-- Logs begin at Tue 2022-08-09 09:43:44 UTC, end at Tue 2022-08-09 10:39:03 UTC. -- Aug 09 10:09:41.609695 dv-cinder-852364-2-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 09 10:09:41.616858 dv-cinder-852364-2-smb devstack@keystone.service[80095]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 09 10:09:41.621868 dv-cinder-852364-2-smb devstack@keystone.service[80095]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 9 10:09:41 2022] *** Aug 09 10:09:41.621868 dv-cinder-852364-2-smb devstack@keystone.service[80095]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 09 10:09:41.621868 dv-cinder-852364-2-smb devstack@keystone.service[80095]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 09 10:09:41.621868 dv-cinder-852364-2-smb devstack@keystone.service[80095]: nodename: dv-cinder-852364-2-smb Aug 09 10:09:41.621868 dv-cinder-852364-2-smb devstack@keystone.service[80095]: machine: x86_64 Aug 09 10:09:41.621868 dv-cinder-852364-2-smb devstack@keystone.service[80095]: clock source: unix Aug 09 10:09:41.621868 dv-cinder-852364-2-smb devstack@keystone.service[80095]: pcre jit disabled Aug 09 10:09:41.621868 dv-cinder-852364-2-smb devstack@keystone.service[80095]: detected number of CPU cores: 4 Aug 09 10:09:41.621868 dv-cinder-852364-2-smb devstack@keystone.service[80095]: current working directory: / Aug 09 10:09:41.621868 dv-cinder-852364-2-smb devstack@keystone.service[80095]: detected binary path: /usr/bin/uwsgi-core Aug 09 10:09:41.621868 dv-cinder-852364-2-smb devstack@keystone.service[80095]: your processes number limit is 47680 Aug 09 10:09:41.621868 dv-cinder-852364-2-smb devstack@keystone.service[80095]: your memory page size is 4096 bytes Aug 09 10:09:41.621868 dv-cinder-852364-2-smb devstack@keystone.service[80095]: detected max file descriptor number: 2048 Aug 09 10:09:41.621868 dv-cinder-852364-2-smb devstack@keystone.service[80095]: lock engine: pthread robust mutexes Aug 09 10:09:41.621868 dv-cinder-852364-2-smb devstack@keystone.service[80095]: thunder lock: enabled Aug 09 10:09:41.621868 dv-cinder-852364-2-smb devstack@keystone.service[80095]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 09 10:09:41.621868 dv-cinder-852364-2-smb devstack@keystone.service[80095]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 09 10:09:41.660458 dv-cinder-852364-2-smb devstack@keystone.service[80095]: Python main interpreter initialized at 0x55ea605399c0 Aug 09 10:09:41.660458 dv-cinder-852364-2-smb devstack@keystone.service[80095]: python threads support enabled Aug 09 10:09:41.660458 dv-cinder-852364-2-smb devstack@keystone.service[80095]: your server socket listen backlog is limited to 100 connections Aug 09 10:09:41.660458 dv-cinder-852364-2-smb devstack@keystone.service[80095]: your mercy for graceful operations on workers is 90 seconds Aug 09 10:09:41.660826 dv-cinder-852364-2-smb devstack@keystone.service[80095]: mapped 403077 bytes (393 KB) for 2 cores Aug 09 10:09:41.660896 dv-cinder-852364-2-smb devstack@keystone.service[80095]: *** Operational MODE: preforking *** Aug 09 10:09:41.661146 dv-cinder-852364-2-smb devstack@keystone.service[80095]: *** uWSGI is running in multiple interpreter mode *** Aug 09 10:09:41.661146 dv-cinder-852364-2-smb devstack@keystone.service[80095]: spawned uWSGI master process (pid: 80095) Aug 09 10:09:41.661350 dv-cinder-852364-2-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 09 10:09:41.662716 dv-cinder-852364-2-smb devstack@keystone.service[80095]: spawned uWSGI worker 1 (pid: 80105, cores: 1) Aug 09 10:09:41.662716 dv-cinder-852364-2-smb devstack@keystone.service[80095]: spawned uWSGI worker 2 (pid: 80106, cores: 1) Aug 09 10:09:41.662716 dv-cinder-852364-2-smb devstack@keystone.service[80095]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 09 10:09:47.131311 dv-cinder-852364-2-smb devstack@keystone.service[80106]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 10:09:47.131311 dv-cinder-852364-2-smb devstack@keystone.service[80106]: from cryptography.utils import int_from_bytes Aug 09 10:09:47.132104 dv-cinder-852364-2-smb devstack@keystone.service[80106]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 10:09:47.132104 dv-cinder-852364-2-smb devstack@keystone.service[80106]: from cryptography.utils import int_from_bytes Aug 09 10:09:47.132243 dv-cinder-852364-2-smb devstack@keystone.service[80105]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 10:09:47.132243 dv-cinder-852364-2-smb devstack@keystone.service[80105]: from cryptography.utils import int_from_bytes Aug 09 10:09:47.132679 dv-cinder-852364-2-smb devstack@keystone.service[80105]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 10:09:47.132679 dv-cinder-852364-2-smb devstack@keystone.service[80105]: from cryptography.utils import int_from_bytes Aug 09 10:09:47.181239 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 09 10:09:47.181405 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 09 10:09:47.181595 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] command line args: [] {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 09 10:09:47.181868 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 09 10:09:47.182044 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 09 10:09:47.182140 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ================================================================================ {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 09 10:09:47.182244 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 09 10:09:47.182338 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] admin_token = **** {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 10:09:47.182418 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] command line args: [] {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 09 10:09:47.182522 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] config_dir = [] {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 10:09:47.182702 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 09 10:09:47.182782 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 10:09:47.182875 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] config_source = [] {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 10:09:47.182963 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ================================================================================ {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 09 10:09:47.183041 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] debug = True {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 10:09:47.183114 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] admin_token = **** {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 10:09:47.183236 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 10:09:47.183514 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] config_dir = [] {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 10:09:47.183514 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 10:09:47.183643 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 10:09:47.183708 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] config_source = [] {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 10:09:47.183767 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 10:09:47.183960 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] debug = True {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 10:09:47.184057 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 10:09:47.184120 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 10:09:47.184202 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 10:09:47.184373 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 10:09:47.184460 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] list_limit = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 10:09:47.184529 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 10:09:47.184594 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] log_config_append = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 10:09:47.184750 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 10:09:47.185343 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 10:09:47.185477 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] log_dir = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 10:09:47.185554 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 10:09:47.185694 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] log_file = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 10:09:47.185963 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] list_limit = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 10:09:47.186048 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 10:09:47.186195 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] log_config_append = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 10:09:47.186275 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 10:09:47.186335 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 10:09:47.186491 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 10:09:47.186571 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] log_dir = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 10:09:47.186696 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 10:09:47.186776 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] log_file = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 10:09:47.186842 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 10:09:47.186907 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 10:09:47.186973 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 10:09:47.187137 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 10:09:47.187216 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 10:09:47.187382 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 10:09:47.187465 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 10:09:47.187631 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 10:09:47.187723 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 10:09:47.187795 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 10:09:47.187860 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 10:09:47.188015 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 10:09:47.188104 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 10:09:47.188244 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 10:09:47.188329 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 10:09:47.188456 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 10:09:47.188541 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 10:09:47.188692 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 10:09:47.188774 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 10:09:47.188920 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 10:09:47.189000 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 10:09:47.189155 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 10:09:47.189388 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 10:09:47.189468 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.36/identity {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 10:09:47.189635 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 10:09:47.189717 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] publish_errors = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 10:09:47.189875 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 10:09:47.189968 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 10:09:47.190105 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 10:09:47.190196 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 10:09:47.190259 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 10:09:47.190503 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 10:09:47.190654 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.36/identity {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 10:09:47.190741 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 10:09:47.190812 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] publish_errors = False {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 10:09:47.190952 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] standard_threads = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 10:09:47.191031 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 10:09:47.191185 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 10:09:47.191275 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 10:09:47.191403 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 10:09:47.191482 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 10:09:47.191613 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 10:09:47.191751 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 10:09:47.191933 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] use_journal = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 10:09:47.191933 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] use_json = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 10:09:47.192187 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 10:09:47.192326 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] use_stderr = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 10:09:47.192460 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] standard_threads = False {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 10:09:47.192589 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] use_syslog = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 10:09:47.192725 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 10:09:47.192856 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 10:09:47.192989 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 10:09:47.193124 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.193259 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 10:09:47.193388 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.193523 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] use_journal = False {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 10:09:47.193523 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] use_json = False {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 10:09:47.193767 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.193936 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] use_stderr = False {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 10:09:47.194090 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.194221 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] use_syslog = False {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 10:09:47.194358 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.194488 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 10:09:47.194622 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.194787 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.194926 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.195055 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.195190 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.195326 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.195455 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.195583 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.195711 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.195838 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.195991 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.196122 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.196256 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.196384 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.196512 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.196639 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.196778 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.196908 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.197045 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.197173 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.197306 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.197436 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.197571 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.197711 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.197862 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.198014 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.198169 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.198300 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.198504 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.198635 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.198763 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.198897 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.199027 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.199156 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.199300 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.199430 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.199565 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.199711 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.199847 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.200019 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.200162 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.200292 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.200459 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.201121 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.201252 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.201390 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.201520 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.201648 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.201781 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.201942 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.202094 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.202233 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.202363 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.202491 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.202618 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.202752 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.202880 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.203016 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.203146 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.203275 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.203275 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.203523 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.203652 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.203797 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.203927 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.204060 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.204189 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.204189 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.204439 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.204579 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.204708 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.204836 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.204971 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.205099 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.205227 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.205432 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.205432 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.205689 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.205817 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.205986 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.206118 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.206254 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.206383 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.206513 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.206641 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.206641 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.206882 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.207023 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.207153 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.207280 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.207407 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.207546 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.207681 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.207820 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.207820 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.208070 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.208208 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.208337 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.208464 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.208601 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.208730 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.208857 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.208985 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.208985 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.209360 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.209507 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.209639 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.209768 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.209950 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.210096 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.210236 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.210368 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.210497 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.210627 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.210627 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.210870 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.211007 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.211154 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.211296 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.211436 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.211577 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.211710 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.211848 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.211848 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.212094 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.212231 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.212362 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.212497 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.212627 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.212757 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.212895 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.213041 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.213041 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.213287 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.213415 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.213590 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.213741 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.213903 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.214040 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.214040 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.214296 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.214425 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.214562 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.214699 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.214846 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.214977 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.215106 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.215241 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.215382 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.215519 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.215519 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.215764 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.215894 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.216185 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.216341 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.216481 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.216640 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.216820 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.216978 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.216978 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.217236 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.217367 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.217503 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.217634 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.217762 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.217933 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.218083 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.218215 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.218215 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.218472 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.218601 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.218730 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.218943 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.219077 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.219206 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.219341 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.219479 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.219479 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.219732 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.219872 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.220010 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.220141 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.220270 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.220398 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.220398 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.220659 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.220791 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.220919 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.221047 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.221176 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.221305 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.221444 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.221574 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.221703 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.221832 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] auth.external = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.221832 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.222111 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.222252 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.222385 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.222524 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.222654 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.222788 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] auth.password = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.222919 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.223063 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] auth.token = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.223195 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.223324 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.223324 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.223567 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.223727 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.223866 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.223998 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.223998 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.224254 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.224392 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.224392 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.224642 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.224772 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] credential.caching = True {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.224916 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] auth.external = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.225048 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.225176 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.225305 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.225305 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.225550 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.225688 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.225819 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.225994 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.226135 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] auth.password = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.226265 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.226395 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] auth.token = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.226535 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.226535 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.226783 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.226911 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.227041 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.227170 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.227170 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.227425 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.227555 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.227684 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.227813 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.227959 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.228102 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.228234 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.228383 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.228521 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.228658 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] federation.caching = True {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.228788 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] credential.caching = True {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.228929 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.229060 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.229190 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.229320 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.229449 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.229580 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.229731 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.229898 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.230035 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.230167 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.230296 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.230426 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.230567 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.230699 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.230829 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.230965 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.231095 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.231234 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.231373 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.231505 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.231662 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.231798 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.231991 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] identity.caching = True {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.232128 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.232341 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.232572 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.232708 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.232840 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.232970 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.233112 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.233244 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.233380 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] federation.caching = True {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.233511 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.233652 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.233782 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.233975 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.234109 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.234239 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.234369 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.234500 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.234630 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.234840 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.234974 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.235104 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.235234 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.235363 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.235492 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.235643 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.235776 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.235907 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.236037 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.236166 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.236296 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.236433 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.236565 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.236695 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] identity.caching = True {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.236825 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.236955 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.236955 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.237209 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.237351 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.237482 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.237611 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.237741 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.237916 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.238062 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.238194 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.238331 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.238466 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.238596 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.238726 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.238864 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.238997 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.239127 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.239266 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.239396 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.239534 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.239673 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.239804 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.239934 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.240065 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.240195 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.240325 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.240463 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.240594 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.240724 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.240853 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.240995 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.241125 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.241264 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.241396 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.241526 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.241655 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.241785 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.241966 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.242110 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.242242 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.242371 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.242501 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.242630 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.242760 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.242911 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.243044 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.243175 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.243304 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.243433 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.243563 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.243701 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.243833 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.243963 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.244093 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.244223 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.244353 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.244490 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.244622 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.244767 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.244899 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.245028 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.245158 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.245297 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.245428 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.245558 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.245695 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.245878 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.246028 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.246161 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.user = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.246292 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.246429 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.246570 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.246700 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.246843 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.246981 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.247112 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.247752 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.247894 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.248023 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.248162 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.248365 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.248596 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.248728 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.248859 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.248988 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.249138 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.249287 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.249420 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.249550 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.249681 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.249811 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.249988 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.250122 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.250252 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.250381 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.250513 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.250642 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.250780 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.250923 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.251054 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.user = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.251183 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.251313 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.251442 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.251581 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.251713 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.251843 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.251973 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.252103 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.252233 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.252370 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.252501 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.252632 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.252771 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.252901 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.253031 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.253169 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.253299 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.253436 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.253436 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.253689 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.253819 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.253987 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.254121 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.254251 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.254380 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.254510 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.254650 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.254789 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.254926 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.255057 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.255187 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.255317 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.255446 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.255583 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.255716 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.255846 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.255975 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.256104 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.256234 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.256382 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.256513 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.256643 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.256773 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.256908 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] resource.caching = True {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.257044 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.257183 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.257314 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.257444 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.257573 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.257702 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.257832 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.258018 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.258151 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.258291 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.258421 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.258550 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.258679 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.258679 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.258942 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.259073 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.259201 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.259339 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.259468 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.259605 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.259736 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] role.caching = True {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.259865 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.259995 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] role.driver = sql {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.260134 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.260263 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.260401 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.260532 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.260662 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] resource.caching = True {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.260790 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.260921 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.261050 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.261255 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.261388 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.261518 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.261647 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.261777 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.261978 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.262114 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.262243 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.262372 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.262501 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.262630 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.262768 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.262996 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.263951 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.264060 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.264126 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.264186 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] role.caching = True {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.264255 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.264318 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] role.driver = sql {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.264389 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.264460 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.264460 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.264587 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.264665 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.264738 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.264807 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.264876 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.264946 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.265015 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.265097 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.265170 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.265240 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.265315 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.265387 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.265457 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.265534 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.265534 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.265663 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.265732 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.265801 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.265894 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.265982 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.266055 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.266124 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.266194 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.266263 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.266263 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.266398 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.266470 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.266539 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.266609 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.266677 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.266754 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.266825 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.266894 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.266894 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.267019 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.267088 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.267165 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.267237 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] token.caching = True {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.267312 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.267383 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.267452 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.267521 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.267597 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.267669 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.267738 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.267738 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.267862 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.267931 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.268008 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.268079 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.268154 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.268225 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.268294 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.268362 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.268439 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.268522 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.268594 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.268663 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.268731 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.268800 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.268876 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.268947 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.269016 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.269085 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] token.caching = True {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.269153 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.269221 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.269297 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.269368 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.269438 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.269506 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.269575 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.269644 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.269720 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.269791 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.269791 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.269926 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] database.connection = **** {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.270008 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.270089 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.270161 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.270239 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.270311 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.270380 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.270449 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.270517 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.270585 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.270662 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.270733 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.270802 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.270871 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.270939 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.271007 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.271084 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.271155 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.271224 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.271293 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.271361 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.271361 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.271493 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.271565 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.271634 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] database.connection = **** {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.271711 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.271790 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.271861 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.271931 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.272006 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.272084 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.272155 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.272224 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.272293 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.272362 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.272430 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.272507 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.272578 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80105) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 09 10:09:47.272648 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.272648 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.272648 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.272648 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.272648 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.272648 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.272648 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.272648 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.272648 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.273174 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.273174 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.273174 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 10:09:47.273174 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80106) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 09 10:09:47.298925 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80105) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 10:09:47.299160 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80105) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 10:09:47.299383 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80105) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 10:09:47.300262 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 10:09:47.300490 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 10:09:47.300712 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 10:09:47.309103 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80105) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 10:09:47.310337 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 10:09:47.337353 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80105) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 10:09:47.337585 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80105) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 10:09:47.338156 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 10:09:47.338387 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 10:09:47.391157 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 10:09:47.391628 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80105) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 10:09:47.441309 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 10:09:47.441537 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 10:09:47.443218 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80105) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 10:09:47.443458 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80105) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 10:09:47.506140 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 10:09:47.506308 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 10:09:47.506528 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 10:09:47.506666 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80105) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 10:09:47.506749 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 10:09:47.506898 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80105) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 10:09:47.506980 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 10:09:47.507122 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80105) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 10:09:47.507203 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 10:09:47.507342 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80105) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 10:09:47.507559 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80105) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 10:09:47.507774 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80105) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 10:09:47.530695 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 10:09:47.530925 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 10:09:47.531038 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80105) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 10:09:47.531150 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 10:09:47.531273 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80105) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 10:09:47.531356 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 10:09:47.531502 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80105) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 10:09:47.531583 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 10:09:47.531728 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80105) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 10:09:47.531823 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 10:09:47.531952 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80105) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 10:09:47.532032 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 10:09:47.532171 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80105) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 10:09:47.532385 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80105) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 10:09:47.543165 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 10:09:47.543640 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80105) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 10:09:47.556403 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 10:09:47.556650 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 10:09:47.556873 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 10:09:47.556954 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80105) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 10:09:47.557091 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 10:09:47.557174 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80105) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 10:09:47.557304 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 10:09:47.557385 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80105) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 10:09:47.557514 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 10:09:47.557604 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80105) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 10:09:47.557725 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80106) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 10:09:47.557807 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80105) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 10:09:47.558004 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80105) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 10:09:47.558188 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80105) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 09 10:09:47.574737 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.574943 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 09 10:09:47.575280 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.575360 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.576010 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 09 10:09:47.576175 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 09 10:09:47.576284 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.576354 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.576594 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 09 10:09:47.576685 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.576786 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.576876 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.577038 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.577117 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.577297 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.577554 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.588333 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.588606 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.588872 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.589050 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.589133 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.589330 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.589602 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.589914 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.596170 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=80106) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 10:09:47.596954 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=80105) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 10:09:47.599227 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=80106) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 10:09:47.599508 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.599794 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.600070 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=80105) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 10:09:47.600154 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.600352 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.600434 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.600619 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.600702 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.600883 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.600965 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.601156 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.601246 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.601423 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.601505 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.601703 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.601784 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.601992 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.602077 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.602264 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.602539 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.602816 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.625833 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.626919 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.627347 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80106) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 10:09:47.627635 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.628443 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80105) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 10:09:47.628728 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.632227 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=80106) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 10:09:47.632510 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.632789 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.633354 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=80105) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 10:09:47.633638 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.633947 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.640134 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=80106) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 10:09:47.640414 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.641070 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=80105) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 10:09:47.641358 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.644443 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80106) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 10:09:47.644730 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.645009 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.645288 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.645410 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80105) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 10:09:47.645559 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.645703 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.645829 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.646012 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.646120 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.646298 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.646390 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.646577 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.646856 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.647128 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.647398 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.662097 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.662373 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.663395 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.663679 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.666670 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80106) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 10:09:47.667961 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80105) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 10:09:47.670417 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.670706 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.671722 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.672021 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.675083 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80106) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 10:09:47.676444 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80105) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 10:09:47.678259 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80106) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 10:09:47.679673 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80105) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 10:09:47.681396 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.681692 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.681997 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.682276 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.682551 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.682841 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.682923 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.683166 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.683456 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.683752 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.684030 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.684308 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.698848 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80106) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 10:09:47.699138 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.699402 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.699661 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.701096 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80105) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 10:09:47.701334 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.701607 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.701927 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.707240 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.708798 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.708888 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.709074 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.710442 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.710738 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.711890 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=80106) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 10:09:47.712171 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.712464 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.712750 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.713022 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.713540 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=80105) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 10:09:47.713825 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.714138 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.714431 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.714707 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.724667 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=80106) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 10:09:47.724944 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.725216 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.725488 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.725762 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.726057 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.726326 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=80105) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 10:09:47.726423 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.726607 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.726885 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.727161 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.727441 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.727722 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.727999 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.743096 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=80106) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 10:09:47.744723 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=80105) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 10:09:47.746054 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80106) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 10:09:47.748364 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80105) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 10:09:47.749519 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.751107 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.751443 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.752597 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=80106) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 10:09:47.752884 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.753030 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.753170 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.754582 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=80105) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 10:09:47.754882 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.755167 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.759639 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.761202 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=80106) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 10:09:47.761628 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.763847 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=80105) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 10:09:47.765065 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.765351 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.765633 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.765930 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.766839 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.767387 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.767672 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.767971 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.774048 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80106) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 10:09:47.774448 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.774927 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.776128 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80105) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 10:09:47.776418 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.776697 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.781987 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=80106) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 10:09:47.782266 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.782546 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.782823 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.783094 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.783375 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.783648 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=80105) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 09 10:09:47.783731 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.783910 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.783991 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.784196 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.784278 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.784474 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.784556 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.784750 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.784839 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.785040 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.785122 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.785323 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.785451 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.785583 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80106) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.785664 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.785992 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.786279 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.786565 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.786831 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.787107 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.787370 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80105) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 09 10:09:47.819566 dv-cinder-852364-2-smb devstack@keystone.service[80106]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ea605399c0 pid: 80106 (default app) Aug 09 10:09:47.821880 dv-cinder-852364-2-smb devstack@keystone.service[80105]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ea605399c0 pid: 80105 (default app) Aug 09 10:09:47.822813 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b7dec-e031-47b5-8365-072021afde1a None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:09:47.823097 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b7dec-e031-47b5-8365-072021afde1a None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:09:47.823367 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b7dec-e031-47b5-8365-072021afde1a None None] PATH_INFO: `/v3` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:09:47.827832 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1/1] 10.222.0.36 () {50 vars in 791 bytes} [Tue Aug 9 10:09:47 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:09:55.593340 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab925791-fbae-4467-a4af-d62ef82a176e None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:09:55.593937 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab925791-fbae-4467-a4af-d62ef82a176e None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:09:55.593937 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab925791-fbae-4467-a4af-d62ef82a176e None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:09:55.598941 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1/2] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:09:55 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:09:55.604883 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234016e-86d5-443a-a684-aacd5eaca616 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:09:55.605637 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234016e-86d5-443a-a684-aacd5eaca616 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:09:55.605637 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234016e-86d5-443a-a684-aacd5eaca616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:09:55.685183 dv-cinder-852364-2-smb devstack@keystone.service[80106]: INFO dbcounter [None req-a234016e-86d5-443a-a684-aacd5eaca616 None None] Registered counter for database keystone Aug 09 10:09:55.706061 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG oslo_db.sqlalchemy.engines [None req-a234016e-86d5-443a-a684-aacd5eaca616 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80106) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 10:09:55.712960 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writer thread running {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 10:09:55.898798 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG passlib.handlers.bcrypt [None req-a234016e-86d5-443a-a684-aacd5eaca616 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80106) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 09 10:09:55.899294 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG passlib.handlers.bcrypt [None req-a234016e-86d5-443a-a684-aacd5eaca616 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80106) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 09 10:09:55.958274 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-a234016e-86d5-443a-a684-aacd5eaca616 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:09:55.960405 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-a234016e-86d5-443a-a684-aacd5eaca616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:09:56.110158 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 2/3] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:09:55 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 506 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 09 10:09:56.218123 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab925791-fbae-4467-a4af-d62ef82a176e None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:09:56.290276 dv-cinder-852364-2-smb devstack@keystone.service[80105]: INFO dbcounter [None req-ab925791-fbae-4467-a4af-d62ef82a176e None None] Registered counter for database keystone Aug 09 10:09:56.311957 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG oslo_db.sqlalchemy.engines [None req-ab925791-fbae-4467-a4af-d62ef82a176e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80105) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 10:09:56.318118 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writer thread running {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 10:09:56.436671 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab925791-fbae-4467-a4af-d62ef82a176e None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:09:56.441075 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6585829-89a4-49f6-9207-3979484a0a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:09:56.441692 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6585829-89a4-49f6-9207-3979484a0a05 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:09:56.442001 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6585829-89a4-49f6-9207-3979484a0a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:09:56.442276 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6585829-89a4-49f6-9207-3979484a0a05 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:09:56.451008 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6585829-89a4-49f6-9207-3979484a0a05 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:09:56.505091 dv-cinder-852364-2-smb devstack@keystone.service[80105]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b6585829-89a4-49f6-9207-3979484a0a05 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 09 10:09:56.505366 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6585829-89a4-49f6-9207-3979484a0a05 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:09:56.515398 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 2/4] 10.222.0.36 () {58 vars in 1324 bytes} [Tue Aug 9 10:09:56 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 09 10:09:56.521366 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a234016e-86d5-443a-a684-aacd5eaca616 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:09:56.535678 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a234016e-86d5-443a-a684-aacd5eaca616 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:09:56.540347 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0c911d-84b5-4103-8310-800da5529613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:09:56.541462 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0c911d-84b5-4103-8310-800da5529613 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:09:56.541751 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0c911d-84b5-4103-8310-800da5529613 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:09:56.542063 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0c911d-84b5-4103-8310-800da5529613 admin admin] PATH_INFO: `/v3/projects/182565a8c7ef44d4a6cfcadb2f45a71f` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:09:56.543501 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0c911d-84b5-4103-8310-800da5529613 admin admin] RBAC: Authorizing `identity:get_project(project_id=182565a8c7ef44d4a6cfcadb2f45a71f)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:09:56.595443 dv-cinder-852364-2-smb devstack@keystone.service[80106]: WARNING keystone.common.rbac_enforcer.enforcer [None req-8f0c911d-84b5-4103-8310-800da5529613 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 09 10:09:56.595781 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0c911d-84b5-4103-8310-800da5529613 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:09:56.600395 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 3/5] 10.222.0.36 () {56 vars in 1207 bytes} [Tue Aug 9 10:09:56 2022] GET /identity/v3/projects/182565a8c7ef44d4a6cfcadb2f45a71f => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:09:58.574298 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3743764a-a573-41bf-b693-6ecc45f1a392 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:09:58.574848 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3743764a-a573-41bf-b693-6ecc45f1a392 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:09:58.574848 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3743764a-a573-41bf-b693-6ecc45f1a392 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:09:58.579757 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 3/6] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:09:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:09:58.585034 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d45eb-8147-4314-bc2c-c3236937bb47 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:09:58.585406 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d45eb-8147-4314-bc2c-c3236937bb47 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:09:58.585590 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d45eb-8147-4314-bc2c-c3236937bb47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:09:58.606554 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-1b6d45eb-8147-4314-bc2c-c3236937bb47 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:09:58.608591 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-1b6d45eb-8147-4314-bc2c-c3236937bb47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:09:58.617418 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 4/7] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:09:58 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 09 10:09:58.640413 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3743764a-a573-41bf-b693-6ecc45f1a392 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:09:58.652551 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3743764a-a573-41bf-b693-6ecc45f1a392 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:09:58.656884 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4d80f3-93ed-4e6f-b587-66d3bec71a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:09:58.657475 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d80f3-93ed-4e6f-b587-66d3bec71a03 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:09:58.657758 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d80f3-93ed-4e6f-b587-66d3bec71a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:09:58.658056 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d80f3-93ed-4e6f-b587-66d3bec71a03 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:09:58.665916 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4d80f3-93ed-4e6f-b587-66d3bec71a03 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:09:58.667677 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4d80f3-93ed-4e6f-b587-66d3bec71a03 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:09:58.677000 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 4/8] 10.222.0.36 () {58 vars in 1324 bytes} [Tue Aug 9 10:09:58 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 10:09:58.682410 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6d45eb-8147-4314-bc2c-c3236937bb47 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:09:58.692452 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6d45eb-8147-4314-bc2c-c3236937bb47 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:09:58.696784 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2852b53c-5d24-4a8b-b242-c1e3dfbc31bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:09:58.697400 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2852b53c-5d24-4a8b-b242-c1e3dfbc31bf admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:09:58.697681 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2852b53c-5d24-4a8b-b242-c1e3dfbc31bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:09:58.697997 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2852b53c-5d24-4a8b-b242-c1e3dfbc31bf admin admin] PATH_INFO: `/v3/users/f678c8c3c6754b9a81efff6e9db8f623` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:09:58.699308 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2852b53c-5d24-4a8b-b242-c1e3dfbc31bf admin admin] RBAC: Authorizing `identity:get_user(user_id=f678c8c3c6754b9a81efff6e9db8f623)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:09:58.701591 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2852b53c-5d24-4a8b-b242-c1e3dfbc31bf admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:09:58.703121 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 5/9] 10.222.0.36 () {56 vars in 1198 bytes} [Tue Aug 9 10:09:58 2022] GET /identity/v3/users/f678c8c3c6754b9a81efff6e9db8f623 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:10:00.755941 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b1144-58ae-45c7-836b-ce69c6e39a6b None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:00.756484 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b1144-58ae-45c7-836b-ce69c6e39a6b None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:00.756484 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b1144-58ae-45c7-836b-ce69c6e39a6b None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:00.757796 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 5/10] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:10:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:10:00.762793 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45253f7-79c6-477b-b5c0-5f4a7939ac2b None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:00.763212 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45253f7-79c6-477b-b5c0-5f4a7939ac2b None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:00.763527 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45253f7-79c6-477b-b5c0-5f4a7939ac2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:00.781733 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-c45253f7-79c6-477b-b5c0-5f4a7939ac2b None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:10:00.782915 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-c45253f7-79c6-477b-b5c0-5f4a7939ac2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:10:00.813834 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f460b5-0871-4387-8f7a-c9c2b293bf9d None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:00.814146 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f460b5-0871-4387-8f7a-c9c2b293bf9d None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:00.814422 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f460b5-0871-4387-8f7a-c9c2b293bf9d None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:00.815729 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 6/11] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:10:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 10:10:00.820857 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad66fea-4f1b-4877-93d5-6063027990f4 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:00.821144 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad66fea-4f1b-4877-93d5-6063027990f4 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:00.821423 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad66fea-4f1b-4877-93d5-6063027990f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:00.862942 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 6/12] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:10:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 10:10:00.864631 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG passlib.handlers.bcrypt [None req-3ad66fea-4f1b-4877-93d5-6063027990f4 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80105) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 09 10:10:00.865052 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG passlib.handlers.bcrypt [None req-3ad66fea-4f1b-4877-93d5-6063027990f4 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80105) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 09 10:10:00.885227 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45253f7-79c6-477b-b5c0-5f4a7939ac2b None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:00.909262 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:00.910893 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-3ad66fea-4f1b-4877-93d5-6063027990f4 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:10:00.912474 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-3ad66fea-4f1b-4877-93d5-6063027990f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:10:00.989829 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45253f7-79c6-477b-b5c0-5f4a7939ac2b None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:01.011284 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 7/13] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:10:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 10:10:01.023642 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a1a60e-7a0f-4636-b067-7b78ba321f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:01.024275 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a1a60e-7a0f-4636-b067-7b78ba321f57 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:01.024556 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a1a60e-7a0f-4636-b067-7b78ba321f57 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:01.024836 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a1a60e-7a0f-4636-b067-7b78ba321f57 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:01.033620 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad66fea-4f1b-4877-93d5-6063027990f4 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:01.036991 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a1a60e-7a0f-4636-b067-7b78ba321f57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 10:10:01.047116 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-c8a1a60e-7a0f-4636-b067-7b78ba321f57 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 10:10:01.047116 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:10:01.047116 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:10:01.047116 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:10:01.047116 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:10:01.047116 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:10:01.047116 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:10:01.047116 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:10:01.047116 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:10:01.047116 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:10:01.047116 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:10:01.047116 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:10:01.047116 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 10:10:01.047116 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 10:10:01.047116 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 10:10:01.047116 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 10:10:01.048024 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 10:10:01.048024 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 10:10:01.048024 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 10:10:01.048024 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 10:10:01.048024 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:10:01.048024 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:10:01.048024 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:10:01.048024 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:10:01.048024 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:10:01.048024 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:10:01.048024 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:10:01.048024 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:10:01.048024 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:10:01.048024 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:10:01.048024 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:10:01.048024 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:10:01.048860 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:10:01.048860 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:10:01.048860 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:10:01.048860 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:10:01.048860 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 10:10:01.048860 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 10:10:01.048860 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 10:10:01.048860 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 10:10:01.048860 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 10:10:01.048860 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 10:10:01.048860 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 10:10:01.048860 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:10:01.048860 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 7/14] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Aug 9 10:10:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 10:10:01.054026 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a1a60e-7a0f-4636-b067-7b78ba321f57 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:01.133306 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad66fea-4f1b-4877-93d5-6063027990f4 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:01.134717 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:01.135910 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:01.155432 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a1a60e-7a0f-4636-b067-7b78ba321f57 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:01.172860 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d662dde-25d3-42a4-b3cf-be2b4b4d72a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:01.173722 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d662dde-25d3-42a4-b3cf-be2b4b4d72a2 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:01.174037 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d662dde-25d3-42a4-b3cf-be2b4b4d72a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:01.174312 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d662dde-25d3-42a4-b3cf-be2b4b4d72a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:01.189555 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c14c49-4e32-4cfe-bea8-0bbdf50ba723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:01.190190 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c14c49-4e32-4cfe-bea8-0bbdf50ba723 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:01.190466 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c14c49-4e32-4cfe-bea8-0bbdf50ba723 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:01.190735 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c14c49-4e32-4cfe-bea8-0bbdf50ba723 None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:01.191393 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c14c49-4e32-4cfe-bea8-0bbdf50ba723 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:10:01.191694 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c14c49-4e32-4cfe-bea8-0bbdf50ba723 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:01.193099 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c14c49-4e32-4cfe-bea8-0bbdf50ba723 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:01.205241 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 8/15] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Aug 9 10:10:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:10:01.210326 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c14c49-4e32-4cfe-bea8-0bbdf50ba723 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:01.241539 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d662dde-25d3-42a4-b3cf-be2b4b4d72a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:01.243079 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d662dde-25d3-42a4-b3cf-be2b4b4d72a2 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:01.346884 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 8/16] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Aug 9 10:10:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 09 10:10:01.352689 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d662dde-25d3-42a4-b3cf-be2b4b4d72a2 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:01.355894 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:01.418454 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c14c49-4e32-4cfe-bea8-0bbdf50ba723 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:01.453299 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6ed2a2-d770-4b8a-b5d9-64de4fa9268d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:01.453945 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6ed2a2-d770-4b8a-b5d9-64de4fa9268d None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:01.454091 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d662dde-25d3-42a4-b3cf-be2b4b4d72a2 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:01.454234 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6ed2a2-d770-4b8a-b5d9-64de4fa9268d None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:01.454506 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6ed2a2-d770-4b8a-b5d9-64de4fa9268d None admin] PATH_INFO: `/v3/users/f678c8c3c6754b9a81efff6e9db8f623` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:01.455658 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6ed2a2-d770-4b8a-b5d9-64de4fa9268d None admin] RBAC: Authorizing `identity:get_user(user_id=f678c8c3c6754b9a81efff6e9db8f623)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:01.457106 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6ed2a2-d770-4b8a-b5d9-64de4fa9268d None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:01.458698 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 9/17] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Aug 9 10:10:01 2022] GET /identity/v3/users/f678c8c3c6754b9a81efff6e9db8f623 => generated 247 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:10:01.463988 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6ed2a2-d770-4b8a-b5d9-64de4fa9268d None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:01.478290 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:01.488352 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235c3685-12e1-4f9a-99d9-4894461a2eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:01.489189 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c3685-12e1-4f9a-99d9-4894461a2eb0 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:01.489472 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c3685-12e1-4f9a-99d9-4894461a2eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:01.489745 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c3685-12e1-4f9a-99d9-4894461a2eb0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:01.508146 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235c3685-12e1-4f9a-99d9-4894461a2eb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:01.509603 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235c3685-12e1-4f9a-99d9-4894461a2eb0 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:01.527916 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-235c3685-12e1-4f9a-99d9-4894461a2eb0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:10:01.527916 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:10:01.527916 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:10:01.527916 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:10:01.527916 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:10:01.527916 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:10:01.527916 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:10:01.527916 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:10:01.527916 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:10:01.527916 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:10:01.527916 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:10:01.527916 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:10:01.527916 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 10:10:01.527916 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 10:10:01.527916 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 10:10:01.527916 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 10:10:01.528862 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:10:01.528862 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:10:01.528862 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:10:01.528862 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:10:01.528862 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:10:01.528862 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:10:01.528862 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:10:01.528862 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:10:01.528862 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:10:01.528862 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:10:01.528862 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:10:01.528862 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:10:01.528862 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:10:01.528862 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:10:01.528862 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:10:01.528862 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:10:01.528862 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 10:10:01.529661 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 10:10:01.529661 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:10:01.529661 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:10:01.529661 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 9/18] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:10:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 10:10:01.534771 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235c3685-12e1-4f9a-99d9-4894461a2eb0 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:01.564007 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6ed2a2-d770-4b8a-b5d9-64de4fa9268d None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:01.590750 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:01.598279 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d38b14-98a4-4e62-a4ea-a0ce81c7134a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:01.598841 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d38b14-98a4-4e62-a4ea-a0ce81c7134a None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:01.599117 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d38b14-98a4-4e62-a4ea-a0ce81c7134a None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:01.599385 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d38b14-98a4-4e62-a4ea-a0ce81c7134a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:01.600488 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d38b14-98a4-4e62-a4ea-a0ce81c7134a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:01.601943 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d38b14-98a4-4e62-a4ea-a0ce81c7134a None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:01.603478 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 10/19] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:10:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:10:01.609620 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d38b14-98a4-4e62-a4ea-a0ce81c7134a None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:01.634721 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235c3685-12e1-4f9a-99d9-4894461a2eb0 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:01.668154 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7278de34-97b9-4d65-97c5-603cc7fcdd30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:01.668749 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7278de34-97b9-4d65-97c5-603cc7fcdd30 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:01.669025 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7278de34-97b9-4d65-97c5-603cc7fcdd30 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:01.670145 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7278de34-97b9-4d65-97c5-603cc7fcdd30 None admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:01.670482 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7278de34-97b9-4d65-97c5-603cc7fcdd30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:10:01.670783 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7278de34-97b9-4d65-97c5-603cc7fcdd30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:01.672153 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7278de34-97b9-4d65-97c5-603cc7fcdd30 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:01.688323 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:01.689353 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 10/20] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Aug 9 10:10:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:10:01.708476 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d38b14-98a4-4e62-a4ea-a0ce81c7134a None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:01.744744 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d792cc-0467-4528-b1cd-6940505a9818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:01.745360 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d792cc-0467-4528-b1cd-6940505a9818 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:01.745640 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d792cc-0467-4528-b1cd-6940505a9818 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:01.745945 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d792cc-0467-4528-b1cd-6940505a9818 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:01.746690 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d792cc-0467-4528-b1cd-6940505a9818 None admin] RBAC: Adding query filter params (role.id=89ca30cbbb634be8a96e9921aa56626b, scope.domain.id=default, user.id=f678c8c3c6754b9a81efff6e9db8f623) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:10:01.747000 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d792cc-0467-4528-b1cd-6940505a9818 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:01.749095 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d792cc-0467-4528-b1cd-6940505a9818 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:01.756580 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 11/21] 10.222.0.36 () {56 vars in 1322 bytes} [Tue Aug 9 10:10:01 2022] GET /identity/v3/role_assignments?user.id=f678c8c3c6754b9a81efff6e9db8f623&scope.domain.id=default&role.id=89ca30cbbb634be8a96e9921aa56626b => generated 233 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:10:03.964454 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d449c2-9512-4c10-a8a1-fb99b66a2bd4 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:03.964935 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d449c2-9512-4c10-a8a1-fb99b66a2bd4 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:03.965032 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d449c2-9512-4c10-a8a1-fb99b66a2bd4 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:03.966444 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 11/22] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:10:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:10:03.971811 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a6702-df63-462c-aa83-f67c86827bf1 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:03.972230 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a6702-df63-462c-aa83-f67c86827bf1 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:03.972394 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a6702-df63-462c-aa83-f67c86827bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:04.001348 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-5c7a6702-df63-462c-aa83-f67c86827bf1 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:10:04.002610 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-5c7a6702-df63-462c-aa83-f67c86827bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:10:04.100167 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 12/23] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:10:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 10:10:04.140038 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d449c2-9512-4c10-a8a1-fb99b66a2bd4 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:04.274868 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d449c2-9512-4c10-a8a1-fb99b66a2bd4 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:04.275304 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a475d7b-bc2f-4ac3-8f97-c24d7f455b65 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:04.275598 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a475d7b-bc2f-4ac3-8f97-c24d7f455b65 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:04.275879 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a475d7b-bc2f-4ac3-8f97-c24d7f455b65 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:04.277532 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 13/24] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:10:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:10:04.296492 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd263c-ac50-4f30-b329-747b8a3ad4d0 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:04.296796 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd263c-ac50-4f30-b329-747b8a3ad4d0 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:04.297074 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd263c-ac50-4f30-b329-747b8a3ad4d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:04.300641 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:04.330854 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-7fdd263c-ac50-4f30-b329-747b8a3ad4d0 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:10:04.332058 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-7fdd263c-ac50-4f30-b329-747b8a3ad4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:10:04.335665 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7349c5aa-5c9c-45a6-8527-77dc41f798e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:04.336298 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7349c5aa-5c9c-45a6-8527-77dc41f798e5 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:04.336578 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7349c5aa-5c9c-45a6-8527-77dc41f798e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:04.336842 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7349c5aa-5c9c-45a6-8527-77dc41f798e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:04.359712 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7349c5aa-5c9c-45a6-8527-77dc41f798e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:04.361358 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7349c5aa-5c9c-45a6-8527-77dc41f798e5 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:04.508587 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-7349c5aa-5c9c-45a6-8527-77dc41f798e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:10:04.508587 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:10:04.508587 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:10:04.508587 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:10:04.508587 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:10:04.508587 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:10:04.508587 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:10:04.508587 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:10:04.508587 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:10:04.508587 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:10:04.508587 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:10:04.508587 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:10:04.508587 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 10:10:04.508587 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 10:10:04.508587 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 10:10:04.508587 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 10:10:04.509530 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:10:04.509530 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:10:04.509530 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:10:04.509530 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:10:04.509530 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:10:04.509530 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:10:04.509530 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:10:04.509530 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:10:04.509530 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:10:04.509530 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:10:04.509530 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:10:04.509530 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:10:04.509530 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:10:04.509530 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:10:04.509530 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:10:04.509530 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:10:04.509530 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 10:10:04.510357 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 10:10:04.510357 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:10:04.510357 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:10:04.510357 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 12/25] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:10:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 370 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:10:04.512328 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 14/26] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:10:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 10:10:04.516074 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdd263c-ac50-4f30-b329-747b8a3ad4d0 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:04.518416 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2dd40-d4ff-44ea-8922-ea97fc8328af None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:04.518702 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2dd40-d4ff-44ea-8922-ea97fc8328af None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:04.518976 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2dd40-d4ff-44ea-8922-ea97fc8328af None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:04.520249 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 13/27] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:10:04 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:10:04.526962 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:04.527308 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e792f6e8-2483-48a9-bddd-bae0b7bb11c4 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:04.527589 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e792f6e8-2483-48a9-bddd-bae0b7bb11c4 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:04.527855 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e792f6e8-2483-48a9-bddd-bae0b7bb11c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:04.575498 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-e792f6e8-2483-48a9-bddd-bae0b7bb11c4 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:10:04.576795 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-e792f6e8-2483-48a9-bddd-bae0b7bb11c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:10:04.693708 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 14/28] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:10:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 10:10:04.694650 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e792f6e8-2483-48a9-bddd-bae0b7bb11c4 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:04.702614 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdd263c-ac50-4f30-b329-747b8a3ad4d0 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:04.742080 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f9d790-d524-49a6-b5f4-08f89d3f1d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:04.743431 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f9d790-d524-49a6-b5f4-08f89d3f1d86 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:04.743905 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f9d790-d524-49a6-b5f4-08f89d3f1d86 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:04.744537 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f9d790-d524-49a6-b5f4-08f89d3f1d86 None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:04.745382 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f9d790-d524-49a6-b5f4-08f89d3f1d86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:10:04.745895 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f9d790-d524-49a6-b5f4-08f89d3f1d86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:04.747818 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f9d790-d524-49a6-b5f4-08f89d3f1d86 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:04.769245 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 15/29] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Aug 9 10:10:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:10:04.770573 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f9d790-d524-49a6-b5f4-08f89d3f1d86 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:04.852435 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:04.857221 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e792f6e8-2483-48a9-bddd-bae0b7bb11c4 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:04.861833 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:04.900650 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8395f193-9f21-4f1a-99ee-58b742cc783c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:04.902939 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8395f193-9f21-4f1a-99ee-58b742cc783c None admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:04.903729 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8395f193-9f21-4f1a-99ee-58b742cc783c None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:04.905256 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8395f193-9f21-4f1a-99ee-58b742cc783c None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:04.906148 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8395f193-9f21-4f1a-99ee-58b742cc783c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:04.908622 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8395f193-9f21-4f1a-99ee-58b742cc783c None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:04.931179 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f9d790-d524-49a6-b5f4-08f89d3f1d86 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:04.980484 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e509f7-ed66-43e2-ac33-d451cbdd1fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:04.982554 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e509f7-ed66-43e2-ac33-d451cbdd1fd9 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:04.983076 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e509f7-ed66-43e2-ac33-d451cbdd1fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:04.983584 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e509f7-ed66-43e2-ac33-d451cbdd1fd9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:04.995021 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e509f7-ed66-43e2-ac33-d451cbdd1fd9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 10:10:05.000887 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-e3e509f7-ed66-43e2-ac33-d451cbdd1fd9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 10:10:05.000887 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:10:05.000887 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:10:05.000887 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:10:05.000887 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:10:05.000887 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:10:05.000887 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:10:05.000887 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:10:05.000887 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:10:05.000887 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:10:05.000887 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:10:05.000887 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:10:05.000887 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 10:10:05.000887 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 10:10:05.000887 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 10:10:05.000887 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 10:10:05.001717 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 10:10:05.001717 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 10:10:05.001717 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 10:10:05.001717 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 10:10:05.001717 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:10:05.001717 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:10:05.001717 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:10:05.001717 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:10:05.001717 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:10:05.001717 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:10:05.001717 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:10:05.001717 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:10:05.001717 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:10:05.001717 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:10:05.001717 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:10:05.001717 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:10:05.002921 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:10:05.002921 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:10:05.002921 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:10:05.002921 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:10:05.002921 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 10:10:05.002921 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 10:10:05.002921 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 10:10:05.002921 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 10:10:05.002921 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 10:10:05.002921 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 10:10:05.002921 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 10:10:05.002921 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:10:05.005350 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 16/30] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Aug 9 10:10:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:10:05.006378 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e509f7-ed66-43e2-ac33-d451cbdd1fd9 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:05.078955 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 15/31] 10.222.0.36 () {60 vars in 1131 bytes} [Tue Aug 9 10:10:04 2022] POST /identity/v3/roles => generated 219 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:10:05.081288 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2c4204-c41d-4fb4-8540-805dfdcd29db None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:05.081798 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2c4204-c41d-4fb4-8540-805dfdcd29db None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:05.082296 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2c4204-c41d-4fb4-8540-805dfdcd29db None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:05.083868 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 16/32] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:10:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:10:05.084924 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2c4204-c41d-4fb4-8540-805dfdcd29db None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:05.168979 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e509f7-ed66-43e2-ac33-d451cbdd1fd9 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:05.214809 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2c4204-c41d-4fb4-8540-805dfdcd29db None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:05.227440 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:05.259292 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ceb224-a12d-47de-bc3d-6a09dc15a6ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:05.260285 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ceb224-a12d-47de-bc3d-6a09dc15a6ec None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:05.260856 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ceb224-a12d-47de-bc3d-6a09dc15a6ec None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:05.261198 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf582e2-5bc7-494a-8b49-665d7c4d0308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:05.261542 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ceb224-a12d-47de-bc3d-6a09dc15a6ec None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:05.261815 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf582e2-5bc7-494a-8b49-665d7c4d0308 None admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:05.262170 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf582e2-5bc7-494a-8b49-665d7c4d0308 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:05.262449 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf582e2-5bc7-494a-8b49-665d7c4d0308 None admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:05.263185 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf582e2-5bc7-494a-8b49-665d7c4d0308 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:05.263554 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ceb224-a12d-47de-bc3d-6a09dc15a6ec None admin] RBAC: Adding query filter params (name=admin) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:10:05.264077 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ceb224-a12d-47de-bc3d-6a09dc15a6ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:05.264654 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf582e2-5bc7-494a-8b49-665d7c4d0308 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:05.266013 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ceb224-a12d-47de-bc3d-6a09dc15a6ec None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:05.280633 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 17/33] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Aug 9 10:10:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:05.282301 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f3f21f-1083-4c1b-afd2-a82cc85ee605 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:05.282780 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f3f21f-1083-4c1b-afd2-a82cc85ee605 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:05.283263 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f3f21f-1083-4c1b-afd2-a82cc85ee605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:05.305972 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-98f3f21f-1083-4c1b-afd2-a82cc85ee605 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:10:05.307978 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-98f3f21f-1083-4c1b-afd2-a82cc85ee605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:10:05.326429 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:05.395184 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 18/34] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:10:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 10:10:05.396497 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f3f21f-1083-4c1b-afd2-a82cc85ee605 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:05.446423 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 17/35] 10.222.0.36 () {60 vars in 1141 bytes} [Tue Aug 9 10:10:05 2022] POST /identity/v3/projects => generated 301 bytes in 440 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:10:05.447806 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7d57a9-d45e-44f2-a795-94d367a159fe None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:05.448098 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7d57a9-d45e-44f2-a795-94d367a159fe None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:05.448375 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7d57a9-d45e-44f2-a795-94d367a159fe None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:05.449888 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 18/36] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:10:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:10:05.454849 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7d57a9-d45e-44f2-a795-94d367a159fe None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:05.521415 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f3f21f-1083-4c1b-afd2-a82cc85ee605 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:05.562172 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25370d67-81fa-4042-a91f-b781505a756f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:05.563284 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25370d67-81fa-4042-a91f-b781505a756f None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:05.563864 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25370d67-81fa-4042-a91f-b781505a756f None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:05.564325 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25370d67-81fa-4042-a91f-b781505a756f None admin] PATH_INFO: `/v3/users/f678c8c3c6754b9a81efff6e9db8f623` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:05.566536 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25370d67-81fa-4042-a91f-b781505a756f None admin] RBAC: Authorizing `identity:get_user(user_id=f678c8c3c6754b9a81efff6e9db8f623)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:05.568587 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25370d67-81fa-4042-a91f-b781505a756f None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:05.571324 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 19/37] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Aug 9 10:10:05 2022] GET /identity/v3/users/f678c8c3c6754b9a81efff6e9db8f623 => generated 247 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:05.573121 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee48b73-265a-42aa-902d-2c2713ba2b02 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:05.573607 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee48b73-265a-42aa-902d-2c2713ba2b02 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:05.574097 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee48b73-265a-42aa-902d-2c2713ba2b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:05.593328 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-dee48b73-265a-42aa-902d-2c2713ba2b02 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:10:05.594889 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-dee48b73-265a-42aa-902d-2c2713ba2b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:10:05.602973 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7d57a9-d45e-44f2-a795-94d367a159fe None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:05.611284 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:05.650829 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a86f0d-4957-4577-ab16-40fde1ce8bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:05.651722 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a86f0d-4957-4577-ab16-40fde1ce8bff None admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:05.652012 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a86f0d-4957-4577-ab16-40fde1ce8bff None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:05.652285 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a86f0d-4957-4577-ab16-40fde1ce8bff None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:05.653419 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a86f0d-4957-4577-ab16-40fde1ce8bff None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:05.654667 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a86f0d-4957-4577-ab16-40fde1ce8bff None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:05.672971 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 19/38] 10.222.0.36 () {60 vars in 1131 bytes} [Tue Aug 9 10:10:05 2022] POST /identity/v3/roles => generated 225 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:10:05.682626 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a86f0d-4957-4577-ab16-40fde1ce8bff None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:05.696855 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 20/39] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:10:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 10:10:05.699367 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a67c5c4-6d75-41c0-9b72-00e49ab5069b None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:05.699917 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a67c5c4-6d75-41c0-9b72-00e49ab5069b None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:05.700611 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a67c5c4-6d75-41c0-9b72-00e49ab5069b None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:05.703020 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 21/40] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:10:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:10:05.708894 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01eefbd-dc63-4fb6-9b26-7a9b2d8fb1b4 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:05.709507 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01eefbd-dc63-4fb6-9b26-7a9b2d8fb1b4 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:05.710366 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01eefbd-dc63-4fb6-9b26-7a9b2d8fb1b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:05.730649 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:05.734427 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-e01eefbd-dc63-4fb6-9b26-7a9b2d8fb1b4 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:10:05.735653 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-e01eefbd-dc63-4fb6-9b26-7a9b2d8fb1b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:10:05.812323 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a86f0d-4957-4577-ab16-40fde1ce8bff None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:05.813186 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 22/41] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:10:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 10:10:05.813884 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01eefbd-dc63-4fb6-9b26-7a9b2d8fb1b4 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:05.871645 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c77fa7-c769-418e-a60c-ecbde24c8ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:05.872850 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c77fa7-c769-418e-a60c-ecbde24c8ef1 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:05.873131 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c77fa7-c769-418e-a60c-ecbde24c8ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:05.873407 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c77fa7-c769-418e-a60c-ecbde24c8ef1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:05.874673 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c77fa7-c769-418e-a60c-ecbde24c8ef1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:05.876134 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c77fa7-c769-418e-a60c-ecbde24c8ef1 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:05.877717 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 20/42] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:10:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:05.879445 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c77fa7-c769-418e-a60c-ecbde24c8ef1 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:05.909732 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:05.932446 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01eefbd-dc63-4fb6-9b26-7a9b2d8fb1b4 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:05.980768 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5915c0e3-05fa-4bf6-b7ff-aa4830baf31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:05.981308 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5915c0e3-05fa-4bf6-b7ff-aa4830baf31b None admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:05.981658 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5915c0e3-05fa-4bf6-b7ff-aa4830baf31b None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:05.982022 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5915c0e3-05fa-4bf6-b7ff-aa4830baf31b None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:05.983060 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5915c0e3-05fa-4bf6-b7ff-aa4830baf31b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:05.984477 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5915c0e3-05fa-4bf6-b7ff-aa4830baf31b None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:05.990919 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c77fa7-c769-418e-a60c-ecbde24c8ef1 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:05.994839 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:06.000687 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 23/43] 10.222.0.36 () {60 vars in 1131 bytes} [Tue Aug 9 10:10:05 2022] POST /identity/v3/roles => generated 223 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:10:06.001493 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5915c0e3-05fa-4bf6-b7ff-aa4830baf31b None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:06.036269 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d1e0fb-07da-4805-a1ad-836f8dc8f66f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:06.037271 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d1e0fb-07da-4805-a1ad-836f8dc8f66f None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:06.037561 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d1e0fb-07da-4805-a1ad-836f8dc8f66f None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:06.037879 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d1e0fb-07da-4805-a1ad-836f8dc8f66f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:06.039126 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d1e0fb-07da-4805-a1ad-836f8dc8f66f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:06.040898 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d1e0fb-07da-4805-a1ad-836f8dc8f66f None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:06.042615 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 21/44] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:10:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:06.049182 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d1e0fb-07da-4805-a1ad-836f8dc8f66f None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:06.119643 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5915c0e3-05fa-4bf6-b7ff-aa4830baf31b None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:06.159250 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecec98b-6b41-449c-b0d8-5cd8c92cde6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:06.159797 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecec98b-6b41-449c-b0d8-5cd8c92cde6d None admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:06.160077 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecec98b-6b41-449c-b0d8-5cd8c92cde6d None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:06.160357 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecec98b-6b41-449c-b0d8-5cd8c92cde6d None admin] PATH_INFO: `/v3/domains/default/users/f678c8c3c6754b9a81efff6e9db8f623/roles/89ca30cbbb634be8a96e9921aa56626b` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:06.162364 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecec98b-6b41-449c-b0d8-5cd8c92cde6d None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=f678c8c3c6754b9a81efff6e9db8f623, role_id=89ca30cbbb634be8a96e9921aa56626b)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:06.163603 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d1e0fb-07da-4805-a1ad-836f8dc8f66f None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:06.163812 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecec98b-6b41-449c-b0d8-5cd8c92cde6d None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:06.175795 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:06.182184 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 24/45] 10.222.0.36 () {58 vars in 1361 bytes} [Tue Aug 9 10:10:06 2022] PUT /identity/v3/domains/default/users/f678c8c3c6754b9a81efff6e9db8f623/roles/89ca30cbbb634be8a96e9921aa56626b => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:10:06.206390 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb34fc5-950e-4854-b92b-9964ad3bcc17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:06.207033 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb34fc5-950e-4854-b92b-9964ad3bcc17 None admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:06.207329 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb34fc5-950e-4854-b92b-9964ad3bcc17 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:06.207596 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb34fc5-950e-4854-b92b-9964ad3bcc17 None admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:06.208278 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb34fc5-950e-4854-b92b-9964ad3bcc17 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:06.209800 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb34fc5-950e-4854-b92b-9964ad3bcc17 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:06.239712 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 22/46] 10.222.0.36 () {60 vars in 1141 bytes} [Tue Aug 9 10:10:06 2022] POST /identity/v3/projects => generated 312 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:10:08.222937 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520a908-1467-4241-a012-6ed938039fc4 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:08.223437 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520a908-1467-4241-a012-6ed938039fc4 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:08.223437 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520a908-1467-4241-a012-6ed938039fc4 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:08.224757 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 25/47] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:10:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:10:08.229867 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3c17b8-d349-4f1d-b47c-a02e028357fe None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:08.230261 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3c17b8-d349-4f1d-b47c-a02e028357fe None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:08.230463 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3c17b8-d349-4f1d-b47c-a02e028357fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:08.249826 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-8d3c17b8-d349-4f1d-b47c-a02e028357fe None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:10:08.251374 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-8d3c17b8-d349-4f1d-b47c-a02e028357fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:10:08.256264 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa92160-7300-4bdd-a478-3e66e6ebff94 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:08.256552 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa92160-7300-4bdd-a478-3e66e6ebff94 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:08.256829 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa92160-7300-4bdd-a478-3e66e6ebff94 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:08.258162 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 26/48] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:10:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 10:10:08.263500 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7381f3dc-f44e-4af5-8d9d-9dbdcb5baa39 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:08.263772 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7381f3dc-f44e-4af5-8d9d-9dbdcb5baa39 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:08.264052 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7381f3dc-f44e-4af5-8d9d-9dbdcb5baa39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:08.270307 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:08.282130 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-7381f3dc-f44e-4af5-8d9d-9dbdcb5baa39 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:10:08.283301 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-7381f3dc-f44e-4af5-8d9d-9dbdcb5baa39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:10:08.321156 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 23/49] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:10:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 10:10:08.345025 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3c17b8-d349-4f1d-b47c-a02e028357fe None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:08.349455 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 27/50] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:10:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 10:10:08.372453 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7381f3dc-f44e-4af5-8d9d-9dbdcb5baa39 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:08.440540 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3c17b8-d349-4f1d-b47c-a02e028357fe None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:08.468782 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7381f3dc-f44e-4af5-8d9d-9dbdcb5baa39 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:08.474687 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df08202-e4f8-436d-873a-695753077414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:08.475252 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df08202-e4f8-436d-873a-695753077414 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:08.475530 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df08202-e4f8-436d-873a-695753077414 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:08.475803 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df08202-e4f8-436d-873a-695753077414 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:08.486336 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df08202-e4f8-436d-873a-695753077414 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 10:10:08.490984 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-1df08202-e4f8-436d-873a-695753077414 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 10:10:08.490984 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:10:08.490984 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:10:08.490984 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:10:08.490984 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:10:08.490984 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:10:08.490984 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:10:08.490984 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:10:08.490984 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:10:08.490984 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:10:08.490984 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:10:08.490984 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:10:08.490984 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 10:10:08.490984 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 10:10:08.490984 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 10:10:08.490984 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 10:10:08.492086 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 10:10:08.492086 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 10:10:08.492086 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 10:10:08.492086 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 10:10:08.492086 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:10:08.492086 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:10:08.492086 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:10:08.492086 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:10:08.492086 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:10:08.492086 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:10:08.492086 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:10:08.492086 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:10:08.492086 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:10:08.492086 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:10:08.492086 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:10:08.492086 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:10:08.492862 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:10:08.492862 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:10:08.492862 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:10:08.492862 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:10:08.492862 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 10:10:08.492862 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 10:10:08.492862 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 10:10:08.492862 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 10:10:08.492862 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 10:10:08.492862 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 10:10:08.492862 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 10:10:08.492862 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:10:08.492862 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 24/51] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Aug 9 10:10:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 10:10:08.497894 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:08.498126 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df08202-e4f8-436d-873a-695753077414 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:08.506161 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d34bc62-c686-466b-8974-4e043c20af0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:08.506802 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d34bc62-c686-466b-8974-4e043c20af0b None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:08.507066 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d34bc62-c686-466b-8974-4e043c20af0b None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:08.507338 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d34bc62-c686-466b-8974-4e043c20af0b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:08.508470 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d34bc62-c686-466b-8974-4e043c20af0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:08.509945 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d34bc62-c686-466b-8974-4e043c20af0b None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:08.511486 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 28/52] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:10:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:10:08.513977 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:08.518018 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d34bc62-c686-466b-8974-4e043c20af0b None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:08.601570 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df08202-e4f8-436d-873a-695753077414 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:08.617731 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d34bc62-c686-466b-8974-4e043c20af0b None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:08.634923 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8fd764-3625-43a6-af6a-580a02e38ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:08.635533 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8fd764-3625-43a6-af6a-580a02e38ed3 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:08.635817 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8fd764-3625-43a6-af6a-580a02e38ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:08.636093 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8fd764-3625-43a6-af6a-580a02e38ed3 None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:08.636757 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8fd764-3625-43a6-af6a-580a02e38ed3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:10:08.637072 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8fd764-3625-43a6-af6a-580a02e38ed3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:08.639031 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8fd764-3625-43a6-af6a-580a02e38ed3 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:08.652732 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 25/53] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Aug 9 10:10:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:10:08.654582 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8fd764-3625-43a6-af6a-580a02e38ed3 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:08.655596 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed71fb7-8347-49f5-beac-6a87323fdb01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:08.656208 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed71fb7-8347-49f5-beac-6a87323fdb01 None admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:08.656485 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed71fb7-8347-49f5-beac-6a87323fdb01 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:08.656756 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed71fb7-8347-49f5-beac-6a87323fdb01 None admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:08.657384 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed71fb7-8347-49f5-beac-6a87323fdb01 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:08.658864 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed71fb7-8347-49f5-beac-6a87323fdb01 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:08.687778 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 29/54] 10.222.0.36 () {60 vars in 1140 bytes} [Tue Aug 9 10:10:08 2022] POST /identity/v3/projects => generated 298 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 10:10:08.739620 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:08.764404 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8fd764-3625-43a6-af6a-580a02e38ed3 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:08.798991 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb86dd97-8b30-4491-842d-6f36c65575cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:08.799638 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb86dd97-8b30-4491-842d-6f36c65575cb None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:08.799921 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb86dd97-8b30-4491-842d-6f36c65575cb None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:08.800194 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb86dd97-8b30-4491-842d-6f36c65575cb None admin] PATH_INFO: `/v3/users/f678c8c3c6754b9a81efff6e9db8f623` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:08.801378 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb86dd97-8b30-4491-842d-6f36c65575cb None admin] RBAC: Authorizing `identity:get_user(user_id=f678c8c3c6754b9a81efff6e9db8f623)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:08.802883 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb86dd97-8b30-4491-842d-6f36c65575cb None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:08.804510 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 26/55] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Aug 9 10:10:08 2022] GET /identity/v3/users/f678c8c3c6754b9a81efff6e9db8f623 => generated 247 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:10:08.811232 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed71fb7-8347-49f5-beac-6a87323fdb01 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:08.864343 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:08.915048 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed71fb7-8347-49f5-beac-6a87323fdb01 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:08.952681 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785c7a22-6467-4f32-876d-9465e78290ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:08.953318 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c7a22-6467-4f32-876d-9465e78290ee None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:08.953591 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c7a22-6467-4f32-876d-9465e78290ee None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:08.953883 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c7a22-6467-4f32-876d-9465e78290ee None admin] PATH_INFO: `/v3/domains/default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:08.954983 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785c7a22-6467-4f32-876d-9465e78290ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:08.956508 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785c7a22-6467-4f32-876d-9465e78290ee None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:08.958276 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 30/56] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:10:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:08.963988 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb86dd97-8b30-4491-842d-6f36c65575cb None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:09.063160 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb86dd97-8b30-4491-842d-6f36c65575cb None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:09.095383 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ef794b-b975-4d04-b39b-435282288199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:09.095981 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ef794b-b975-4d04-b39b-435282288199 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:09.096263 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ef794b-b975-4d04-b39b-435282288199 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:09.096539 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ef794b-b975-4d04-b39b-435282288199 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:09.097261 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ef794b-b975-4d04-b39b-435282288199 None admin] RBAC: Adding query filter params (role.id=89ca30cbbb634be8a96e9921aa56626b, scope.domain.id=default, user.id=f678c8c3c6754b9a81efff6e9db8f623) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:10:09.097571 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ef794b-b975-4d04-b39b-435282288199 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:09.099055 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ef794b-b975-4d04-b39b-435282288199 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:09.104606 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 27/57] 10.222.0.36 () {56 vars in 1322 bytes} [Tue Aug 9 10:10:08 2022] GET /identity/v3/role_assignments?user.id=f678c8c3c6754b9a81efff6e9db8f623&scope.domain.id=default&role.id=89ca30cbbb634be8a96e9921aa56626b => generated 530 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:10.708669 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb4bb1-0e37-46e1-924b-0ec292375c22 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:10.709184 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb4bb1-0e37-46e1-924b-0ec292375c22 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:10.709266 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb4bb1-0e37-46e1-924b-0ec292375c22 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:10.710587 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 31/58] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:10:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:10:10.715697 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe71c1e-bddf-435c-ba6d-4fb6c6823e60 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:10.716678 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe71c1e-bddf-435c-ba6d-4fb6c6823e60 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:10.716871 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe71c1e-bddf-435c-ba6d-4fb6c6823e60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:10.734415 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-efe71c1e-bddf-435c-ba6d-4fb6c6823e60 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:10:10.735603 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-efe71c1e-bddf-435c-ba6d-4fb6c6823e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:10:10.737492 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:10.801159 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 28/59] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:10:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 10:10:10.824900 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bb4bb1-0e37-46e1-924b-0ec292375c22 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:10.925413 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bb4bb1-0e37-46e1-924b-0ec292375c22 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:10.941275 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:10.959906 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de4915f-e51e-4c49-9864-6e33e2b665bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:10.960471 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de4915f-e51e-4c49-9864-6e33e2b665bd None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:10.960748 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de4915f-e51e-4c49-9864-6e33e2b665bd None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:10.961020 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de4915f-e51e-4c49-9864-6e33e2b665bd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:10.962153 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de4915f-e51e-4c49-9864-6e33e2b665bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:10.963581 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de4915f-e51e-4c49-9864-6e33e2b665bd None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:10.965124 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 32/60] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:10:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:10.971206 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe71c1e-bddf-435c-ba6d-4fb6c6823e60 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:11.067076 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe71c1e-bddf-435c-ba6d-4fb6c6823e60 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:11.100080 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35698d0c-6ac5-4a5d-b370-8ce818fea1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:11.100668 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35698d0c-6ac5-4a5d-b370-8ce818fea1e2 None admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:11.100945 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35698d0c-6ac5-4a5d-b370-8ce818fea1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:11.101239 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35698d0c-6ac5-4a5d-b370-8ce818fea1e2 None admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:11.101907 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35698d0c-6ac5-4a5d-b370-8ce818fea1e2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:11.103341 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35698d0c-6ac5-4a5d-b370-8ce818fea1e2 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:11.117700 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:11.130574 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 29/61] 10.222.0.36 () {60 vars in 1132 bytes} [Tue Aug 9 10:10:10 2022] POST /identity/v3/users => generated 275 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:10:14.211207 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa385eaa-f728-47fc-b9c2-5c179c92dc1c None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:14.212017 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa385eaa-f728-47fc-b9c2-5c179c92dc1c None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:14.212446 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa385eaa-f728-47fc-b9c2-5c179c92dc1c None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:14.213940 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 33/62] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:10:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:10:14.221065 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e2ec62-2566-4fa2-acf0-c326c93699d0 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:14.221824 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e2ec62-2566-4fa2-acf0-c326c93699d0 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:14.222257 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e2ec62-2566-4fa2-acf0-c326c93699d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:14.246812 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-c6e2ec62-2566-4fa2-acf0-c326c93699d0 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:10:14.248867 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-c6e2ec62-2566-4fa2-acf0-c326c93699d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:10:14.343555 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 30/63] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:10:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 10:10:14.379313 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa385eaa-f728-47fc-b9c2-5c179c92dc1c None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:14.453421 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c9f24-e494-42a4-904b-66d0e7a6ab6a None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:14.454094 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c9f24-e494-42a4-904b-66d0e7a6ab6a None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:14.454560 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c9f24-e494-42a4-904b-66d0e7a6ab6a None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:14.456091 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 31/64] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:10:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 10:10:14.461271 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1720881-7e17-4334-bed1-20d84fc6cf82 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:14.461768 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1720881-7e17-4334-bed1-20d84fc6cf82 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:14.462269 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1720881-7e17-4334-bed1-20d84fc6cf82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:14.484656 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-a1720881-7e17-4334-bed1-20d84fc6cf82 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:10:14.485869 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-a1720881-7e17-4334-bed1-20d84fc6cf82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:10:14.553915 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa385eaa-f728-47fc-b9c2-5c179c92dc1c None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:14.592660 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5461eca9-d4c9-4dcd-bb70-4443b62685b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:14.593646 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5461eca9-d4c9-4dcd-bb70-4443b62685b3 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:14.594138 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5461eca9-d4c9-4dcd-bb70-4443b62685b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:14.594600 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5461eca9-d4c9-4dcd-bb70-4443b62685b3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:14.608465 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5461eca9-d4c9-4dcd-bb70-4443b62685b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 10:10:14.615899 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-5461eca9-d4c9-4dcd-bb70-4443b62685b3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 10:10:14.615899 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:10:14.615899 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:10:14.615899 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:10:14.615899 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:10:14.615899 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:10:14.615899 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:10:14.615899 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:10:14.615899 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:10:14.615899 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:10:14.615899 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:10:14.615899 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:10:14.615899 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 10:10:14.615899 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 10:10:14.615899 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 10:10:14.615899 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 10:10:14.616746 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 10:10:14.616746 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 10:10:14.616746 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 10:10:14.616746 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 10:10:14.616746 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:10:14.616746 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:10:14.616746 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:10:14.616746 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:10:14.616746 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:10:14.616746 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:10:14.616746 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:10:14.616746 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:10:14.616746 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:10:14.616746 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:10:14.616746 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:10:14.616746 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:10:14.617505 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:10:14.617505 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:10:14.617505 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:10:14.617505 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:10:14.617505 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 10:10:14.617505 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 10:10:14.617505 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 10:10:14.617505 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 10:10:14.617505 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 10:10:14.617505 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 10:10:14.617505 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 10:10:14.617505 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:10:14.620178 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 34/65] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Aug 9 10:10:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:10:14.628834 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5461eca9-d4c9-4dcd-bb70-4443b62685b3 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:14.637578 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 32/66] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:10:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 10:10:14.641713 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61656e6d-f0ba-4bb1-a55d-2a9f4f43264b None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:14.642209 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61656e6d-f0ba-4bb1-a55d-2a9f4f43264b None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:14.642624 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61656e6d-f0ba-4bb1-a55d-2a9f4f43264b None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:14.644284 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 33/67] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:10:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:10:14.649185 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03687c7-8829-441a-8457-a814b2c44249 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:14.649597 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03687c7-8829-441a-8457-a814b2c44249 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:14.650027 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03687c7-8829-441a-8457-a814b2c44249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:14.675323 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-a03687c7-8829-441a-8457-a814b2c44249 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:10:14.677047 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-a03687c7-8829-441a-8457-a814b2c44249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:10:14.698719 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:14.731375 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:14.753019 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 34/68] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:10:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 10:10:14.754536 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03687c7-8829-441a-8457-a814b2c44249 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:14.766578 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5461eca9-d4c9-4dcd-bb70-4443b62685b3 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:14.813429 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2687c718-47ed-4d08-8522-1008de6fe67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:14.814192 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2687c718-47ed-4d08-8522-1008de6fe67d None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:14.814947 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2687c718-47ed-4d08-8522-1008de6fe67d None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:14.815231 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2687c718-47ed-4d08-8522-1008de6fe67d None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:14.816053 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2687c718-47ed-4d08-8522-1008de6fe67d None admin] RBAC: Adding query filter params (name=member) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:10:14.816493 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2687c718-47ed-4d08-8522-1008de6fe67d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:14.818160 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2687c718-47ed-4d08-8522-1008de6fe67d None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:14.829964 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 35/69] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Aug 9 10:10:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:14.831543 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60ac7c1-12c8-4413-971d-6bf8a60adb40 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:14.831981 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60ac7c1-12c8-4413-971d-6bf8a60adb40 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:14.832397 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60ac7c1-12c8-4413-971d-6bf8a60adb40 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:14.834168 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 36/70] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:10:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:10:14.835303 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60ac7c1-12c8-4413-971d-6bf8a60adb40 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:14.886106 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03687c7-8829-441a-8457-a814b2c44249 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:14.922736 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2407a7-442e-4548-9100-b77045511517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:14.923398 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2407a7-442e-4548-9100-b77045511517 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:14.923685 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2407a7-442e-4548-9100-b77045511517 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:14.923965 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2407a7-442e-4548-9100-b77045511517 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:14.934228 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2407a7-442e-4548-9100-b77045511517 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 10:10:14.939576 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-8b2407a7-442e-4548-9100-b77045511517 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 10:10:14.939576 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:10:14.939576 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:10:14.939576 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:10:14.939576 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:10:14.939576 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:10:14.939576 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:10:14.939576 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:10:14.939576 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:10:14.939576 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:10:14.939576 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:10:14.939576 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:10:14.939576 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 10:10:14.939576 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 10:10:14.939576 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 10:10:14.939576 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 10:10:14.940466 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 10:10:14.940466 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 10:10:14.940466 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 10:10:14.940466 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 10:10:14.940466 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:10:14.940466 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:10:14.940466 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:10:14.940466 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:10:14.940466 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:10:14.940466 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:10:14.940466 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:10:14.940466 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:10:14.940466 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:10:14.940466 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:10:14.940466 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:10:14.940466 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:10:14.941234 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:10:14.941234 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:10:14.941234 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:10:14.941234 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:10:14.941234 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 10:10:14.941234 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 10:10:14.941234 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 10:10:14.941234 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 10:10:14.941234 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 10:10:14.941234 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 10:10:14.941234 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 10:10:14.941234 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:10:14.941234 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 35/71] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Aug 9 10:10:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:10:14.941880 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2407a7-442e-4548-9100-b77045511517 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:14.950474 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60ac7c1-12c8-4413-971d-6bf8a60adb40 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:14.958189 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:14.985824 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ef0511-f5b7-4b38-af75-52ccf9e94162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:14.986668 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef0511-f5b7-4b38-af75-52ccf9e94162 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:14.986951 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef0511-f5b7-4b38-af75-52ccf9e94162 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:14.987557 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef0511-f5b7-4b38-af75-52ccf9e94162 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:14.989654 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:14.997965 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ef0511-f5b7-4b38-af75-52ccf9e94162 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 10:10:15.002626 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-a3ef0511-f5b7-4b38-af75-52ccf9e94162 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 10:10:15.002626 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:10:15.002626 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:10:15.002626 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:10:15.002626 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:10:15.002626 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:10:15.002626 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:10:15.002626 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:10:15.002626 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:10:15.002626 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:10:15.002626 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:10:15.002626 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:10:15.002626 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 10:10:15.002626 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 10:10:15.002626 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 10:10:15.002626 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 10:10:15.003461 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 10:10:15.003461 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 10:10:15.003461 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 10:10:15.003461 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 10:10:15.003461 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:10:15.003461 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:10:15.003461 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:10:15.003461 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:10:15.003461 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:10:15.003461 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:10:15.003461 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:10:15.003461 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:10:15.003461 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:10:15.003461 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:10:15.003461 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:10:15.003461 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:10:15.004242 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:10:15.004242 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:10:15.004242 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:10:15.004242 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:10:15.004242 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 10:10:15.004242 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 10:10:15.004242 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 10:10:15.004242 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 10:10:15.004242 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 10:10:15.004242 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 10:10:15.004242 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 10:10:15.004242 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:10:15.004242 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 37/72] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Aug 9 10:10:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:10:15.004859 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204f441b-45e2-401e-b8af-0c8f7b5f988d None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:15.005089 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204f441b-45e2-401e-b8af-0c8f7b5f988d None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:15.005368 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204f441b-45e2-401e-b8af-0c8f7b5f988d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:15.023096 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-204f441b-45e2-401e-b8af-0c8f7b5f988d None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:10:15.024277 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-204f441b-45e2-401e-b8af-0c8f7b5f988d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:10:15.048974 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2407a7-442e-4548-9100-b77045511517 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:15.082305 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c1cfa-a97a-4f78-b9f7-59e75311a018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:15.082932 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c1cfa-a97a-4f78-b9f7-59e75311a018 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:15.083212 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c1cfa-a97a-4f78-b9f7-59e75311a018 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:15.083485 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c1cfa-a97a-4f78-b9f7-59e75311a018 None admin] PATH_INFO: `/v3/users/bdb286c28efa42b5a3fd021d0345a5a5` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:15.091378 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 38/73] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:10:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 10:10:15.091378 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03287524-8484-4b6a-92e3-b3fe843f70bf None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:15.091378 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03287524-8484-4b6a-92e3-b3fe843f70bf None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:15.091378 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03287524-8484-4b6a-92e3-b3fe843f70bf None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:15.091378 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 39/74] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:10:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:10:15.091378 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03287524-8484-4b6a-92e3-b3fe843f70bf None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:15.102477 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9c1cfa-a97a-4f78-b9f7-59e75311a018 None admin] RBAC: Authorizing `identity:get_user(user_id=bdb286c28efa42b5a3fd021d0345a5a5)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:15.103179 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9c1cfa-a97a-4f78-b9f7-59e75311a018 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:15.111046 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 36/75] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Aug 9 10:10:14 2022] GET /identity/v3/users/bdb286c28efa42b5a3fd021d0345a5a5 => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:15.111046 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c1cfa-a97a-4f78-b9f7-59e75311a018 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:15.197618 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:15.205260 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03287524-8484-4b6a-92e3-b3fe843f70bf None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:15.208756 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c1cfa-a97a-4f78-b9f7-59e75311a018 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:15.210328 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:15.239125 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3785c716-c5b1-48ae-92fb-fc5c7543e09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:15.239665 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3785c716-c5b1-48ae-92fb-fc5c7543e09f None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:15.239949 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3785c716-c5b1-48ae-92fb-fc5c7543e09f None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:15.240222 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3785c716-c5b1-48ae-92fb-fc5c7543e09f None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:15.240879 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3785c716-c5b1-48ae-92fb-fc5c7543e09f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:10:15.241184 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3785c716-c5b1-48ae-92fb-fc5c7543e09f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:15.242592 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3785c716-c5b1-48ae-92fb-fc5c7543e09f None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:15.244618 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61ece9d-8a5b-4cae-9449-c6ae7ca63059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:15.245219 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ece9d-8a5b-4cae-9449-c6ae7ca63059 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:15.245501 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ece9d-8a5b-4cae-9449-c6ae7ca63059 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:15.245776 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ece9d-8a5b-4cae-9449-c6ae7ca63059 None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:15.246469 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61ece9d-8a5b-4cae-9449-c6ae7ca63059 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:10:15.246776 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61ece9d-8a5b-4cae-9449-c6ae7ca63059 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:15.248240 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61ece9d-8a5b-4cae-9449-c6ae7ca63059 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:15.251031 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 40/76] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Aug 9 10:10:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:15.252251 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb43d280-fced-44dd-a64f-af80c10daaa5 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:15.252544 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb43d280-fced-44dd-a64f-af80c10daaa5 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:15.252843 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb43d280-fced-44dd-a64f-af80c10daaa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:15.263879 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 37/77] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Aug 9 10:10:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:15.263879 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61ece9d-8a5b-4cae-9449-c6ae7ca63059 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:15.270454 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-bb43d280-fced-44dd-a64f-af80c10daaa5 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:10:15.271651 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-bb43d280-fced-44dd-a64f-af80c10daaa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:10:15.337775 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 41/78] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:10:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 10:10:15.338632 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb43d280-fced-44dd-a64f-af80c10daaa5 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:15.367338 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61ece9d-8a5b-4cae-9449-c6ae7ca63059 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:15.400527 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb5b3b5-f6c6-479b-a1b6-d590dd0c9b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:15.401119 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb5b3b5-f6c6-479b-a1b6-d590dd0c9b56 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:15.401399 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb5b3b5-f6c6-479b-a1b6-d590dd0c9b56 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:15.401671 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb5b3b5-f6c6-479b-a1b6-d590dd0c9b56 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:15.425997 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:15.433109 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:15.441072 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb43d280-fced-44dd-a64f-af80c10daaa5 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:15.474883 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8f8eda-8102-4b95-bc7d-0ae6054c51a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:15.475512 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8f8eda-8102-4b95-bc7d-0ae6054c51a7 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:15.475795 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8f8eda-8102-4b95-bc7d-0ae6054c51a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:15.476050 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb5b3b5-f6c6-479b-a1b6-d590dd0c9b56 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:15.476143 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8f8eda-8102-4b95-bc7d-0ae6054c51a7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:15.477516 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb5b3b5-f6c6-479b-a1b6-d590dd0c9b56 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:15.488187 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8f8eda-8102-4b95-bc7d-0ae6054c51a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 10:10:15.493420 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-bf8f8eda-8102-4b95-bc7d-0ae6054c51a7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 10:10:15.493420 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:10:15.493420 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:10:15.493420 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:10:15.493420 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:10:15.493420 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:10:15.493420 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:10:15.493420 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:10:15.493420 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:10:15.493420 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:10:15.493420 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:10:15.493420 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:10:15.493420 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 10:10:15.493420 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 10:10:15.493420 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 10:10:15.493420 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 10:10:15.494543 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 10:10:15.494543 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 10:10:15.494543 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 10:10:15.494543 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 10:10:15.494543 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:10:15.494543 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:10:15.494543 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:10:15.494543 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:10:15.494543 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:10:15.494543 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:10:15.494543 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:10:15.494543 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:10:15.494543 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:10:15.494543 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:10:15.494543 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:10:15.494543 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:10:15.495470 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:10:15.495470 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:10:15.495470 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:10:15.495470 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:10:15.495470 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 10:10:15.495470 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 10:10:15.495470 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 10:10:15.495470 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 10:10:15.495470 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 10:10:15.495470 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 10:10:15.495470 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 10:10:15.495470 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:10:15.495470 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 42/79] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Aug 9 10:10:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:10:15.495470 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8f8eda-8102-4b95-bc7d-0ae6054c51a7 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:15.577070 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 38/80] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Aug 9 10:10:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 10:10:15.577947 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb5b3b5-f6c6-479b-a1b6-d590dd0c9b56 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:15.597964 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8f8eda-8102-4b95-bc7d-0ae6054c51a7 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:15.631752 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3384266-66cb-4564-b4bd-2b9695a8d31d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:15.632374 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3384266-66cb-4564-b4bd-2b9695a8d31d None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:15.632660 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3384266-66cb-4564-b4bd-2b9695a8d31d None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:15.632937 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3384266-66cb-4564-b4bd-2b9695a8d31d None admin] PATH_INFO: `/v3/users/f678c8c3c6754b9a81efff6e9db8f623` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:15.634104 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3384266-66cb-4564-b4bd-2b9695a8d31d None admin] RBAC: Authorizing `identity:get_user(user_id=f678c8c3c6754b9a81efff6e9db8f623)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:15.635557 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3384266-66cb-4564-b4bd-2b9695a8d31d None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:15.637120 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 43/81] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Aug 9 10:10:15 2022] GET /identity/v3/users/f678c8c3c6754b9a81efff6e9db8f623 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:15.638972 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3384266-66cb-4564-b4bd-2b9695a8d31d None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:15.640294 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:15.657313 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:15.679406 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb5b3b5-f6c6-479b-a1b6-d590dd0c9b56 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:15.713984 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d670530-a6fa-4d13-8e73-7484aed777c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:15.714633 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d670530-a6fa-4d13-8e73-7484aed777c4 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:15.714915 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d670530-a6fa-4d13-8e73-7484aed777c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:15.715191 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d670530-a6fa-4d13-8e73-7484aed777c4 None admin] PATH_INFO: `/v3/users/bdb286c28efa42b5a3fd021d0345a5a5` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:15.716967 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d670530-a6fa-4d13-8e73-7484aed777c4 None admin] RBAC: Authorizing `identity:get_user(user_id=bdb286c28efa42b5a3fd021d0345a5a5)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:15.718466 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d670530-a6fa-4d13-8e73-7484aed777c4 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:15.720044 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 39/82] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Aug 9 10:10:15 2022] GET /identity/v3/users/bdb286c28efa42b5a3fd021d0345a5a5 => generated 275 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:15.721197 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d670530-a6fa-4d13-8e73-7484aed777c4 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:15.744233 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3384266-66cb-4564-b4bd-2b9695a8d31d None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:15.778704 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ff35c7-d001-4c63-9329-1f0c69377a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:15.779323 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ff35c7-d001-4c63-9329-1f0c69377a19 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:15.779609 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ff35c7-d001-4c63-9329-1f0c69377a19 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:15.779892 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ff35c7-d001-4c63-9329-1f0c69377a19 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:15.781007 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ff35c7-d001-4c63-9329-1f0c69377a19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:15.782483 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ff35c7-d001-4c63-9329-1f0c69377a19 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:15.784237 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 44/83] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:10:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:15.784844 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ff35c7-d001-4c63-9329-1f0c69377a19 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:15.826666 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d670530-a6fa-4d13-8e73-7484aed777c4 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:15.855194 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:15.861154 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed4ad9b-9814-4577-a256-4667e89040cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:15.861754 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed4ad9b-9814-4577-a256-4667e89040cd None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:15.862063 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed4ad9b-9814-4577-a256-4667e89040cd None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:15.862337 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed4ad9b-9814-4577-a256-4667e89040cd None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:15.863005 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed4ad9b-9814-4577-a256-4667e89040cd None admin] RBAC: Adding query filter params (name=member) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:10:15.863312 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed4ad9b-9814-4577-a256-4667e89040cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:15.864710 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed4ad9b-9814-4577-a256-4667e89040cd None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:15.869974 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:15.872932 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 40/84] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Aug 9 10:10:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:15.873730 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed4ad9b-9814-4577-a256-4667e89040cd None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:15.889918 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ff35c7-d001-4c63-9329-1f0c69377a19 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:15.922971 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831ab5b9-8f36-4a7b-978e-248e2d8843c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:15.923623 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ab5b9-8f36-4a7b-978e-248e2d8843c8 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:15.923904 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ab5b9-8f36-4a7b-978e-248e2d8843c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:15.924177 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ab5b9-8f36-4a7b-978e-248e2d8843c8 None admin] PATH_INFO: `/v3/projects/5a0951c053754bea9df8fb8448e1b42f` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:15.925278 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831ab5b9-8f36-4a7b-978e-248e2d8843c8 None admin] RBAC: Authorizing `identity:get_project(project_id=5a0951c053754bea9df8fb8448e1b42f)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:15.926736 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831ab5b9-8f36-4a7b-978e-248e2d8843c8 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:15.928330 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 45/85] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Aug 9 10:10:15 2022] GET /identity/v3/projects/5a0951c053754bea9df8fb8448e1b42f => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:15.929082 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831ab5b9-8f36-4a7b-978e-248e2d8843c8 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:15.974074 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed4ad9b-9814-4577-a256-4667e89040cd None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:16.007920 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7afa5b-e3d7-4ec8-8a5d-df5c6c60faa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:16.008451 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7afa5b-e3d7-4ec8-8a5d-df5c6c60faa1 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:16.008728 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7afa5b-e3d7-4ec8-8a5d-df5c6c60faa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:16.009001 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7afa5b-e3d7-4ec8-8a5d-df5c6c60faa1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:16.029860 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831ab5b9-8f36-4a7b-978e-248e2d8843c8 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:16.063988 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da171a40-b4d2-478d-98c5-8f08b1ef8b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:16.064590 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da171a40-b4d2-478d-98c5-8f08b1ef8b6d None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:16.064871 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da171a40-b4d2-478d-98c5-8f08b1ef8b6d None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:16.065148 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da171a40-b4d2-478d-98c5-8f08b1ef8b6d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:16.068334 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:16.077025 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7afa5b-e3d7-4ec8-8a5d-df5c6c60faa1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:16.078591 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7afa5b-e3d7-4ec8-8a5d-df5c6c60faa1 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:16.091855 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:16.139125 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da171a40-b4d2-478d-98c5-8f08b1ef8b6d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:16.140595 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da171a40-b4d2-478d-98c5-8f08b1ef8b6d None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:16.178645 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 41/86] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Aug 9 10:10:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 10:10:16.179466 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7afa5b-e3d7-4ec8-8a5d-df5c6c60faa1 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:16.239508 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 46/87] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Aug 9 10:10:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 10:10:16.240347 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da171a40-b4d2-478d-98c5-8f08b1ef8b6d None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:16.272097 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:16.279944 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7afa5b-e3d7-4ec8-8a5d-df5c6c60faa1 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:16.293402 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:16.313532 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db321dbe-1763-476a-b321-c82ec223d50d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:16.314156 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db321dbe-1763-476a-b321-c82ec223d50d None admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:16.314437 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db321dbe-1763-476a-b321-c82ec223d50d None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:16.314711 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db321dbe-1763-476a-b321-c82ec223d50d None admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:16.315428 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db321dbe-1763-476a-b321-c82ec223d50d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:16.316864 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db321dbe-1763-476a-b321-c82ec223d50d None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:16.337092 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 42/88] 10.222.0.36 () {60 vars in 1132 bytes} [Tue Aug 9 10:10:16 2022] POST /identity/v3/users => generated 289 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:10:16.337953 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db321dbe-1763-476a-b321-c82ec223d50d None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:16.353735 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da171a40-b4d2-478d-98c5-8f08b1ef8b6d None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:16.402155 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0973808e-3c8c-4110-be35-f25b08c772fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:16.402805 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0973808e-3c8c-4110-be35-f25b08c772fb None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:16.403089 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0973808e-3c8c-4110-be35-f25b08c772fb None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:16.403874 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0973808e-3c8c-4110-be35-f25b08c772fb None admin] PATH_INFO: `/v3/users/bdb286c28efa42b5a3fd021d0345a5a5` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:16.405232 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0973808e-3c8c-4110-be35-f25b08c772fb None admin] RBAC: Authorizing `identity:get_user(user_id=bdb286c28efa42b5a3fd021d0345a5a5)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:16.406767 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0973808e-3c8c-4110-be35-f25b08c772fb None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:16.408677 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 47/89] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Aug 9 10:10:16 2022] GET /identity/v3/users/bdb286c28efa42b5a3fd021d0345a5a5 => generated 275 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:16.409377 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0973808e-3c8c-4110-be35-f25b08c772fb None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:16.467598 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db321dbe-1763-476a-b321-c82ec223d50d None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:16.507712 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab89f32-6a3e-4cd8-b4f3-510331f9f9f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:16.508664 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab89f32-6a3e-4cd8-b4f3-510331f9f9f7 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:16.509174 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab89f32-6a3e-4cd8-b4f3-510331f9f9f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:16.509674 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab89f32-6a3e-4cd8-b4f3-510331f9f9f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:16.510513 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab89f32-6a3e-4cd8-b4f3-510331f9f9f7 None admin] RBAC: Adding query filter params (role.id=a9895331e9694fa8b2b50908bb057bcb, scope.project.id=5a0951c053754bea9df8fb8448e1b42f, user.id=bdb286c28efa42b5a3fd021d0345a5a5) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:10:16.510835 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab89f32-6a3e-4cd8-b4f3-510331f9f9f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:16.512293 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab89f32-6a3e-4cd8-b4f3-510331f9f9f7 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:16.520408 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 43/90] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Aug 9 10:10:16 2022] GET /identity/v3/role_assignments?user.id=bdb286c28efa42b5a3fd021d0345a5a5&scope.project.id=5a0951c053754bea9df8fb8448e1b42f&role.id=a9895331e9694fa8b2b50908bb057bcb => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:16.521884 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab89f32-6a3e-4cd8-b4f3-510331f9f9f7 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:16.547028 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:16.557406 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0973808e-3c8c-4110-be35-f25b08c772fb None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:16.593680 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:16.611383 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f0bfcc-46f0-49b8-bc03-9b5316e134b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:16.612104 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f0bfcc-46f0-49b8-bc03-9b5316e134b2 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:16.612385 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f0bfcc-46f0-49b8-bc03-9b5316e134b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:16.612720 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f0bfcc-46f0-49b8-bc03-9b5316e134b2 None admin] PATH_INFO: `/v3/projects/5a0951c053754bea9df8fb8448e1b42f` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:16.615090 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f0bfcc-46f0-49b8-bc03-9b5316e134b2 None admin] RBAC: Authorizing `identity:get_project(project_id=5a0951c053754bea9df8fb8448e1b42f)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:16.616581 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f0bfcc-46f0-49b8-bc03-9b5316e134b2 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:16.618445 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 48/91] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Aug 9 10:10:16 2022] GET /identity/v3/projects/5a0951c053754bea9df8fb8448e1b42f => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:16.619349 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f0bfcc-46f0-49b8-bc03-9b5316e134b2 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:16.683790 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab89f32-6a3e-4cd8-b4f3-510331f9f9f7 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:16.738850 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbc2b22-d17a-4fd0-84a9-74dbe5afbde5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:16.739857 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc2b22-d17a-4fd0-84a9-74dbe5afbde5 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:16.740354 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc2b22-d17a-4fd0-84a9-74dbe5afbde5 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:16.740829 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc2b22-d17a-4fd0-84a9-74dbe5afbde5 None admin] PATH_INFO: `/v3/projects/5a0951c053754bea9df8fb8448e1b42f` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:16.742295 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbc2b22-d17a-4fd0-84a9-74dbe5afbde5 None admin] RBAC: Authorizing `identity:get_project(project_id=5a0951c053754bea9df8fb8448e1b42f)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:16.745013 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbc2b22-d17a-4fd0-84a9-74dbe5afbde5 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:16.748161 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 44/92] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Aug 9 10:10:16 2022] GET /identity/v3/projects/5a0951c053754bea9df8fb8448e1b42f => generated 298 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:16.749474 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbc2b22-d17a-4fd0-84a9-74dbe5afbde5 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:16.780735 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f0bfcc-46f0-49b8-bc03-9b5316e134b2 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:16.821625 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375dddce-8d60-4c54-b29e-072f471a95f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:16.822120 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375dddce-8d60-4c54-b29e-072f471a95f0 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:16.822402 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375dddce-8d60-4c54-b29e-072f471a95f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:16.822671 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375dddce-8d60-4c54-b29e-072f471a95f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:16.898220 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:16.902212 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbc2b22-d17a-4fd0-84a9-74dbe5afbde5 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:16.909728 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:16.932171 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375dddce-8d60-4c54-b29e-072f471a95f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:16.933633 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375dddce-8d60-4c54-b29e-072f471a95f0 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:16.967170 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816b1adb-6c5c-448a-83e0-973e7375b22c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:16.967921 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b1adb-6c5c-448a-83e0-973e7375b22c None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:16.968206 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b1adb-6c5c-448a-83e0-973e7375b22c None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:16.968478 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b1adb-6c5c-448a-83e0-973e7375b22c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:16.969478 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816b1adb-6c5c-448a-83e0-973e7375b22c None admin] RBAC: Adding query filter params (role.id=89ca30cbbb634be8a96e9921aa56626b, scope.project.id=5a0951c053754bea9df8fb8448e1b42f, user.id=f678c8c3c6754b9a81efff6e9db8f623) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:10:16.969786 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816b1adb-6c5c-448a-83e0-973e7375b22c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:16.971274 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816b1adb-6c5c-448a-83e0-973e7375b22c None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:16.985442 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 45/93] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Aug 9 10:10:16 2022] GET /identity/v3/role_assignments?user.id=f678c8c3c6754b9a81efff6e9db8f623&scope.project.id=5a0951c053754bea9df8fb8448e1b42f&role.id=89ca30cbbb634be8a96e9921aa56626b => generated 259 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:16.986305 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816b1adb-6c5c-448a-83e0-973e7375b22c None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:17.118920 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816b1adb-6c5c-448a-83e0-973e7375b22c None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:17.146754 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 49/94] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Aug 9 10:10:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 10:10:17.152785 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375dddce-8d60-4c54-b29e-072f471a95f0 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:17.155803 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9c31b8-0247-410a-9dc9-66bf18ac5562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:17.156401 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c31b8-0247-410a-9dc9-66bf18ac5562 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:17.156681 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c31b8-0247-410a-9dc9-66bf18ac5562 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:17.156955 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c31b8-0247-410a-9dc9-66bf18ac5562 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:17.157704 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9c31b8-0247-410a-9dc9-66bf18ac5562 None admin] RBAC: Adding query filter params (role.id=af19908af5d6489696eb27791925a5aa, scope.project.id=5a0951c053754bea9df8fb8448e1b42f, user.id=bdb286c28efa42b5a3fd021d0345a5a5) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:10:17.158045 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9c31b8-0247-410a-9dc9-66bf18ac5562 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:17.159522 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9c31b8-0247-410a-9dc9-66bf18ac5562 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:17.165988 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 46/95] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Aug 9 10:10:16 2022] GET /identity/v3/role_assignments?user.id=bdb286c28efa42b5a3fd021d0345a5a5&scope.project.id=5a0951c053754bea9df8fb8448e1b42f&role.id=af19908af5d6489696eb27791925a5aa => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:17.313641 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:17.329316 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375dddce-8d60-4c54-b29e-072f471a95f0 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:17.368282 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913a033d-74e8-4ed7-8c6d-1235409436e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:17.368980 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913a033d-74e8-4ed7-8c6d-1235409436e1 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:17.369203 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913a033d-74e8-4ed7-8c6d-1235409436e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:17.369474 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913a033d-74e8-4ed7-8c6d-1235409436e1 None admin] PATH_INFO: `/v3/projects/56c4c1e033cf498ba7ef51b8c87f75f3` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:17.370654 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913a033d-74e8-4ed7-8c6d-1235409436e1 None admin] RBAC: Authorizing `identity:get_project(project_id=56c4c1e033cf498ba7ef51b8c87f75f3)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:17.372165 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913a033d-74e8-4ed7-8c6d-1235409436e1 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:17.374126 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 50/96] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Aug 9 10:10:17 2022] GET /identity/v3/projects/56c4c1e033cf498ba7ef51b8c87f75f3 => generated 312 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:10:17.380219 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9c31b8-0247-410a-9dc9-66bf18ac5562 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:17.394240 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:17.486478 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9c31b8-0247-410a-9dc9-66bf18ac5562 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:17.521455 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add209c3-dc5b-4fa9-afd7-b8ce5d5ebfe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:17.522094 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add209c3-dc5b-4fa9-afd7-b8ce5d5ebfe3 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:17.522378 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add209c3-dc5b-4fa9-afd7-b8ce5d5ebfe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:17.522654 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add209c3-dc5b-4fa9-afd7-b8ce5d5ebfe3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:17.523380 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add209c3-dc5b-4fa9-afd7-b8ce5d5ebfe3 None admin] RBAC: Adding query filter params (role.id=a9895331e9694fa8b2b50908bb057bcb, scope.project.id=56c4c1e033cf498ba7ef51b8c87f75f3, user.id=bdb286c28efa42b5a3fd021d0345a5a5) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:10:17.523688 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add209c3-dc5b-4fa9-afd7-b8ce5d5ebfe3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:17.525123 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add209c3-dc5b-4fa9-afd7-b8ce5d5ebfe3 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:17.531152 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 47/97] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Aug 9 10:10:17 2022] GET /identity/v3/role_assignments?user.id=bdb286c28efa42b5a3fd021d0345a5a5&scope.project.id=56c4c1e033cf498ba7ef51b8c87f75f3&role.id=a9895331e9694fa8b2b50908bb057bcb => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:19.173496 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20e1ab3-44e1-45ee-b01c-7bd38f481264 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:19.173496 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20e1ab3-44e1-45ee-b01c-7bd38f481264 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:19.173496 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20e1ab3-44e1-45ee-b01c-7bd38f481264 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:19.173496 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 51/98] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:10:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:10:19.183044 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0dc016-0d80-4bc7-b8a2-9d0556263dd5 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:19.183044 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0dc016-0d80-4bc7-b8a2-9d0556263dd5 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:19.183044 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0dc016-0d80-4bc7-b8a2-9d0556263dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:19.206527 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-aa0dc016-0d80-4bc7-b8a2-9d0556263dd5 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:10:19.208037 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-aa0dc016-0d80-4bc7-b8a2-9d0556263dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:10:19.300723 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 48/99] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:10:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 10:10:19.347885 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20e1ab3-44e1-45ee-b01c-7bd38f481264 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:19.383960 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e35324-10eb-4847-8ae5-1d9c12061f4b None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:19.384358 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e35324-10eb-4847-8ae5-1d9c12061f4b None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:19.384714 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e35324-10eb-4847-8ae5-1d9c12061f4b None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:19.386325 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 49/100] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:10:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 10:10:19.395069 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad05443-d72b-45b8-b0fb-15df3954ff6a None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:19.395358 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad05443-d72b-45b8-b0fb-15df3954ff6a None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:19.395642 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad05443-d72b-45b8-b0fb-15df3954ff6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:19.411884 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:19.422930 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-3ad05443-d72b-45b8-b0fb-15df3954ff6a None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:10:19.424124 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-3ad05443-d72b-45b8-b0fb-15df3954ff6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:10:19.515681 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20e1ab3-44e1-45ee-b01c-7bd38f481264 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:19.535370 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 50/101] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:10:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 10:10:19.580325 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad05443-d72b-45b8-b0fb-15df3954ff6a None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:19.580653 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9882d2-2f09-42b7-a106-792388604a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:19.581338 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9882d2-2f09-42b7-a106-792388604a53 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:19.581619 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9882d2-2f09-42b7-a106-792388604a53 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:19.581917 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9882d2-2f09-42b7-a106-792388604a53 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:19.586363 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9882d2-2f09-42b7-a106-792388604a53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:19.588205 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9882d2-2f09-42b7-a106-792388604a53 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:19.590006 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 52/102] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:10:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:19.596445 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9882d2-2f09-42b7-a106-792388604a53 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:19.640350 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:19.756057 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad05443-d72b-45b8-b0fb-15df3954ff6a None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:19.800431 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9882d2-2f09-42b7-a106-792388604a53 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:19.822934 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084ce07b-f713-47c9-8450-a9ae5c42d0ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:19.823932 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ce07b-f713-47c9-8450-a9ae5c42d0ab None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:19.824416 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ce07b-f713-47c9-8450-a9ae5c42d0ab None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:19.824888 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ce07b-f713-47c9-8450-a9ae5c42d0ab None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:19.834176 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:19.847595 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084ce07b-f713-47c9-8450-a9ae5c42d0ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 10:10:19.853351 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-084ce07b-f713-47c9-8450-a9ae5c42d0ab None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 10:10:19.853351 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:10:19.853351 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:10:19.853351 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:10:19.853351 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:10:19.853351 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:10:19.853351 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:10:19.853351 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:10:19.853351 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:10:19.853351 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:10:19.853351 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:10:19.853351 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:10:19.853351 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 10:10:19.853351 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 10:10:19.853351 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 10:10:19.853351 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 10:10:19.854469 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 10:10:19.854469 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 10:10:19.854469 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 10:10:19.854469 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 10:10:19.854469 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:10:19.854469 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:10:19.854469 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:10:19.854469 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:10:19.854469 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:10:19.854469 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:10:19.854469 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:10:19.854469 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:10:19.854469 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:10:19.854469 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:10:19.854469 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:10:19.854469 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:10:19.855225 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:10:19.855225 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:10:19.855225 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:10:19.855225 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:10:19.855225 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 10:10:19.855225 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 10:10:19.855225 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 10:10:19.855225 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 10:10:19.855225 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 10:10:19.855225 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 10:10:19.855225 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 10:10:19.855225 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:10:19.855792 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5f756e-4517-4d9b-9c51-6b348b95d053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:19.855792 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5f756e-4517-4d9b-9c51-6b348b95d053 None admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:19.855792 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5f756e-4517-4d9b-9c51-6b348b95d053 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:19.855792 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5f756e-4517-4d9b-9c51-6b348b95d053 None admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:19.856043 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5f756e-4517-4d9b-9c51-6b348b95d053 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:19.857928 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 51/103] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Aug 9 10:10:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:10:19.858030 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5f756e-4517-4d9b-9c51-6b348b95d053 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:19.859851 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28287ef-3a39-4c24-a74e-62288d2fc3b9 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:19.860317 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28287ef-3a39-4c24-a74e-62288d2fc3b9 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:19.860795 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28287ef-3a39-4c24-a74e-62288d2fc3b9 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:19.862406 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 52/104] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:10:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:10:19.864050 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b9278-d601-4a7c-b69b-352e90c5cf4f None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:19.864402 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b9278-d601-4a7c-b69b-352e90c5cf4f None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:19.864744 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b9278-d601-4a7c-b69b-352e90c5cf4f None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:19.869881 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 53/105] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:10:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:10:19.869881 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83b9278-d601-4a7c-b69b-352e90c5cf4f None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:19.898879 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 53/106] 10.222.0.36 () {60 vars in 1141 bytes} [Tue Aug 9 10:10:19 2022] POST /identity/v3/projects => generated 302 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 10:10:19.900683 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd4580-dc61-4c99-b9e8-373771a11287 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:19.901222 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd4580-dc61-4c99-b9e8-373771a11287 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:19.901707 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd4580-dc61-4c99-b9e8-373771a11287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:19.925016 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-29cd4580-dc61-4c99-b9e8-373771a11287 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:10:19.926995 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-29cd4580-dc61-4c99-b9e8-373771a11287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:10:20.040213 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 54/107] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:10:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 10:10:20.041368 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05741fea-812e-4e0d-96a0-1a0f06f80f52 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:20.041994 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05741fea-812e-4e0d-96a0-1a0f06f80f52 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:20.042453 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05741fea-812e-4e0d-96a0-1a0f06f80f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:20.062184 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-05741fea-812e-4e0d-96a0-1a0f06f80f52 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:10:20.063693 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-05741fea-812e-4e0d-96a0-1a0f06f80f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:10:20.067163 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:20.102695 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83b9278-d601-4a7c-b69b-352e90c5cf4f None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:20.143346 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dfb78d-78bb-4265-b61f-9e282f8d6436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:20.144320 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dfb78d-78bb-4265-b61f-9e282f8d6436 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:20.144797 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dfb78d-78bb-4265-b61f-9e282f8d6436 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:20.145259 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dfb78d-78bb-4265-b61f-9e282f8d6436 None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:20.146247 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dfb78d-78bb-4265-b61f-9e282f8d6436 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:10:20.146868 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dfb78d-78bb-4265-b61f-9e282f8d6436 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:20.148439 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 55/108] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:10:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 10:10:20.148781 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dfb78d-78bb-4265-b61f-9e282f8d6436 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:20.149628 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05741fea-812e-4e0d-96a0-1a0f06f80f52 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:20.161964 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 54/109] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Aug 9 10:10:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:20.167665 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dfb78d-78bb-4265-b61f-9e282f8d6436 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:20.258528 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:20.260349 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05741fea-812e-4e0d-96a0-1a0f06f80f52 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:20.291563 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dfb78d-78bb-4265-b61f-9e282f8d6436 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:20.299241 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ddde67-67a7-44f6-9201-71ef5f3211ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:20.299893 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ddde67-67a7-44f6-9201-71ef5f3211ce None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:20.300483 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ddde67-67a7-44f6-9201-71ef5f3211ce None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:20.300483 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ddde67-67a7-44f6-9201-71ef5f3211ce None admin] PATH_INFO: `/v3/roles/member` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:20.303532 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:20.313201 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ddde67-67a7-44f6-9201-71ef5f3211ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 10:10:20.318190 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-d0ddde67-67a7-44f6-9201-71ef5f3211ce None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 10:10:20.318190 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:10:20.318190 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:10:20.318190 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:10:20.318190 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:10:20.318190 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:10:20.318190 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:10:20.318190 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:10:20.318190 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:10:20.318190 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:10:20.318190 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:10:20.318190 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:10:20.318190 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 10:10:20.318190 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 10:10:20.318190 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 10:10:20.318190 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 10:10:20.319022 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 10:10:20.319022 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 10:10:20.319022 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 10:10:20.319022 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 10:10:20.319022 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:10:20.319022 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:10:20.319022 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:10:20.319022 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:10:20.319022 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:10:20.319022 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:10:20.319022 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:10:20.319022 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:10:20.319022 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:10:20.319022 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:10:20.319022 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:10:20.319022 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:10:20.319776 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:10:20.319776 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:10:20.319776 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:10:20.319776 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:10:20.319776 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 10:10:20.319776 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 10:10:20.319776 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 10:10:20.319776 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 10:10:20.319776 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 10:10:20.319776 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 10:10:20.319776 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 10:10:20.319776 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:10:20.319776 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 56/110] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Aug 9 10:10:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:10:20.320445 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ddde67-67a7-44f6-9201-71ef5f3211ce None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:20.335349 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01fe219-8d1f-4835-99cc-0286c20449a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:20.336289 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01fe219-8d1f-4835-99cc-0286c20449a4 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:20.336718 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01fe219-8d1f-4835-99cc-0286c20449a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:20.337132 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01fe219-8d1f-4835-99cc-0286c20449a4 None admin] PATH_INFO: `/v3/users/6c56fcc8dda046b6b958632ec4f5de24` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:20.351980 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01fe219-8d1f-4835-99cc-0286c20449a4 None admin] RBAC: Authorizing `identity:get_user(user_id=6c56fcc8dda046b6b958632ec4f5de24)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:20.353771 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01fe219-8d1f-4835-99cc-0286c20449a4 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:20.355839 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 55/111] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Aug 9 10:10:20 2022] GET /identity/v3/users/6c56fcc8dda046b6b958632ec4f5de24 => generated 289 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:10:20.357451 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01fe219-8d1f-4835-99cc-0286c20449a4 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:20.432418 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ddde67-67a7-44f6-9201-71ef5f3211ce None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:20.471175 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731bc59f-209a-4a92-ab64-c29c67d28325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:20.471969 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731bc59f-209a-4a92-ab64-c29c67d28325 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:20.472357 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731bc59f-209a-4a92-ab64-c29c67d28325 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:20.472641 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731bc59f-209a-4a92-ab64-c29c67d28325 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:20.487315 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731bc59f-209a-4a92-ab64-c29c67d28325 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 10:10:20.492111 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-731bc59f-209a-4a92-ab64-c29c67d28325 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 10:10:20.492111 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:10:20.492111 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:10:20.492111 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:10:20.492111 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:10:20.492111 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:10:20.492111 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:10:20.492111 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:10:20.492111 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:10:20.492111 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:10:20.492111 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:10:20.492111 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:10:20.492111 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 10:10:20.492111 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 10:10:20.492111 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 10:10:20.492111 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 10:10:20.492936 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 10:10:20.492936 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 10:10:20.492936 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 10:10:20.492936 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 10:10:20.492936 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:10:20.492936 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:10:20.492936 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:10:20.492936 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:10:20.492936 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:10:20.492936 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:10:20.492936 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:10:20.492936 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:10:20.492936 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:10:20.492936 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:10:20.492936 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:10:20.492936 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:10:20.494109 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:10:20.494109 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:10:20.494109 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:10:20.494109 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:10:20.494109 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 10:10:20.494109 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 10:10:20.494109 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 10:10:20.494109 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 10:10:20.494109 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 10:10:20.494109 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 10:10:20.494109 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 10:10:20.494109 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:10:20.494109 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 57/112] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Aug 9 10:10:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:10:20.494743 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731bc59f-209a-4a92-ab64-c29c67d28325 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:20.502343 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01fe219-8d1f-4835-99cc-0286c20449a4 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:20.521545 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:20.550502 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efa0cb7-a896-45f8-ae4a-efeaecfd62df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:20.551332 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa0cb7-a896-45f8-ae4a-efeaecfd62df None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:20.551999 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa0cb7-a896-45f8-ae4a-efeaecfd62df None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:20.552280 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa0cb7-a896-45f8-ae4a-efeaecfd62df None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:20.552950 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efa0cb7-a896-45f8-ae4a-efeaecfd62df None admin] RBAC: Adding query filter params (name=member) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:10:20.553258 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efa0cb7-a896-45f8-ae4a-efeaecfd62df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:20.554686 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efa0cb7-a896-45f8-ae4a-efeaecfd62df None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:20.562014 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:20.565162 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 56/113] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Aug 9 10:10:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:20.567511 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf079981-62df-43ee-be81-02d480d7ac00 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:20.567790 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf079981-62df-43ee-be81-02d480d7ac00 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:20.568065 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf079981-62df-43ee-be81-02d480d7ac00 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:20.569288 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 57/114] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:10:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:10:20.570018 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf079981-62df-43ee-be81-02d480d7ac00 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:20.615775 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731bc59f-209a-4a92-ab64-c29c67d28325 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:20.659568 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25c75c4-ae07-4a4b-a929-5f765cf6bd04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:20.660177 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25c75c4-ae07-4a4b-a929-5f765cf6bd04 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:20.660701 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25c75c4-ae07-4a4b-a929-5f765cf6bd04 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:20.660984 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25c75c4-ae07-4a4b-a929-5f765cf6bd04 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:20.703970 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf079981-62df-43ee-be81-02d480d7ac00 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:20.744730 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25c75c4-ae07-4a4b-a929-5f765cf6bd04 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:20.746242 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25c75c4-ae07-4a4b-a929-5f765cf6bd04 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:20.748646 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25a142e-fe0d-4893-b6e6-145ce72982b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:20.749218 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a142e-fe0d-4893-b6e6-145ce72982b7 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:20.749973 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a142e-fe0d-4893-b6e6-145ce72982b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:20.749973 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a142e-fe0d-4893-b6e6-145ce72982b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:20.750443 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25a142e-fe0d-4893-b6e6-145ce72982b7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:10:20.750746 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25a142e-fe0d-4893-b6e6-145ce72982b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:20.752099 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25a142e-fe0d-4893-b6e6-145ce72982b7 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:20.760948 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 58/115] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Aug 9 10:10:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:20.761755 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25a142e-fe0d-4893-b6e6-145ce72982b7 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:20.804665 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:20.813330 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:20.860692 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 58/116] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Aug 9 10:10:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 10:10:20.861860 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bbb9db-e8d7-45dc-a043-6bdb0a11f510 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:20.862149 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bbb9db-e8d7-45dc-a043-6bdb0a11f510 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:20.862420 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bbb9db-e8d7-45dc-a043-6bdb0a11f510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:20.877377 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25a142e-fe0d-4893-b6e6-145ce72982b7 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:20.880227 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-47bbb9db-e8d7-45dc-a043-6bdb0a11f510 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:10:20.881408 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-47bbb9db-e8d7-45dc-a043-6bdb0a11f510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:10:20.915241 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f46abde-64c7-4fbf-99ae-870f081e44eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:20.916146 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f46abde-64c7-4fbf-99ae-870f081e44eb None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:20.916609 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f46abde-64c7-4fbf-99ae-870f081e44eb None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:20.917103 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f46abde-64c7-4fbf-99ae-870f081e44eb None admin] PATH_INFO: `/v3/users/bdb286c28efa42b5a3fd021d0345a5a5` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:20.918291 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f46abde-64c7-4fbf-99ae-870f081e44eb None admin] RBAC: Authorizing `identity:get_user(user_id=bdb286c28efa42b5a3fd021d0345a5a5)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:20.919786 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f46abde-64c7-4fbf-99ae-870f081e44eb None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:20.929661 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 59/117] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Aug 9 10:10:20 2022] GET /identity/v3/users/bdb286c28efa42b5a3fd021d0345a5a5 => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:20.929661 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af733733-97ef-4343-a755-49925212c20d None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:20.929661 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af733733-97ef-4343-a755-49925212c20d None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:20.929661 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af733733-97ef-4343-a755-49925212c20d None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:20.929661 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 60/118] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:10:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:10:20.929661 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af733733-97ef-4343-a755-49925212c20d None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:20.963185 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 59/119] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:10:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 10:10:20.964197 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bbb9db-e8d7-45dc-a043-6bdb0a11f510 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:21.049259 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:21.052619 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af733733-97ef-4343-a755-49925212c20d None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:21.059953 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:21.066940 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bbb9db-e8d7-45dc-a043-6bdb0a11f510 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:21.092634 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1822ec-0774-4646-82fe-0243954017f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:21.093269 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1822ec-0774-4646-82fe-0243954017f6 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:21.093552 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1822ec-0774-4646-82fe-0243954017f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:21.093819 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1822ec-0774-4646-82fe-0243954017f6 None admin] PATH_INFO: `/v3/users/f678c8c3c6754b9a81efff6e9db8f623` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:21.094982 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1822ec-0774-4646-82fe-0243954017f6 None admin] RBAC: Authorizing `identity:get_user(user_id=f678c8c3c6754b9a81efff6e9db8f623)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:21.096441 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1822ec-0774-4646-82fe-0243954017f6 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:21.098201 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 61/120] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Aug 9 10:10:20 2022] GET /identity/v3/users/f678c8c3c6754b9a81efff6e9db8f623 => generated 247 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:21.102206 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b843e60-dd69-4275-a989-e5bed61ee1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:21.103134 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b843e60-dd69-4275-a989-e5bed61ee1dd None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:21.103298 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1822ec-0774-4646-82fe-0243954017f6 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:21.103408 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b843e60-dd69-4275-a989-e5bed61ee1dd None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:21.103692 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b843e60-dd69-4275-a989-e5bed61ee1dd None admin] PATH_INFO: `/v3/projects/5a0951c053754bea9df8fb8448e1b42f` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:21.104750 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b843e60-dd69-4275-a989-e5bed61ee1dd None admin] RBAC: Authorizing `identity:get_project(project_id=5a0951c053754bea9df8fb8448e1b42f)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:21.106206 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b843e60-dd69-4275-a989-e5bed61ee1dd None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:21.108952 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 60/121] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Aug 9 10:10:20 2022] GET /identity/v3/projects/5a0951c053754bea9df8fb8448e1b42f => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:21.109482 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a17c11-a0bb-4a0b-9f1e-80541210495f None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:21.109764 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a17c11-a0bb-4a0b-9f1e-80541210495f None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:21.110060 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a17c11-a0bb-4a0b-9f1e-80541210495f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:21.128516 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-19a17c11-a0bb-4a0b-9f1e-80541210495f None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:10:21.129650 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-19a17c11-a0bb-4a0b-9f1e-80541210495f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:10:21.206306 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 61/122] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:10:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 10:10:21.210032 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a17c11-a0bb-4a0b-9f1e-80541210495f None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:21.223259 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1822ec-0774-4646-82fe-0243954017f6 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:21.265780 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d959f9b6-504a-42dd-aadf-7c68425d7acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:21.266429 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d959f9b6-504a-42dd-aadf-7c68425d7acb None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:21.266708 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d959f9b6-504a-42dd-aadf-7c68425d7acb None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:21.267091 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d959f9b6-504a-42dd-aadf-7c68425d7acb None admin] PATH_INFO: `/v3/projects/5a0951c053754bea9df8fb8448e1b42f` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:21.268228 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d959f9b6-504a-42dd-aadf-7c68425d7acb None admin] RBAC: Authorizing `identity:get_project(project_id=5a0951c053754bea9df8fb8448e1b42f)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:21.269674 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d959f9b6-504a-42dd-aadf-7c68425d7acb None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:21.271349 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 62/123] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Aug 9 10:10:21 2022] GET /identity/v3/projects/5a0951c053754bea9df8fb8448e1b42f => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:21.272094 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d959f9b6-504a-42dd-aadf-7c68425d7acb None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:21.312599 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:21.319086 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:21.329746 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a17c11-a0bb-4a0b-9f1e-80541210495f None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:21.365374 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9fb21c-1949-44da-bc1c-99aa55fd98ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:21.366037 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9fb21c-1949-44da-bc1c-99aa55fd98ff None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:21.366320 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9fb21c-1949-44da-bc1c-99aa55fd98ff None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:21.367010 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9fb21c-1949-44da-bc1c-99aa55fd98ff None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:21.377627 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9fb21c-1949-44da-bc1c-99aa55fd98ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 10:10:21.379447 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d959f9b6-504a-42dd-aadf-7c68425d7acb None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:21.382544 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-0d9fb21c-1949-44da-bc1c-99aa55fd98ff None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 10:10:21.382544 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:10:21.382544 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:10:21.382544 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:10:21.382544 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:10:21.382544 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:10:21.382544 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:10:21.382544 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:10:21.382544 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:10:21.382544 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:10:21.382544 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:10:21.382544 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:10:21.382544 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 10:10:21.382544 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 10:10:21.382544 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 10:10:21.382544 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 10:10:21.383398 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 10:10:21.383398 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 10:10:21.383398 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 10:10:21.383398 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 10:10:21.383398 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:10:21.383398 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:10:21.383398 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:10:21.383398 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:10:21.383398 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:10:21.383398 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:10:21.383398 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:10:21.383398 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:10:21.383398 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:10:21.383398 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:10:21.383398 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:10:21.383398 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:10:21.384157 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:10:21.384157 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:10:21.384157 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:10:21.384157 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:10:21.384157 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 10:10:21.384157 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 10:10:21.384157 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 10:10:21.384157 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 10:10:21.384157 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 10:10:21.384157 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 10:10:21.384157 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 10:10:21.384157 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:10:21.384157 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 62/124] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Aug 9 10:10:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:10:21.384768 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9fb21c-1949-44da-bc1c-99aa55fd98ff None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:21.420101 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30605a2-52a1-4059-ac59-af2db7daeece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:21.420735 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30605a2-52a1-4059-ac59-af2db7daeece None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:21.421020 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30605a2-52a1-4059-ac59-af2db7daeece None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:21.421294 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30605a2-52a1-4059-ac59-af2db7daeece None admin] PATH_INFO: `/v3/projects/5a0951c053754bea9df8fb8448e1b42f` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:21.422524 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30605a2-52a1-4059-ac59-af2db7daeece None admin] RBAC: Authorizing `identity:get_project(project_id=5a0951c053754bea9df8fb8448e1b42f)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:21.423970 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30605a2-52a1-4059-ac59-af2db7daeece None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:21.430219 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 63/125] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Aug 9 10:10:21 2022] GET /identity/v3/projects/5a0951c053754bea9df8fb8448e1b42f => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:21.430219 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30605a2-52a1-4059-ac59-af2db7daeece None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:21.496958 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9fb21c-1949-44da-bc1c-99aa55fd98ff None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:21.534813 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30605a2-52a1-4059-ac59-af2db7daeece None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:21.546794 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2266dd56-2d41-4858-b26f-63c05894340e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:21.547686 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2266dd56-2d41-4858-b26f-63c05894340e None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:21.548130 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2266dd56-2d41-4858-b26f-63c05894340e None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:21.548399 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2266dd56-2d41-4858-b26f-63c05894340e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:21.548651 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:21.549136 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2266dd56-2d41-4858-b26f-63c05894340e None admin] RBAC: Adding query filter params (role.id=b2850f278b2d4b32b2b56324509a5a01, scope.project.id=5a0951c053754bea9df8fb8448e1b42f, user.id=6c56fcc8dda046b6b958632ec4f5de24) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:10:21.549447 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2266dd56-2d41-4858-b26f-63c05894340e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:21.551496 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2266dd56-2d41-4858-b26f-63c05894340e None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:21.566047 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 63/126] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Aug 9 10:10:21 2022] GET /identity/v3/role_assignments?user.id=6c56fcc8dda046b6b958632ec4f5de24&scope.project.id=5a0951c053754bea9df8fb8448e1b42f&role.id=b2850f278b2d4b32b2b56324509a5a01 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:21.566047 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2266dd56-2d41-4858-b26f-63c05894340e None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:21.583699 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:21.589479 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f7f207-612c-4f2d-826a-97ef34281119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:21.590558 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f7f207-612c-4f2d-826a-97ef34281119 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:21.591190 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f7f207-612c-4f2d-826a-97ef34281119 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:21.591708 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f7f207-612c-4f2d-826a-97ef34281119 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:21.604410 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f7f207-612c-4f2d-826a-97ef34281119 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 10:10:21.609865 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-64f7f207-612c-4f2d-826a-97ef34281119 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 10:10:21.609865 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:10:21.609865 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:10:21.609865 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:10:21.609865 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:10:21.609865 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:10:21.609865 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:10:21.609865 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:10:21.609865 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:10:21.609865 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:10:21.609865 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:10:21.609865 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:10:21.609865 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 10:10:21.609865 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 10:10:21.609865 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 10:10:21.609865 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 10:10:21.610967 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 10:10:21.610967 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 10:10:21.610967 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 10:10:21.610967 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 10:10:21.610967 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:10:21.610967 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:10:21.610967 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:10:21.610967 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:10:21.610967 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:10:21.610967 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:10:21.610967 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:10:21.610967 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:10:21.610967 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:10:21.610967 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:10:21.610967 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:10:21.610967 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:10:21.611913 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:10:21.611913 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:10:21.611913 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:10:21.611913 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:10:21.611913 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 10:10:21.611913 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 10:10:21.611913 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 10:10:21.611913 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 10:10:21.611913 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 10:10:21.611913 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 10:10:21.611913 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 10:10:21.611913 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:10:21.614085 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 64/127] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Aug 9 10:10:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:10:21.615108 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f7f207-612c-4f2d-826a-97ef34281119 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:21.704999 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2266dd56-2d41-4858-b26f-63c05894340e None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:21.752384 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06c871a-f795-4d5a-9266-9359e9f904d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:21.753059 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c871a-f795-4d5a-9266-9359e9f904d8 None admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:21.753343 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c871a-f795-4d5a-9266-9359e9f904d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:21.753625 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c871a-f795-4d5a-9266-9359e9f904d8 None admin] PATH_INFO: `/v3/projects/5a0951c053754bea9df8fb8448e1b42f/users/bdb286c28efa42b5a3fd021d0345a5a5/roles/a9895331e9694fa8b2b50908bb057bcb` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:21.756279 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06c871a-f795-4d5a-9266-9359e9f904d8 None admin] RBAC: Authorizing `identity:create_grant(project_id=5a0951c053754bea9df8fb8448e1b42f, user_id=bdb286c28efa42b5a3fd021d0345a5a5, role_id=a9895331e9694fa8b2b50908bb057bcb)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:21.757740 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06c871a-f795-4d5a-9266-9359e9f904d8 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:21.765668 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f7f207-612c-4f2d-826a-97ef34281119 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:21.777881 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 64/128] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Aug 9 10:10:21 2022] PUT /identity/v3/projects/5a0951c053754bea9df8fb8448e1b42f/users/bdb286c28efa42b5a3fd021d0345a5a5/roles/a9895331e9694fa8b2b50908bb057bcb => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:10:21.777881 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06c871a-f795-4d5a-9266-9359e9f904d8 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:21.844153 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e686e082-bbe2-4997-b804-a876cafefac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:21.845019 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e686e082-bbe2-4997-b804-a876cafefac1 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:21.845438 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e686e082-bbe2-4997-b804-a876cafefac1 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:21.845864 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e686e082-bbe2-4997-b804-a876cafefac1 None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:21.846872 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e686e082-bbe2-4997-b804-a876cafefac1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:10:21.847363 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e686e082-bbe2-4997-b804-a876cafefac1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:21.848900 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e686e082-bbe2-4997-b804-a876cafefac1 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:21.855810 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:21.862706 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 65/129] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Aug 9 10:10:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:21.871102 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e686e082-bbe2-4997-b804-a876cafefac1 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:21.938044 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06c871a-f795-4d5a-9266-9359e9f904d8 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:21.949818 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:22.013341 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad5f1e7-730d-4e51-95ad-066b606cb1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:22.014112 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad5f1e7-730d-4e51-95ad-066b606cb1cf None admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:22.014393 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad5f1e7-730d-4e51-95ad-066b606cb1cf None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:22.014667 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad5f1e7-730d-4e51-95ad-066b606cb1cf None admin] PATH_INFO: `/v3/projects/5a0951c053754bea9df8fb8448e1b42f/users/f678c8c3c6754b9a81efff6e9db8f623/roles/89ca30cbbb634be8a96e9921aa56626b` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:22.016619 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad5f1e7-730d-4e51-95ad-066b606cb1cf None admin] RBAC: Authorizing `identity:create_grant(project_id=5a0951c053754bea9df8fb8448e1b42f, user_id=f678c8c3c6754b9a81efff6e9db8f623, role_id=89ca30cbbb634be8a96e9921aa56626b)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:22.018101 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad5f1e7-730d-4e51-95ad-066b606cb1cf None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:22.035089 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 65/130] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Aug 9 10:10:21 2022] PUT /identity/v3/projects/5a0951c053754bea9df8fb8448e1b42f/users/f678c8c3c6754b9a81efff6e9db8f623/roles/89ca30cbbb634be8a96e9921aa56626b => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:10:22.035677 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad5f1e7-730d-4e51-95ad-066b606cb1cf None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:22.055857 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e686e082-bbe2-4997-b804-a876cafefac1 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:22.103282 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8dbad5-dcb8-43e9-a21e-5213f0976969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:22.104505 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8dbad5-dcb8-43e9-a21e-5213f0976969 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:22.105030 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8dbad5-dcb8-43e9-a21e-5213f0976969 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:22.105508 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8dbad5-dcb8-43e9-a21e-5213f0976969 None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:22.106518 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8dbad5-dcb8-43e9-a21e-5213f0976969 None admin] RBAC: Adding query filter params (name=member) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:10:22.107022 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8dbad5-dcb8-43e9-a21e-5213f0976969 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:22.108871 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8dbad5-dcb8-43e9-a21e-5213f0976969 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:22.118920 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 66/131] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Aug 9 10:10:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:22.130961 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8dbad5-dcb8-43e9-a21e-5213f0976969 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:22.172813 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad5f1e7-730d-4e51-95ad-066b606cb1cf None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:22.207315 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:22.224565 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb75b85-76b8-4686-80ca-dbd5a85fc77a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:22.225300 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb75b85-76b8-4686-80ca-dbd5a85fc77a None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:22.225582 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb75b85-76b8-4686-80ca-dbd5a85fc77a None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:22.225871 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb75b85-76b8-4686-80ca-dbd5a85fc77a None admin] PATH_INFO: `/v3/users/bdb286c28efa42b5a3fd021d0345a5a5` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:22.227435 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb75b85-76b8-4686-80ca-dbd5a85fc77a None admin] RBAC: Authorizing `identity:get_user(user_id=bdb286c28efa42b5a3fd021d0345a5a5)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:22.229011 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb75b85-76b8-4686-80ca-dbd5a85fc77a None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:22.238742 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 66/132] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Aug 9 10:10:22 2022] GET /identity/v3/users/bdb286c28efa42b5a3fd021d0345a5a5 => generated 275 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:22.242293 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b516a75-f460-48b4-b380-809e9cbd823b None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:22.242608 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b516a75-f460-48b4-b380-809e9cbd823b None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:22.242892 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b516a75-f460-48b4-b380-809e9cbd823b None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:22.244509 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 67/133] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:10:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:10:22.246729 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b516a75-f460-48b4-b380-809e9cbd823b None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:22.311237 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:22.319148 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8dbad5-dcb8-43e9-a21e-5213f0976969 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:22.355525 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745424f9-8a2e-4ec3-b9bd-787391229659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:22.356155 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745424f9-8a2e-4ec3-b9bd-787391229659 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:22.356509 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745424f9-8a2e-4ec3-b9bd-787391229659 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:22.357302 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745424f9-8a2e-4ec3-b9bd-787391229659 None admin] PATH_INFO: `/v3/users/bdb286c28efa42b5a3fd021d0345a5a5` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:22.359890 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745424f9-8a2e-4ec3-b9bd-787391229659 None admin] RBAC: Authorizing `identity:get_user(user_id=bdb286c28efa42b5a3fd021d0345a5a5)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:22.361343 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745424f9-8a2e-4ec3-b9bd-787391229659 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:22.362965 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 67/134] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Aug 9 10:10:22 2022] GET /identity/v3/users/bdb286c28efa42b5a3fd021d0345a5a5 => generated 275 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:22.364106 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ed670-ec23-4312-844a-e3ed87954d13 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:22.364387 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ed670-ec23-4312-844a-e3ed87954d13 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:22.364658 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ed670-ec23-4312-844a-e3ed87954d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:22.376939 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b516a75-f460-48b4-b380-809e9cbd823b None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:22.387499 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-0f1ed670-ec23-4312-844a-e3ed87954d13 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:10:22.388885 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-0f1ed670-ec23-4312-844a-e3ed87954d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:10:22.416005 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406ca288-d5fd-4dd2-bf0a-c7a9b79c368e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:22.416694 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ca288-d5fd-4dd2-bf0a-c7a9b79c368e None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:22.416982 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ca288-d5fd-4dd2-bf0a-c7a9b79c368e None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:22.417258 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ca288-d5fd-4dd2-bf0a-c7a9b79c368e None admin] PATH_INFO: `/v3/projects/5a0951c053754bea9df8fb8448e1b42f` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:22.419400 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406ca288-d5fd-4dd2-bf0a-c7a9b79c368e None admin] RBAC: Authorizing `identity:get_project(project_id=5a0951c053754bea9df8fb8448e1b42f)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:22.421018 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406ca288-d5fd-4dd2-bf0a-c7a9b79c368e None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:22.422949 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 68/135] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Aug 9 10:10:22 2022] GET /identity/v3/projects/5a0951c053754bea9df8fb8448e1b42f => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:22.427993 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406ca288-d5fd-4dd2-bf0a-c7a9b79c368e None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:22.461746 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 68/136] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:10:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 10:10:22.462610 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1ed670-ec23-4312-844a-e3ed87954d13 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:22.534248 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:22.546534 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406ca288-d5fd-4dd2-bf0a-c7a9b79c368e None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:22.557512 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:22.578878 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1ed670-ec23-4312-844a-e3ed87954d13 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:22.589153 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17368ded-cdba-4a79-891c-0233a757aed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:22.590034 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17368ded-cdba-4a79-891c-0233a757aed8 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:22.590485 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17368ded-cdba-4a79-891c-0233a757aed8 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:22.590939 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17368ded-cdba-4a79-891c-0233a757aed8 None admin] PATH_INFO: `/v3/projects/56c4c1e033cf498ba7ef51b8c87f75f3` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:22.592254 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17368ded-cdba-4a79-891c-0233a757aed8 None admin] RBAC: Authorizing `identity:get_project(project_id=56c4c1e033cf498ba7ef51b8c87f75f3)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:22.593995 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17368ded-cdba-4a79-891c-0233a757aed8 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:22.596015 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 69/137] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Aug 9 10:10:22 2022] GET /identity/v3/projects/56c4c1e033cf498ba7ef51b8c87f75f3 => generated 312 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:22.597003 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17368ded-cdba-4a79-891c-0233a757aed8 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:22.643519 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db991a3d-3b8e-4752-930d-231dd7b2b36b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:22.644214 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db991a3d-3b8e-4752-930d-231dd7b2b36b None admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:22.644508 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db991a3d-3b8e-4752-930d-231dd7b2b36b None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:22.644781 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db991a3d-3b8e-4752-930d-231dd7b2b36b None admin] PATH_INFO: `/v3/projects/5a0951c053754bea9df8fb8448e1b42f/users/bdb286c28efa42b5a3fd021d0345a5a5/roles/af19908af5d6489696eb27791925a5aa` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:22.647348 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db991a3d-3b8e-4752-930d-231dd7b2b36b None admin] RBAC: Authorizing `identity:create_grant(project_id=5a0951c053754bea9df8fb8448e1b42f, user_id=bdb286c28efa42b5a3fd021d0345a5a5, role_id=af19908af5d6489696eb27791925a5aa)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:22.648897 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db991a3d-3b8e-4752-930d-231dd7b2b36b None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:22.681874 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 69/138] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Aug 9 10:10:22 2022] PUT /identity/v3/projects/5a0951c053754bea9df8fb8448e1b42f/users/bdb286c28efa42b5a3fd021d0345a5a5/roles/af19908af5d6489696eb27791925a5aa => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:10:22.681874 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db991a3d-3b8e-4752-930d-231dd7b2b36b None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:22.715068 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17368ded-cdba-4a79-891c-0233a757aed8 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:22.750265 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:22.756656 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc553b46-4f3f-4651-b26d-bf2859bb0fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:22.757539 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc553b46-4f3f-4651-b26d-bf2859bb0fe2 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:22.758048 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc553b46-4f3f-4651-b26d-bf2859bb0fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:22.758826 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc553b46-4f3f-4651-b26d-bf2859bb0fe2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:22.760660 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc553b46-4f3f-4651-b26d-bf2859bb0fe2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:22.762276 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc553b46-4f3f-4651-b26d-bf2859bb0fe2 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:22.764498 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 70/139] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:10:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:22.772783 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc553b46-4f3f-4651-b26d-bf2859bb0fe2 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:22.909670 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc553b46-4f3f-4651-b26d-bf2859bb0fe2 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:22.979943 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db991a3d-3b8e-4752-930d-231dd7b2b36b None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:23.006559 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820c0297-eaf9-426e-8bf4-03b098981539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:23.007181 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820c0297-eaf9-426e-8bf4-03b098981539 None admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:23.007461 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820c0297-eaf9-426e-8bf4-03b098981539 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:23.007734 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820c0297-eaf9-426e-8bf4-03b098981539 None admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:23.008383 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820c0297-eaf9-426e-8bf4-03b098981539 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:23.010005 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820c0297-eaf9-426e-8bf4-03b098981539 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:23.025396 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c02dcf-1c72-42b5-89fa-081d7d89ac32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:23.026123 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c02dcf-1c72-42b5-89fa-081d7d89ac32 None admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:23.026396 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c02dcf-1c72-42b5-89fa-081d7d89ac32 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:23.026667 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c02dcf-1c72-42b5-89fa-081d7d89ac32 None admin] PATH_INFO: `/v3/projects/56c4c1e033cf498ba7ef51b8c87f75f3/users/bdb286c28efa42b5a3fd021d0345a5a5/roles/a9895331e9694fa8b2b50908bb057bcb` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:23.028640 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c02dcf-1c72-42b5-89fa-081d7d89ac32 None admin] RBAC: Authorizing `identity:create_grant(project_id=56c4c1e033cf498ba7ef51b8c87f75f3, user_id=bdb286c28efa42b5a3fd021d0345a5a5, role_id=a9895331e9694fa8b2b50908bb057bcb)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:23.030475 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c02dcf-1c72-42b5-89fa-081d7d89ac32 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:23.048586 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 70/140] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Aug 9 10:10:22 2022] PUT /identity/v3/projects/56c4c1e033cf498ba7ef51b8c87f75f3/users/bdb286c28efa42b5a3fd021d0345a5a5/roles/a9895331e9694fa8b2b50908bb057bcb => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:10:23.050440 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 71/141] 10.222.0.36 () {60 vars in 1132 bytes} [Tue Aug 9 10:10:22 2022] POST /identity/v3/users => generated 283 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:10:24.258821 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5afa60-7385-4b97-ab97-a7f62d09794c None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:24.259378 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5afa60-7385-4b97-ab97-a7f62d09794c None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:24.259378 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5afa60-7385-4b97-ab97-a7f62d09794c None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:24.260947 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 71/142] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:10:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:10:24.266785 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99fc129-394d-4454-ba33-43e3c694238f None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:24.267229 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99fc129-394d-4454-ba33-43e3c694238f None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:24.267443 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99fc129-394d-4454-ba33-43e3c694238f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:24.286819 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-f99fc129-394d-4454-ba33-43e3c694238f None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:10:24.287976 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-f99fc129-394d-4454-ba33-43e3c694238f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:10:24.355084 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:24.377582 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 72/143] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:10:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 10:10:24.408597 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5afa60-7385-4b97-ab97-a7f62d09794c None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:24.424990 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:24.530109 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5afa60-7385-4b97-ab97-a7f62d09794c None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:24.570496 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a278ed5-af1b-4e3e-b991-d2f0d4ae3535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:24.571129 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a278ed5-af1b-4e3e-b991-d2f0d4ae3535 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:24.571431 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a278ed5-af1b-4e3e-b991-d2f0d4ae3535 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:24.571855 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a278ed5-af1b-4e3e-b991-d2f0d4ae3535 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:24.588515 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a278ed5-af1b-4e3e-b991-d2f0d4ae3535 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 10:10:24.594586 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-5a278ed5-af1b-4e3e-b991-d2f0d4ae3535 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 10:10:24.594586 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:10:24.594586 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:10:24.594586 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:10:24.594586 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:10:24.594586 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:10:24.594586 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:10:24.594586 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:10:24.594586 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:10:24.594586 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:10:24.594586 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:10:24.594586 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:10:24.594586 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 10:10:24.594586 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 10:10:24.594586 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 10:10:24.594586 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 10:10:24.595488 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 10:10:24.595488 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 10:10:24.595488 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 10:10:24.595488 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 10:10:24.595488 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:10:24.595488 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:10:24.595488 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:10:24.595488 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:10:24.595488 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:10:24.595488 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:10:24.595488 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:10:24.595488 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:10:24.595488 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:10:24.595488 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:10:24.595488 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:10:24.595488 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:10:24.597529 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:10:24.597529 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:10:24.597529 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:10:24.597529 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:10:24.597529 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 10:10:24.597529 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 10:10:24.597529 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 10:10:24.597529 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 10:10:24.597529 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 10:10:24.597529 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 10:10:24.597529 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 10:10:24.597529 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:10:24.597529 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 72/144] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Aug 9 10:10:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:10:24.601688 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99fc129-394d-4454-ba33-43e3c694238f None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:24.648614 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a96f6-7f0b-4504-83db-2da49572b5f2 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:24.648948 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a96f6-7f0b-4504-83db-2da49572b5f2 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:24.649160 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a96f6-7f0b-4504-83db-2da49572b5f2 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:24.650729 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 73/145] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:10:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:10:24.657608 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab957c-1b85-49d1-95f4-9eefab1f9a16 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:24.657914 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab957c-1b85-49d1-95f4-9eefab1f9a16 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:24.658171 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab957c-1b85-49d1-95f4-9eefab1f9a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:24.680656 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-11ab957c-1b85-49d1-95f4-9eefab1f9a16 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:10:24.681881 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-11ab957c-1b85-49d1-95f4-9eefab1f9a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:10:24.733362 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99fc129-394d-4454-ba33-43e3c694238f None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:24.759291 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 74/146] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:10:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 10:10:24.786701 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ba7dee-e520-4ccc-bb28-955ecafbb610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:24.787262 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ba7dee-e520-4ccc-bb28-955ecafbb610 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:24.787544 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ba7dee-e520-4ccc-bb28-955ecafbb610 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:24.787820 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ba7dee-e520-4ccc-bb28-955ecafbb610 None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:24.788521 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ba7dee-e520-4ccc-bb28-955ecafbb610 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:10:24.788805 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ba7dee-e520-4ccc-bb28-955ecafbb610 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:24.790809 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ba7dee-e520-4ccc-bb28-955ecafbb610 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:24.791851 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ab957c-1b85-49d1-95f4-9eefab1f9a16 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:24.794445 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:24.800935 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 73/147] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Aug 9 10:10:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:24.815578 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ba7dee-e520-4ccc-bb28-955ecafbb610 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:24.909012 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ab957c-1b85-49d1-95f4-9eefab1f9a16 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:24.912577 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:24.954126 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b02ca32-4e27-4983-a3aa-6c99bb0840ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:24.954126 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02ca32-4e27-4983-a3aa-6c99bb0840ab None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:24.954126 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02ca32-4e27-4983-a3aa-6c99bb0840ab None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:24.954126 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02ca32-4e27-4983-a3aa-6c99bb0840ab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:24.962297 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b02ca32-4e27-4983-a3aa-6c99bb0840ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 10:10:24.969600 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-1b02ca32-4e27-4983-a3aa-6c99bb0840ab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 10:10:24.969600 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:10:24.969600 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:10:24.969600 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:10:24.969600 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:10:24.969600 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:10:24.969600 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:10:24.969600 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:10:24.969600 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:10:24.969600 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:10:24.969600 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:10:24.969600 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:10:24.969600 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 10:10:24.969600 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 10:10:24.969600 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 10:10:24.969600 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 10:10:24.970574 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 10:10:24.970574 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 10:10:24.970574 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 10:10:24.970574 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 10:10:24.970574 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:10:24.970574 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:10:24.970574 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:10:24.970574 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:10:24.970574 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:10:24.970574 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:10:24.970574 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:10:24.970574 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:10:24.970574 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:10:24.970574 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:10:24.970574 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:10:24.970574 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:10:24.972424 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:10:24.972424 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:10:24.972424 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:10:24.972424 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:10:24.972424 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 10:10:24.972424 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 10:10:24.972424 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 10:10:24.972424 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 10:10:24.972424 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 10:10:24.972424 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 10:10:24.972424 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 10:10:24.972424 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:10:24.972424 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 75/148] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Aug 9 10:10:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 10:10:24.972424 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e47ccea-9f55-4b99-90da-28a4c808a944 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:24.973131 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e47ccea-9f55-4b99-90da-28a4c808a944 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:24.973131 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e47ccea-9f55-4b99-90da-28a4c808a944 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:24.979213 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 76/149] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:10:24 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:10:24.980089 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e47ccea-9f55-4b99-90da-28a4c808a944 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:25.023468 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ba7dee-e520-4ccc-bb28-955ecafbb610 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:25.052225 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:25.096141 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e47ccea-9f55-4b99-90da-28a4c808a944 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:25.111220 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bdad20-9990-44e1-9e1a-022f32b76993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:25.111874 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bdad20-9990-44e1-9e1a-022f32b76993 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:25.112156 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bdad20-9990-44e1-9e1a-022f32b76993 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:25.112426 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bdad20-9990-44e1-9e1a-022f32b76993 None admin] PATH_INFO: `/v3/users/6c56fcc8dda046b6b958632ec4f5de24` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:25.113563 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bdad20-9990-44e1-9e1a-022f32b76993 None admin] RBAC: Authorizing `identity:get_user(user_id=6c56fcc8dda046b6b958632ec4f5de24)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:25.115024 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bdad20-9990-44e1-9e1a-022f32b76993 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:25.116938 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 74/150] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Aug 9 10:10:24 2022] GET /identity/v3/users/6c56fcc8dda046b6b958632ec4f5de24 => generated 289 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:25.118087 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a555349b-107f-4809-87a1-4a5770001685 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:25.118367 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a555349b-107f-4809-87a1-4a5770001685 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:25.118636 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a555349b-107f-4809-87a1-4a5770001685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:25.138865 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06c33f8-c3fd-4df2-99fb-554b6415b4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:25.139531 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c33f8-c3fd-4df2-99fb-554b6415b4f4 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:25.139854 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c33f8-c3fd-4df2-99fb-554b6415b4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:25.140122 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c33f8-c3fd-4df2-99fb-554b6415b4f4 None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:25.140862 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06c33f8-c3fd-4df2-99fb-554b6415b4f4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:10:25.141164 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06c33f8-c3fd-4df2-99fb-554b6415b4f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:25.142741 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06c33f8-c3fd-4df2-99fb-554b6415b4f4 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:25.149489 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-a555349b-107f-4809-87a1-4a5770001685 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:10:25.152051 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 77/151] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Aug 9 10:10:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:25.153035 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06c33f8-c3fd-4df2-99fb-554b6415b4f4 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:25.154941 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-a555349b-107f-4809-87a1-4a5770001685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:10:25.267538 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06c33f8-c3fd-4df2-99fb-554b6415b4f4 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:25.312023 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:25.366542 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbf94a9-9673-4742-a341-d4898094f7ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:25.367280 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbf94a9-9673-4742-a341-d4898094f7ae None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:25.367568 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbf94a9-9673-4742-a341-d4898094f7ae None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:25.367837 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbf94a9-9673-4742-a341-d4898094f7ae None admin] PATH_INFO: `/v3/projects/5a0951c053754bea9df8fb8448e1b42f` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:25.369224 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 75/152] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:10:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 10:10:25.370067 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbf94a9-9673-4742-a341-d4898094f7ae None admin] RBAC: Authorizing `identity:get_project(project_id=5a0951c053754bea9df8fb8448e1b42f)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:25.371032 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a555349b-107f-4809-87a1-4a5770001685 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:25.371509 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbf94a9-9673-4742-a341-d4898094f7ae None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:25.374481 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 78/153] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Aug 9 10:10:25 2022] GET /identity/v3/projects/5a0951c053754bea9df8fb8448e1b42f => generated 298 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:25.382724 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbf94a9-9673-4742-a341-d4898094f7ae None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:25.455114 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:25.560218 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a555349b-107f-4809-87a1-4a5770001685 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:25.630541 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd094a4-c03b-48a5-8188-1eb5b80d49b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:25.631557 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd094a4-c03b-48a5-8188-1eb5b80d49b4 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:25.632058 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd094a4-c03b-48a5-8188-1eb5b80d49b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:25.632551 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd094a4-c03b-48a5-8188-1eb5b80d49b4 None admin] PATH_INFO: `/v3/users/f678c8c3c6754b9a81efff6e9db8f623` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:25.638935 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd094a4-c03b-48a5-8188-1eb5b80d49b4 None admin] RBAC: Authorizing `identity:get_user(user_id=f678c8c3c6754b9a81efff6e9db8f623)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:25.640683 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd094a4-c03b-48a5-8188-1eb5b80d49b4 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:25.642584 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 76/154] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Aug 9 10:10:25 2022] GET /identity/v3/users/f678c8c3c6754b9a81efff6e9db8f623 => generated 247 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:25.643643 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd094a4-c03b-48a5-8188-1eb5b80d49b4 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:25.656061 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbf94a9-9673-4742-a341-d4898094f7ae None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:25.789562 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b81ca97-f040-4a2a-b0fd-12fb1f14b16d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:25.789780 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd094a4-c03b-48a5-8188-1eb5b80d49b4 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:25.790513 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b81ca97-f040-4a2a-b0fd-12fb1f14b16d None admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:25.790791 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b81ca97-f040-4a2a-b0fd-12fb1f14b16d None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:25.791059 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b81ca97-f040-4a2a-b0fd-12fb1f14b16d None admin] PATH_INFO: `/v3/projects/5a0951c053754bea9df8fb8448e1b42f/users/6c56fcc8dda046b6b958632ec4f5de24/roles/b2850f278b2d4b32b2b56324509a5a01` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:25.802887 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b81ca97-f040-4a2a-b0fd-12fb1f14b16d None admin] RBAC: Authorizing `identity:create_grant(project_id=5a0951c053754bea9df8fb8448e1b42f, user_id=6c56fcc8dda046b6b958632ec4f5de24, role_id=b2850f278b2d4b32b2b56324509a5a01)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:25.804122 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b81ca97-f040-4a2a-b0fd-12fb1f14b16d None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:25.807097 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:25.829959 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d57286-d3e1-4ef9-8286-e27968141e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:25.831044 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d57286-d3e1-4ef9-8286-e27968141e6f None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:25.831547 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d57286-d3e1-4ef9-8286-e27968141e6f None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:25.832074 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d57286-d3e1-4ef9-8286-e27968141e6f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:25.836343 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 79/155] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Aug 9 10:10:25 2022] PUT /identity/v3/projects/5a0951c053754bea9df8fb8448e1b42f/users/6c56fcc8dda046b6b958632ec4f5de24/roles/b2850f278b2d4b32b2b56324509a5a01 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:10:25.837195 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b81ca97-f040-4a2a-b0fd-12fb1f14b16d None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:25.855907 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d57286-d3e1-4ef9-8286-e27968141e6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 10:10:25.861808 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-a6d57286-d3e1-4ef9-8286-e27968141e6f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 10:10:25.861808 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:10:25.861808 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:10:25.861808 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:10:25.861808 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:10:25.861808 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:10:25.861808 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:10:25.861808 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:10:25.861808 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:10:25.861808 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:10:25.861808 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:10:25.861808 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:10:25.861808 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 10:10:25.861808 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 10:10:25.861808 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 10:10:25.861808 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 10:10:25.866849 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 10:10:25.866849 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 10:10:25.866849 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 10:10:25.866849 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 10:10:25.866849 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:10:25.866849 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:10:25.866849 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:10:25.866849 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:10:25.866849 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:10:25.866849 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:10:25.866849 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:10:25.866849 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:10:25.866849 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:10:25.866849 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:10:25.866849 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:10:25.866849 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:10:25.867902 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:10:25.867902 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:10:25.867902 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:10:25.867902 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:10:25.867902 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 10:10:25.867902 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 10:10:25.867902 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 10:10:25.867902 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 10:10:25.867902 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 10:10:25.867902 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 10:10:25.867902 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 10:10:25.867902 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:10:25.871618 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 77/156] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Aug 9 10:10:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:10:25.878142 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d57286-d3e1-4ef9-8286-e27968141e6f None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:25.965875 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:26.042166 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d57286-d3e1-4ef9-8286-e27968141e6f None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:26.094457 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8598f908-85e5-430d-bd0f-3ba474b0c49f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:26.095412 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8598f908-85e5-430d-bd0f-3ba474b0c49f None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:26.095916 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8598f908-85e5-430d-bd0f-3ba474b0c49f None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:26.096376 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8598f908-85e5-430d-bd0f-3ba474b0c49f None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:26.097283 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8598f908-85e5-430d-bd0f-3ba474b0c49f None admin] RBAC: Adding query filter params (name=member) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:10:26.097827 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8598f908-85e5-430d-bd0f-3ba474b0c49f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:26.102687 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8598f908-85e5-430d-bd0f-3ba474b0c49f None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:26.114969 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b81ca97-f040-4a2a-b0fd-12fb1f14b16d None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:26.115335 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 78/157] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Aug 9 10:10:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:26.122075 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8598f908-85e5-430d-bd0f-3ba474b0c49f None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:26.174455 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:26.187970 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774d9c08-f93c-4b0d-ab21-dbf5380705b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:26.188545 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d9c08-f93c-4b0d-ab21-dbf5380705b9 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:26.188811 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d9c08-f93c-4b0d-ab21-dbf5380705b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:26.189081 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d9c08-f93c-4b0d-ab21-dbf5380705b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:26.242917 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8598f908-85e5-430d-bd0f-3ba474b0c49f None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:26.279139 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b181b-e16c-4ed3-8478-207ab4aa390c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:26.280723 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b181b-e16c-4ed3-8478-207ab4aa390c None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:26.281515 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b181b-e16c-4ed3-8478-207ab4aa390c None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:26.282100 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b181b-e16c-4ed3-8478-207ab4aa390c None admin] PATH_INFO: `/v3/users/bdb286c28efa42b5a3fd021d0345a5a5` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:26.283588 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787b181b-e16c-4ed3-8478-207ab4aa390c None admin] RBAC: Authorizing `identity:get_user(user_id=bdb286c28efa42b5a3fd021d0345a5a5)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:26.285285 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787b181b-e16c-4ed3-8478-207ab4aa390c None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:26.287212 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 79/158] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Aug 9 10:10:26 2022] GET /identity/v3/users/bdb286c28efa42b5a3fd021d0345a5a5 => generated 275 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:10:26.295489 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b181b-e16c-4ed3-8478-207ab4aa390c None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:26.321207 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774d9c08-f93c-4b0d-ab21-dbf5380705b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:26.322874 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774d9c08-f93c-4b0d-ab21-dbf5380705b9 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:26.393601 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:26.409310 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b181b-e16c-4ed3-8478-207ab4aa390c None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:26.418181 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:26.447074 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f535ae-263d-4bda-9d3d-8da0ec6520f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:26.447799 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f535ae-263d-4bda-9d3d-8da0ec6520f6 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:26.448143 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f535ae-263d-4bda-9d3d-8da0ec6520f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:26.448494 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f535ae-263d-4bda-9d3d-8da0ec6520f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:26.464216 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 80/159] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Aug 9 10:10:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 628 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 10:10:26.470706 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774d9c08-f93c-4b0d-ab21-dbf5380705b9 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:26.552523 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f535ae-263d-4bda-9d3d-8da0ec6520f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:26.554088 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f535ae-263d-4bda-9d3d-8da0ec6520f6 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:26.623838 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774d9c08-f93c-4b0d-ab21-dbf5380705b9 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:26.675913 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe55167-87d1-45c9-990d-b43310d1b102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:26.676554 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe55167-87d1-45c9-990d-b43310d1b102 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:26.676831 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe55167-87d1-45c9-990d-b43310d1b102 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:26.677101 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe55167-87d1-45c9-990d-b43310d1b102 None admin] PATH_INFO: `/v3/projects/5a0951c053754bea9df8fb8448e1b42f` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:26.682571 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe55167-87d1-45c9-990d-b43310d1b102 None admin] RBAC: Authorizing `identity:get_project(project_id=5a0951c053754bea9df8fb8448e1b42f)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:26.684038 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe55167-87d1-45c9-990d-b43310d1b102 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:26.686482 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 81/160] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Aug 9 10:10:26 2022] GET /identity/v3/projects/5a0951c053754bea9df8fb8448e1b42f => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:10:26.692368 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe55167-87d1-45c9-990d-b43310d1b102 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:26.709786 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 80/161] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Aug 9 10:10:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 10:10:26.715658 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f535ae-263d-4bda-9d3d-8da0ec6520f6 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:26.726555 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:26.734235 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:26.869552 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f535ae-263d-4bda-9d3d-8da0ec6520f6 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:26.880623 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe55167-87d1-45c9-990d-b43310d1b102 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:26.923958 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c629a5-7184-45c8-9172-457e6d0c40d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:26.924592 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c629a5-7184-45c8-9172-457e6d0c40d5 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:26.924862 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c629a5-7184-45c8-9172-457e6d0c40d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:26.925124 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c629a5-7184-45c8-9172-457e6d0c40d5 None admin] PATH_INFO: `/v3/projects/5a0951c053754bea9df8fb8448e1b42f` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:26.929868 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c629a5-7184-45c8-9172-457e6d0c40d5 None admin] RBAC: Authorizing `identity:get_project(project_id=5a0951c053754bea9df8fb8448e1b42f)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:26.929868 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c629a5-7184-45c8-9172-457e6d0c40d5 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:26.930577 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 81/162] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Aug 9 10:10:26 2022] GET /identity/v3/projects/5a0951c053754bea9df8fb8448e1b42f => generated 298 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:10:26.945318 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c629a5-7184-45c8-9172-457e6d0c40d5 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:26.963016 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3593fe38-9e6d-441e-acc4-60ff1b80f4e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:26.964275 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3593fe38-9e6d-441e-acc4-60ff1b80f4e7 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:26.964275 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3593fe38-9e6d-441e-acc4-60ff1b80f4e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:26.964616 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3593fe38-9e6d-441e-acc4-60ff1b80f4e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:26.965454 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3593fe38-9e6d-441e-acc4-60ff1b80f4e7 None admin] RBAC: Adding query filter params (role.id=89ca30cbbb634be8a96e9921aa56626b, scope.project.id=5a0951c053754bea9df8fb8448e1b42f, user.id=f678c8c3c6754b9a81efff6e9db8f623) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:10:26.969807 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3593fe38-9e6d-441e-acc4-60ff1b80f4e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:26.969807 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3593fe38-9e6d-441e-acc4-60ff1b80f4e7 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:26.984431 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 82/163] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Aug 9 10:10:26 2022] GET /identity/v3/role_assignments?user.id=f678c8c3c6754b9a81efff6e9db8f623&scope.project.id=5a0951c053754bea9df8fb8448e1b42f&role.id=89ca30cbbb634be8a96e9921aa56626b => generated 608 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:10:26.985640 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49d5567-5f0e-4816-920e-46254a4f4887 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:26.986059 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49d5567-5f0e-4816-920e-46254a4f4887 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:26.986450 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49d5567-5f0e-4816-920e-46254a4f4887 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:26.988031 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 83/164] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:10:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:10:26.993346 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3007184-3f31-481e-942c-13cb1ba22f28 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:26.993744 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3007184-3f31-481e-942c-13cb1ba22f28 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:26.994140 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3007184-3f31-481e-942c-13cb1ba22f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:27.030892 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-a3007184-3f31-481e-942c-13cb1ba22f28 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:10:27.032360 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-a3007184-3f31-481e-942c-13cb1ba22f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:10:27.063329 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:27.096967 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c629a5-7184-45c8-9172-457e6d0c40d5 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:27.134312 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99168af9-8a7d-4cf4-b263-c091492667c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:27.135169 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99168af9-8a7d-4cf4-b263-c091492667c3 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:27.135696 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99168af9-8a7d-4cf4-b263-c091492667c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:27.136099 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99168af9-8a7d-4cf4-b263-c091492667c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:27.137095 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99168af9-8a7d-4cf4-b263-c091492667c3 None admin] RBAC: Adding query filter params (role.id=a9895331e9694fa8b2b50908bb057bcb, scope.project.id=5a0951c053754bea9df8fb8448e1b42f, user.id=bdb286c28efa42b5a3fd021d0345a5a5) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:10:27.137535 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99168af9-8a7d-4cf4-b263-c091492667c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:27.139707 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99168af9-8a7d-4cf4-b263-c091492667c3 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:27.146350 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 82/165] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Aug 9 10:10:26 2022] GET /identity/v3/role_assignments?user.id=bdb286c28efa42b5a3fd021d0345a5a5&scope.project.id=5a0951c053754bea9df8fb8448e1b42f&role.id=a9895331e9694fa8b2b50908bb057bcb => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:10:27.147989 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7739f-99ea-4d4f-b160-b87f3b1da73c None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:27.148472 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7739f-99ea-4d4f-b160-b87f3b1da73c None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:27.149023 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7739f-99ea-4d4f-b160-b87f3b1da73c None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:27.150650 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 83/166] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:10:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:10:27.163781 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb0c45-ed44-42dd-a147-0dc4347e7662 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:27.164513 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb0c45-ed44-42dd-a147-0dc4347e7662 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:27.165229 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb0c45-ed44-42dd-a147-0dc4347e7662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:27.177285 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 84/167] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:10:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 10:10:27.195121 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-a9bb0c45-ed44-42dd-a147-0dc4347e7662 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:10:27.196650 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-a9bb0c45-ed44-42dd-a147-0dc4347e7662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:10:27.230950 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3007184-3f31-481e-942c-13cb1ba22f28 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:27.269459 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:27.302366 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 84/168] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:10:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 10:10:27.363051 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb0c45-ed44-42dd-a147-0dc4347e7662 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:27.473059 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:27.480550 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3007184-3f31-481e-942c-13cb1ba22f28 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:27.516062 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb0c45-ed44-42dd-a147-0dc4347e7662 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:27.558692 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a247bed-0b93-49d3-9872-0fdf3f0a11e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:27.560500 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a247bed-0b93-49d3-9872-0fdf3f0a11e2 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:27.561173 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a247bed-0b93-49d3-9872-0fdf3f0a11e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:27.561665 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a247bed-0b93-49d3-9872-0fdf3f0a11e2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:27.564909 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8554331d-31c5-43b7-b356-86b86498159f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:27.565652 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8554331d-31c5-43b7-b356-86b86498159f None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:27.565955 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8554331d-31c5-43b7-b356-86b86498159f None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:27.566235 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8554331d-31c5-43b7-b356-86b86498159f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:27.576454 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a247bed-0b93-49d3-9872-0fdf3f0a11e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 10:10:27.581881 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-4a247bed-0b93-49d3-9872-0fdf3f0a11e2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 10:10:27.581881 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:10:27.581881 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:10:27.581881 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:10:27.581881 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:10:27.581881 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:10:27.581881 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:10:27.581881 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:10:27.581881 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:10:27.581881 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:10:27.581881 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:10:27.581881 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:10:27.581881 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 10:10:27.581881 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 10:10:27.581881 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 10:10:27.581881 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 10:10:27.582817 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 10:10:27.582817 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 10:10:27.582817 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 10:10:27.582817 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 10:10:27.582817 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:10:27.582817 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:10:27.582817 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:10:27.582817 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:10:27.582817 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:10:27.582817 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:10:27.582817 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:10:27.582817 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:10:27.582817 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:10:27.582817 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:10:27.582817 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:10:27.582817 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:10:27.583668 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:10:27.583668 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:10:27.583668 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:10:27.583668 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:10:27.583668 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 10:10:27.583668 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 10:10:27.583668 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 10:10:27.583668 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 10:10:27.583668 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 10:10:27.583668 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 10:10:27.583668 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 10:10:27.583668 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:10:27.585889 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 85/169] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Aug 9 10:10:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 10:10:27.594459 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a247bed-0b93-49d3-9872-0fdf3f0a11e2 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:27.598856 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8554331d-31c5-43b7-b356-86b86498159f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 10:10:27.603857 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-8554331d-31c5-43b7-b356-86b86498159f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 10:10:27.603857 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:10:27.603857 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:10:27.603857 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:10:27.603857 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:10:27.603857 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:10:27.603857 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:10:27.603857 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:10:27.603857 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:10:27.603857 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:10:27.603857 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:10:27.603857 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:10:27.603857 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 10:10:27.603857 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 10:10:27.603857 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 10:10:27.603857 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 10:10:27.604921 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 10:10:27.604921 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 10:10:27.604921 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 10:10:27.604921 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 10:10:27.604921 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:10:27.604921 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:10:27.604921 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:10:27.604921 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:10:27.604921 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:10:27.604921 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:10:27.604921 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:10:27.604921 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:10:27.604921 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:10:27.604921 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:10:27.604921 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:10:27.604921 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:10:27.606007 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:10:27.606007 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:10:27.606007 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:10:27.606007 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:10:27.606007 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 10:10:27.606007 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 10:10:27.606007 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 10:10:27.606007 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 10:10:27.606007 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 10:10:27.606007 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 10:10:27.606007 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 10:10:27.606007 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:10:27.606007 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 85/170] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Aug 9 10:10:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 375 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:10:27.610846 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8554331d-31c5-43b7-b356-86b86498159f None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:27.736785 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a247bed-0b93-49d3-9872-0fdf3f0a11e2 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:27.785433 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:27.803860 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:27.824088 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9382d2af-387f-499c-b63e-f3b6e389c81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:27.824701 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382d2af-387f-499c-b63e-f3b6e389c81a None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:27.824978 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382d2af-387f-499c-b63e-f3b6e389c81a None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:27.825323 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382d2af-387f-499c-b63e-f3b6e389c81a None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:27.826125 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9382d2af-387f-499c-b63e-f3b6e389c81a None admin] RBAC: Adding query filter params (name=member) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:10:27.826435 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9382d2af-387f-499c-b63e-f3b6e389c81a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:27.827822 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9382d2af-387f-499c-b63e-f3b6e389c81a None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:27.847987 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8554331d-31c5-43b7-b356-86b86498159f None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:27.849585 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 86/171] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Aug 9 10:10:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:27.874195 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9382d2af-387f-499c-b63e-f3b6e389c81a None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:27.906748 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9855030f-12df-4e04-8cd5-c698ace56b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:27.907357 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9855030f-12df-4e04-8cd5-c698ace56b53 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:27.907633 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9855030f-12df-4e04-8cd5-c698ace56b53 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:27.908153 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9855030f-12df-4e04-8cd5-c698ace56b53 None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:27.908568 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9855030f-12df-4e04-8cd5-c698ace56b53 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:10:27.908870 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9855030f-12df-4e04-8cd5-c698ace56b53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:27.910331 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9855030f-12df-4e04-8cd5-c698ace56b53 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:27.926250 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 86/172] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Aug 9 10:10:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:10:27.927483 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6838843d-e95e-4597-ac22-6ba883652609 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:27.927768 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6838843d-e95e-4597-ac22-6ba883652609 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:27.928042 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6838843d-e95e-4597-ac22-6ba883652609 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:27.929374 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 87/173] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:10:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:10:27.931636 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6838843d-e95e-4597-ac22-6ba883652609 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:28.046136 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9382d2af-387f-499c-b63e-f3b6e389c81a None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:28.117477 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167bf7fa-fc30-4896-b68d-042f35dca7a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:28.118138 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167bf7fa-fc30-4896-b68d-042f35dca7a2 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:28.118417 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167bf7fa-fc30-4896-b68d-042f35dca7a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:28.118690 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167bf7fa-fc30-4896-b68d-042f35dca7a2 None admin] PATH_INFO: `/v3/users/bdb286c28efa42b5a3fd021d0345a5a5` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:28.120520 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167bf7fa-fc30-4896-b68d-042f35dca7a2 None admin] RBAC: Authorizing `identity:get_user(user_id=bdb286c28efa42b5a3fd021d0345a5a5)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:28.122063 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167bf7fa-fc30-4896-b68d-042f35dca7a2 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:28.123765 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 87/174] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Aug 9 10:10:27 2022] GET /identity/v3/users/bdb286c28efa42b5a3fd021d0345a5a5 => generated 275 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:28.124874 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fcf4cb-0cec-4dd9-84b0-973acf25f0a0 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:28.125150 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fcf4cb-0cec-4dd9-84b0-973acf25f0a0 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:28.125422 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fcf4cb-0cec-4dd9-84b0-973acf25f0a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:28.133715 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6838843d-e95e-4597-ac22-6ba883652609 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:28.148998 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-17fcf4cb-0cec-4dd9-84b0-973acf25f0a0 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:10:28.150519 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-17fcf4cb-0cec-4dd9-84b0-973acf25f0a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:10:28.170981 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c18c15-7e22-4c24-a89e-88449d4da204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:28.171611 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c18c15-7e22-4c24-a89e-88449d4da204 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:28.171931 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c18c15-7e22-4c24-a89e-88449d4da204 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:28.172209 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c18c15-7e22-4c24-a89e-88449d4da204 None admin] PATH_INFO: `/v3/users/bdb286c28efa42b5a3fd021d0345a5a5` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:28.173346 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c18c15-7e22-4c24-a89e-88449d4da204 None admin] RBAC: Authorizing `identity:get_user(user_id=bdb286c28efa42b5a3fd021d0345a5a5)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:28.174887 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c18c15-7e22-4c24-a89e-88449d4da204 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:28.176658 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 88/175] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Aug 9 10:10:27 2022] GET /identity/v3/users/bdb286c28efa42b5a3fd021d0345a5a5 => generated 275 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:10:28.177357 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c18c15-7e22-4c24-a89e-88449d4da204 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:28.181026 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:28.225315 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 88/176] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:10:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 10:10:28.227431 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f84c690-47f2-4777-a1b9-edeb2df9acd8 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:28.227934 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f84c690-47f2-4777-a1b9-edeb2df9acd8 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:28.228411 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f84c690-47f2-4777-a1b9-edeb2df9acd8 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:28.230276 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:28.230537 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 89/177] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:10:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:10:28.231713 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f84c690-47f2-4777-a1b9-edeb2df9acd8 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:28.283009 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c18c15-7e22-4c24-a89e-88449d4da204 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:28.318550 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2863e2-ee4c-4846-abd4-29b3fd6efff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:28.319198 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2863e2-ee4c-4846-abd4-29b3fd6efff8 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:28.319388 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2863e2-ee4c-4846-abd4-29b3fd6efff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:28.319608 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2863e2-ee4c-4846-abd4-29b3fd6efff8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:28.343518 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f84c690-47f2-4777-a1b9-edeb2df9acd8 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:28.388941 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f2dd6b-db50-406d-93c4-48cbdfdbc98b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:28.390219 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f2dd6b-db50-406d-93c4-48cbdfdbc98b None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:28.390344 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f2dd6b-db50-406d-93c4-48cbdfdbc98b None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:28.390606 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f2dd6b-db50-406d-93c4-48cbdfdbc98b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:28.393350 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2863e2-ee4c-4846-abd4-29b3fd6efff8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:28.394855 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2863e2-ee4c-4846-abd4-29b3fd6efff8 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:28.398190 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:28.478313 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f2dd6b-db50-406d-93c4-48cbdfdbc98b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:28.481174 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f2dd6b-db50-406d-93c4-48cbdfdbc98b None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:28.498589 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 89/178] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Aug 9 10:10:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 10:10:28.499894 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97c3c5b-54bb-4472-8353-e743a600ffa0 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:28.500180 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97c3c5b-54bb-4472-8353-e743a600ffa0 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:28.500454 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97c3c5b-54bb-4472-8353-e743a600ffa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:28.502218 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:28.519018 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-c97c3c5b-54bb-4472-8353-e743a600ffa0 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:10:28.520191 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-c97c3c5b-54bb-4472-8353-e743a600ffa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:10:28.600254 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 90/179] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:10:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 10:10:28.601816 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97c3c5b-54bb-4472-8353-e743a600ffa0 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:28.603474 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 90/180] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Aug 9 10:10:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 10:10:28.604309 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f2dd6b-db50-406d-93c4-48cbdfdbc98b None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:28.642712 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:28.705895 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:28.726550 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f2dd6b-db50-406d-93c4-48cbdfdbc98b None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:28.730271 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97c3c5b-54bb-4472-8353-e743a600ffa0 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:28.764690 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b38443-1917-41ef-9dba-2e5a07742644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:28.765316 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b38443-1917-41ef-9dba-2e5a07742644 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:28.765617 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b38443-1917-41ef-9dba-2e5a07742644 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:28.765864 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b38443-1917-41ef-9dba-2e5a07742644 None admin] PATH_INFO: `/v3/projects/56c4c1e033cf498ba7ef51b8c87f75f3` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:28.767011 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b38443-1917-41ef-9dba-2e5a07742644 None admin] RBAC: Authorizing `identity:get_project(project_id=56c4c1e033cf498ba7ef51b8c87f75f3)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:28.768555 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b38443-1917-41ef-9dba-2e5a07742644 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:28.775296 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 91/181] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Aug 9 10:10:28 2022] GET /identity/v3/projects/56c4c1e033cf498ba7ef51b8c87f75f3 => generated 312 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:28.775296 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b38443-1917-41ef-9dba-2e5a07742644 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:28.775880 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f48412-21dc-41b2-892f-00c4a31d1035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:28.776509 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f48412-21dc-41b2-892f-00c4a31d1035 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:28.776784 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f48412-21dc-41b2-892f-00c4a31d1035 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:28.777056 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f48412-21dc-41b2-892f-00c4a31d1035 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:28.788557 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f48412-21dc-41b2-892f-00c4a31d1035 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 10:10:28.793506 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-22f48412-21dc-41b2-892f-00c4a31d1035 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 10:10:28.793506 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:10:28.793506 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:10:28.793506 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:10:28.793506 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:10:28.793506 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:10:28.793506 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:10:28.793506 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:10:28.793506 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:10:28.793506 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:10:28.793506 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:10:28.793506 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:10:28.793506 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 10:10:28.793506 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 10:10:28.793506 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 10:10:28.793506 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 10:10:28.795679 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 10:10:28.795679 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 10:10:28.795679 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 10:10:28.795679 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 10:10:28.795679 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:10:28.795679 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:10:28.795679 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:10:28.795679 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:10:28.795679 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:10:28.795679 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:10:28.795679 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:10:28.795679 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:10:28.795679 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:10:28.795679 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:10:28.795679 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:10:28.795679 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:10:28.796479 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:10:28.796479 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:10:28.796479 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:10:28.796479 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:10:28.796479 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 10:10:28.796479 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 10:10:28.796479 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 10:10:28.796479 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 10:10:28.796479 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 10:10:28.796479 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 10:10:28.796479 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 10:10:28.796479 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:10:28.796479 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 91/182] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Aug 9 10:10:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:10:28.796479 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f48412-21dc-41b2-892f-00c4a31d1035 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:28.880756 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b38443-1917-41ef-9dba-2e5a07742644 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:28.905137 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:28.913276 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f48412-21dc-41b2-892f-00c4a31d1035 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:28.915362 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f87ecd-31b8-495d-ab28-cbbf35aacd39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:28.915996 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f87ecd-31b8-495d-ab28-cbbf35aacd39 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:28.916272 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f87ecd-31b8-495d-ab28-cbbf35aacd39 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:28.916552 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f87ecd-31b8-495d-ab28-cbbf35aacd39 None admin] PATH_INFO: `/v3/projects/5a0951c053754bea9df8fb8448e1b42f` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:28.917645 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f87ecd-31b8-495d-ab28-cbbf35aacd39 None admin] RBAC: Authorizing `identity:get_project(project_id=5a0951c053754bea9df8fb8448e1b42f)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:28.919185 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f87ecd-31b8-495d-ab28-cbbf35aacd39 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:28.920810 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 92/183] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Aug 9 10:10:28 2022] GET /identity/v3/projects/5a0951c053754bea9df8fb8448e1b42f => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:28.922161 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84203401-1f6f-47d0-9a49-0e19107f3f64 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:28.922443 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84203401-1f6f-47d0-9a49-0e19107f3f64 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:28.922710 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84203401-1f6f-47d0-9a49-0e19107f3f64 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:28.924006 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 93/184] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:10:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:10:28.924624 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84203401-1f6f-47d0-9a49-0e19107f3f64 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:28.953603 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:28.957233 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cd6ff4-67be-4fe0-b843-e140d0497da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:28.958049 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd6ff4-67be-4fe0-b843-e140d0497da9 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:28.958368 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd6ff4-67be-4fe0-b843-e140d0497da9 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:28.958734 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd6ff4-67be-4fe0-b843-e140d0497da9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:28.972070 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cd6ff4-67be-4fe0-b843-e140d0497da9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 10:10:28.978467 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-00cd6ff4-67be-4fe0-b843-e140d0497da9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 10:10:28.978467 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:10:28.978467 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:10:28.978467 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:10:28.978467 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:10:28.978467 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:10:28.978467 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:10:28.978467 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:10:28.978467 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:10:28.978467 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:10:28.978467 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:10:28.978467 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:10:28.978467 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 10:10:28.978467 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 10:10:28.978467 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 10:10:28.978467 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 10:10:28.979331 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 10:10:28.979331 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 10:10:28.979331 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 10:10:28.979331 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 10:10:28.979331 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:10:28.979331 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:10:28.979331 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:10:28.979331 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:10:28.979331 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:10:28.979331 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:10:28.979331 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:10:28.979331 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:10:28.979331 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:10:28.979331 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:10:28.979331 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:10:28.979331 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:10:28.985340 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:10:28.985340 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:10:28.985340 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:10:28.985340 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:10:28.985340 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 10:10:28.985340 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 10:10:28.985340 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 10:10:28.985340 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 10:10:28.985340 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 10:10:28.985340 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 10:10:28.985340 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 10:10:28.985340 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:10:28.985340 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 92/185] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Aug 9 10:10:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:10:28.985340 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cd6ff4-67be-4fe0-b843-e140d0497da9 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:29.047284 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84203401-1f6f-47d0-9a49-0e19107f3f64 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:29.082115 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df684d78-8bbe-40c5-b960-09af94edd8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:29.082718 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df684d78-8bbe-40c5-b960-09af94edd8ce None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:29.082996 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df684d78-8bbe-40c5-b960-09af94edd8ce None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:29.083265 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df684d78-8bbe-40c5-b960-09af94edd8ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:29.083979 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df684d78-8bbe-40c5-b960-09af94edd8ce None admin] RBAC: Adding query filter params (role.id=a9895331e9694fa8b2b50908bb057bcb, scope.project.id=56c4c1e033cf498ba7ef51b8c87f75f3, user.id=bdb286c28efa42b5a3fd021d0345a5a5) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:10:29.084287 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df684d78-8bbe-40c5-b960-09af94edd8ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:29.085760 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df684d78-8bbe-40c5-b960-09af94edd8ce None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:29.091797 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 94/186] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Aug 9 10:10:28 2022] GET /identity/v3/role_assignments?user.id=bdb286c28efa42b5a3fd021d0345a5a5&scope.project.id=56c4c1e033cf498ba7ef51b8c87f75f3&role.id=a9895331e9694fa8b2b50908bb057bcb => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:29.098085 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df684d78-8bbe-40c5-b960-09af94edd8ce None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:29.098205 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cd6ff4-67be-4fe0-b843-e140d0497da9 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:29.148437 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c910bbf-00df-48b3-8e9e-14bf61baabaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:29.148967 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c910bbf-00df-48b3-8e9e-14bf61baabaf None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:29.149249 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c910bbf-00df-48b3-8e9e-14bf61baabaf None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:29.149525 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c910bbf-00df-48b3-8e9e-14bf61baabaf None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:29.150466 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c910bbf-00df-48b3-8e9e-14bf61baabaf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:10:29.151716 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c910bbf-00df-48b3-8e9e-14bf61baabaf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:29.153203 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c910bbf-00df-48b3-8e9e-14bf61baabaf None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:29.164785 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 93/187] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Aug 9 10:10:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:29.166630 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062da3d-8d4a-48fc-a0aa-473e94392066 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:29.167082 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062da3d-8d4a-48fc-a0aa-473e94392066 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:29.167512 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062da3d-8d4a-48fc-a0aa-473e94392066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:29.192594 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-3062da3d-8d4a-48fc-a0aa-473e94392066 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:10:29.194110 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-3062da3d-8d4a-48fc-a0aa-473e94392066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:10:29.209616 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:29.221567 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:29.242840 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df684d78-8bbe-40c5-b960-09af94edd8ce None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:29.287261 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 94/188] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:10:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 10:10:29.288354 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3062da3d-8d4a-48fc-a0aa-473e94392066 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:29.289147 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b6fe52-39fc-49cc-b1e5-62fe8c90953a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:29.289745 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b6fe52-39fc-49cc-b1e5-62fe8c90953a None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:29.290308 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b6fe52-39fc-49cc-b1e5-62fe8c90953a None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:29.290577 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b6fe52-39fc-49cc-b1e5-62fe8c90953a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:29.291291 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b6fe52-39fc-49cc-b1e5-62fe8c90953a None admin] RBAC: Adding query filter params (role.id=af19908af5d6489696eb27791925a5aa, scope.project.id=5a0951c053754bea9df8fb8448e1b42f, user.id=bdb286c28efa42b5a3fd021d0345a5a5) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:10:29.291599 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b6fe52-39fc-49cc-b1e5-62fe8c90953a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:29.293019 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b6fe52-39fc-49cc-b1e5-62fe8c90953a None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:29.300743 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 95/189] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Aug 9 10:10:29 2022] GET /identity/v3/role_assignments?user.id=bdb286c28efa42b5a3fd021d0345a5a5&scope.project.id=5a0951c053754bea9df8fb8448e1b42f&role.id=af19908af5d6489696eb27791925a5aa => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:29.301437 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b6fe52-39fc-49cc-b1e5-62fe8c90953a None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:29.429819 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b6fe52-39fc-49cc-b1e5-62fe8c90953a None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:29.435043 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3062da3d-8d4a-48fc-a0aa-473e94392066 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:29.467773 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e78bb-d82a-4418-9ec2-8c19d7605aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:29.468557 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e78bb-d82a-4418-9ec2-8c19d7605aee None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:29.468822 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e78bb-d82a-4418-9ec2-8c19d7605aee None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:29.469649 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e78bb-d82a-4418-9ec2-8c19d7605aee None admin] PATH_INFO: `/v3/users/3fcb59cb02c043d5963d092efc198d4a` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:29.475874 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f2e86-a014-4daf-8634-dae4d78f51fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:29.475874 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f2e86-a014-4daf-8634-dae4d78f51fe None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:29.476082 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f2e86-a014-4daf-8634-dae4d78f51fe None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:29.476294 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f2e86-a014-4daf-8634-dae4d78f51fe None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:29.476959 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441f2e86-a014-4daf-8634-dae4d78f51fe None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:10:29.477262 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441f2e86-a014-4daf-8634-dae4d78f51fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:29.478725 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441f2e86-a014-4daf-8634-dae4d78f51fe None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:29.488064 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777e78bb-d82a-4418-9ec2-8c19d7605aee None admin] RBAC: Authorizing `identity:get_user(user_id=3fcb59cb02c043d5963d092efc198d4a)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:29.489179 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777e78bb-d82a-4418-9ec2-8c19d7605aee None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:29.489891 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 95/190] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Aug 9 10:10:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:29.490849 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f6a58-de58-49ae-ac2c-f0ce0232dbe1 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:29.491340 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 96/191] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Aug 9 10:10:29 2022] GET /identity/v3/users/3fcb59cb02c043d5963d092efc198d4a => generated 283 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:29.491483 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f6a58-de58-49ae-ac2c-f0ce0232dbe1 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:29.491483 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f6a58-de58-49ae-ac2c-f0ce0232dbe1 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:29.492591 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 96/192] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:10:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:10:29.494783 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e78bb-d82a-4418-9ec2-8c19d7605aee None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:29.497886 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194f6a58-de58-49ae-ac2c-f0ce0232dbe1 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:29.508114 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:29.513786 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:29.608192 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e78bb-d82a-4418-9ec2-8c19d7605aee None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:29.619957 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194f6a58-de58-49ae-ac2c-f0ce0232dbe1 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:29.641493 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00483ad-12d2-49ee-b553-efd9a4d978da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:29.642150 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00483ad-12d2-49ee-b553-efd9a4d978da None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:29.642428 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00483ad-12d2-49ee-b553-efd9a4d978da None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:29.642700 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00483ad-12d2-49ee-b553-efd9a4d978da None admin] PATH_INFO: `/v3/domains/default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:29.643801 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00483ad-12d2-49ee-b553-efd9a4d978da None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:29.645235 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00483ad-12d2-49ee-b553-efd9a4d978da None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:29.646834 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 97/193] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:10:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:29.647926 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac03faac-4870-45b7-9029-a59b2822746b None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:29.648206 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac03faac-4870-45b7-9029-a59b2822746b None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:29.648476 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac03faac-4870-45b7-9029-a59b2822746b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:29.657072 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c269ad5a-882c-47bc-912f-d5ffe337e347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:29.657668 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c269ad5a-882c-47bc-912f-d5ffe337e347 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:29.657973 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c269ad5a-882c-47bc-912f-d5ffe337e347 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:29.658244 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c269ad5a-882c-47bc-912f-d5ffe337e347 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:29.666412 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-ac03faac-4870-45b7-9029-a59b2822746b None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:10:29.667596 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-ac03faac-4870-45b7-9029-a59b2822746b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:10:29.727283 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c269ad5a-882c-47bc-912f-d5ffe337e347 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:29.728662 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c269ad5a-882c-47bc-912f-d5ffe337e347 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:29.735474 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 98/194] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:10:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 10:10:29.745796 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac03faac-4870-45b7-9029-a59b2822746b None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:29.746231 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:29.753740 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:29.827557 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 97/195] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Aug 9 10:10:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 10:10:29.831026 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c269ad5a-882c-47bc-912f-d5ffe337e347 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:29.846896 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac03faac-4870-45b7-9029-a59b2822746b None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:29.880572 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c09209e-796d-4fa4-a880-6aaaf0463c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:29.881191 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c09209e-796d-4fa4-a880-6aaaf0463c04 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:29.881461 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c09209e-796d-4fa4-a880-6aaaf0463c04 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:29.881726 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c09209e-796d-4fa4-a880-6aaaf0463c04 None admin] PATH_INFO: `/v3/users/3fcb59cb02c043d5963d092efc198d4a` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:29.882857 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c09209e-796d-4fa4-a880-6aaaf0463c04 None admin] RBAC: Authorizing `identity:get_user(user_id=3fcb59cb02c043d5963d092efc198d4a)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:29.884273 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c09209e-796d-4fa4-a880-6aaaf0463c04 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:29.885836 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 99/196] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Aug 9 10:10:29 2022] GET /identity/v3/users/3fcb59cb02c043d5963d092efc198d4a => generated 283 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:29.885836 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c09209e-796d-4fa4-a880-6aaaf0463c04 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:29.938251 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c269ad5a-882c-47bc-912f-d5ffe337e347 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:29.947458 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:29.966212 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:29.975554 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f936df-aae7-42b8-82cc-88892aa18353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:29.976156 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f936df-aae7-42b8-82cc-88892aa18353 None admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:29.976432 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f936df-aae7-42b8-82cc-88892aa18353 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:29.976699 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f936df-aae7-42b8-82cc-88892aa18353 None admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:29.977380 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f936df-aae7-42b8-82cc-88892aa18353 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:29.978789 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f936df-aae7-42b8-82cc-88892aa18353 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:29.993116 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c09209e-796d-4fa4-a880-6aaaf0463c04 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:29.999416 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 98/197] 10.222.0.36 () {60 vars in 1132 bytes} [Tue Aug 9 10:10:29 2022] POST /identity/v3/users => generated 297 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:10:30.000226 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f936df-aae7-42b8-82cc-88892aa18353 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:30.042250 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3104f8-7bf1-4d22-92cc-169565318654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:30.042899 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3104f8-7bf1-4d22-92cc-169565318654 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:30.043181 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3104f8-7bf1-4d22-92cc-169565318654 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:30.043453 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3104f8-7bf1-4d22-92cc-169565318654 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:30.057469 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3104f8-7bf1-4d22-92cc-169565318654 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 10:10:30.063194 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-1a3104f8-7bf1-4d22-92cc-169565318654 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 10:10:30.063194 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:10:30.063194 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:10:30.063194 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:10:30.063194 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:10:30.063194 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:10:30.063194 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:10:30.063194 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:10:30.063194 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:10:30.063194 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:10:30.063194 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:10:30.063194 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:10:30.063194 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 10:10:30.063194 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 10:10:30.063194 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 10:10:30.063194 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 10:10:30.064130 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 10:10:30.064130 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 10:10:30.064130 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 10:10:30.064130 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 10:10:30.064130 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:10:30.064130 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:10:30.064130 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:10:30.064130 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:10:30.064130 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:10:30.064130 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:10:30.064130 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:10:30.064130 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:10:30.064130 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:10:30.064130 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:10:30.064130 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:10:30.064130 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:10:30.064918 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:10:30.064918 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:10:30.064918 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:10:30.064918 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:10:30.064918 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 10:10:30.064918 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 10:10:30.064918 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 10:10:30.064918 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 10:10:30.064918 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 10:10:30.064918 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 10:10:30.064918 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 10:10:30.064918 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:10:30.064918 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 100/198] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Aug 9 10:10:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:10:30.065600 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3104f8-7bf1-4d22-92cc-169565318654 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:30.117519 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f936df-aae7-42b8-82cc-88892aa18353 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:30.156295 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7247d88a-7012-4d5b-ba43-a6cd908d7067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:30.156940 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247d88a-7012-4d5b-ba43-a6cd908d7067 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:30.157221 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247d88a-7012-4d5b-ba43-a6cd908d7067 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:30.157918 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247d88a-7012-4d5b-ba43-a6cd908d7067 None admin] PATH_INFO: `/v3/projects/a0b7ec3eb0324b10934f50e12805a4e4` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:30.158679 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7247d88a-7012-4d5b-ba43-a6cd908d7067 None admin] RBAC: Authorizing `identity:get_project(project_id=a0b7ec3eb0324b10934f50e12805a4e4)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:30.160143 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7247d88a-7012-4d5b-ba43-a6cd908d7067 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:30.161961 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 99/199] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Aug 9 10:10:29 2022] GET /identity/v3/projects/a0b7ec3eb0324b10934f50e12805a4e4 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:30.162583 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7247d88a-7012-4d5b-ba43-a6cd908d7067 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:30.200273 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:30.202206 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3104f8-7bf1-4d22-92cc-169565318654 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:30.248804 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63923cd-da0e-4ec4-a42c-e4aec8f53bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:30.249921 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63923cd-da0e-4ec4-a42c-e4aec8f53bf2 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:30.250363 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63923cd-da0e-4ec4-a42c-e4aec8f53bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:30.250817 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63923cd-da0e-4ec4-a42c-e4aec8f53bf2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:30.254914 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:30.287784 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7247d88a-7012-4d5b-ba43-a6cd908d7067 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:30.328847 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafe9e21-31de-42fa-9acc-15de5a8c0490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:30.329457 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe9e21-31de-42fa-9acc-15de5a8c0490 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:30.329730 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe9e21-31de-42fa-9acc-15de5a8c0490 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:30.330031 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe9e21-31de-42fa-9acc-15de5a8c0490 None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:30.330700 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafe9e21-31de-42fa-9acc-15de5a8c0490 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:10:30.331056 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafe9e21-31de-42fa-9acc-15de5a8c0490 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:30.332431 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafe9e21-31de-42fa-9acc-15de5a8c0490 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:30.340913 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 100/200] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Aug 9 10:10:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:30.342060 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafe9e21-31de-42fa-9acc-15de5a8c0490 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:30.342856 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63923cd-da0e-4ec4-a42c-e4aec8f53bf2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:30.345714 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63923cd-da0e-4ec4-a42c-e4aec8f53bf2 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:30.458120 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 101/201] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Aug 9 10:10:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 10:10:30.458983 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63923cd-da0e-4ec4-a42c-e4aec8f53bf2 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:30.469646 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:30.480034 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafe9e21-31de-42fa-9acc-15de5a8c0490 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:30.497885 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:30.525208 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b01875c-617a-44e3-8765-92732c1657bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:30.525724 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b01875c-617a-44e3-8765-92732c1657bb None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:30.526132 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b01875c-617a-44e3-8765-92732c1657bb None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:30.526589 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b01875c-617a-44e3-8765-92732c1657bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:30.527489 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b01875c-617a-44e3-8765-92732c1657bb None admin] RBAC: Adding query filter params (role.id=89ca30cbbb634be8a96e9921aa56626b, scope.project.id=a0b7ec3eb0324b10934f50e12805a4e4, user.id=3fcb59cb02c043d5963d092efc198d4a) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:10:30.527923 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b01875c-617a-44e3-8765-92732c1657bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:30.529662 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b01875c-617a-44e3-8765-92732c1657bb None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:30.535649 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 101/202] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Aug 9 10:10:30 2022] GET /identity/v3/role_assignments?user.id=3fcb59cb02c043d5963d092efc198d4a&scope.project.id=a0b7ec3eb0324b10934f50e12805a4e4&role.id=89ca30cbbb634be8a96e9921aa56626b => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:30.536525 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b01875c-617a-44e3-8765-92732c1657bb None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:30.587681 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63923cd-da0e-4ec4-a42c-e4aec8f53bf2 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:30.644569 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7641da8b-e786-4373-aaca-926aeb815f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:30.645446 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7641da8b-e786-4373-aaca-926aeb815f29 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:30.645730 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7641da8b-e786-4373-aaca-926aeb815f29 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:30.646041 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7641da8b-e786-4373-aaca-926aeb815f29 None admin] PATH_INFO: `/v3/users/6c56fcc8dda046b6b958632ec4f5de24` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:30.647861 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7641da8b-e786-4373-aaca-926aeb815f29 None admin] RBAC: Authorizing `identity:get_user(user_id=6c56fcc8dda046b6b958632ec4f5de24)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:30.649970 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7641da8b-e786-4373-aaca-926aeb815f29 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:30.652817 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 102/203] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Aug 9 10:10:30 2022] GET /identity/v3/users/6c56fcc8dda046b6b958632ec4f5de24 => generated 289 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:30.658817 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7641da8b-e786-4373-aaca-926aeb815f29 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:30.659894 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b01875c-617a-44e3-8765-92732c1657bb None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:30.734030 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f14facf-0c7d-4170-891c-1b51ba49a527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:30.734707 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f14facf-0c7d-4170-891c-1b51ba49a527 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:30.734988 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f14facf-0c7d-4170-891c-1b51ba49a527 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:30.735262 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f14facf-0c7d-4170-891c-1b51ba49a527 None admin] PATH_INFO: `/v3/projects/a0b7ec3eb0324b10934f50e12805a4e4` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:30.737506 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f14facf-0c7d-4170-891c-1b51ba49a527 None admin] RBAC: Authorizing `identity:get_project(project_id=a0b7ec3eb0324b10934f50e12805a4e4)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:30.739105 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f14facf-0c7d-4170-891c-1b51ba49a527 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:30.741083 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 102/204] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Aug 9 10:10:30 2022] GET /identity/v3/projects/a0b7ec3eb0324b10934f50e12805a4e4 => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:30.751214 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f14facf-0c7d-4170-891c-1b51ba49a527 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:30.816106 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7641da8b-e786-4373-aaca-926aeb815f29 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:30.817521 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:30.826963 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:30.859425 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f4da5c-5737-4f65-a1de-062ce5a33f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:30.860041 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f4da5c-5737-4f65-a1de-062ce5a33f05 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:30.860316 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f4da5c-5737-4f65-a1de-062ce5a33f05 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:30.860585 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f4da5c-5737-4f65-a1de-062ce5a33f05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:30.938653 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f4da5c-5737-4f65-a1de-062ce5a33f05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:30.940594 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f4da5c-5737-4f65-a1de-062ce5a33f05 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:31.016497 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f14facf-0c7d-4170-891c-1b51ba49a527 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:31.072343 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 103/205] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Aug 9 10:10:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 10:10:31.074986 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b38f563-3474-4263-ac73-299c79d32078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:31.076134 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b38f563-3474-4263-ac73-299c79d32078 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:31.076412 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b38f563-3474-4263-ac73-299c79d32078 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:31.076681 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b38f563-3474-4263-ac73-299c79d32078 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:31.077498 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b38f563-3474-4263-ac73-299c79d32078 None admin] RBAC: Adding query filter params (role.id=af19908af5d6489696eb27791925a5aa, scope.project.id=a0b7ec3eb0324b10934f50e12805a4e4, user.id=3fcb59cb02c043d5963d092efc198d4a) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:10:31.077809 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b38f563-3474-4263-ac73-299c79d32078 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:31.078697 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f4da5c-5737-4f65-a1de-062ce5a33f05 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:31.079266 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b38f563-3474-4263-ac73-299c79d32078 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:31.081691 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:31.087255 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 103/206] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Aug 9 10:10:30 2022] GET /identity/v3/role_assignments?user.id=3fcb59cb02c043d5963d092efc198d4a&scope.project.id=a0b7ec3eb0324b10934f50e12805a4e4&role.id=af19908af5d6489696eb27791925a5aa => generated 259 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:31.223649 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f4da5c-5737-4f65-a1de-062ce5a33f05 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:31.270579 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e39351-438c-474f-b0e2-b77fc34f9431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:31.271223 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e39351-438c-474f-b0e2-b77fc34f9431 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:31.271504 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e39351-438c-474f-b0e2-b77fc34f9431 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:31.271782 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e39351-438c-474f-b0e2-b77fc34f9431 None admin] PATH_INFO: `/v3/projects/5a0951c053754bea9df8fb8448e1b42f` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:31.272973 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e39351-438c-474f-b0e2-b77fc34f9431 None admin] RBAC: Authorizing `identity:get_project(project_id=5a0951c053754bea9df8fb8448e1b42f)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:31.274473 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e39351-438c-474f-b0e2-b77fc34f9431 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:31.276224 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 104/207] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Aug 9 10:10:31 2022] GET /identity/v3/projects/5a0951c053754bea9df8fb8448e1b42f => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:10:31.283591 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b38f563-3474-4263-ac73-299c79d32078 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:31.398395 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:31.410112 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b38f563-3474-4263-ac73-299c79d32078 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:31.459703 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176988d8-0c2d-462e-8a62-c804f10ff668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:31.460319 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176988d8-0c2d-462e-8a62-c804f10ff668 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:31.460600 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176988d8-0c2d-462e-8a62-c804f10ff668 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:31.460871 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176988d8-0c2d-462e-8a62-c804f10ff668 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:31.461611 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176988d8-0c2d-462e-8a62-c804f10ff668 None admin] RBAC: Adding query filter params (role.id=b2850f278b2d4b32b2b56324509a5a01, scope.project.id=5a0951c053754bea9df8fb8448e1b42f, user.id=6c56fcc8dda046b6b958632ec4f5de24) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:10:31.461951 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176988d8-0c2d-462e-8a62-c804f10ff668 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:31.463398 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176988d8-0c2d-462e-8a62-c804f10ff668 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:31.474916 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 104/208] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Aug 9 10:10:31 2022] GET /identity/v3/role_assignments?user.id=6c56fcc8dda046b6b958632ec4f5de24&scope.project.id=5a0951c053754bea9df8fb8448e1b42f&role.id=b2850f278b2d4b32b2b56324509a5a01 => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:32.406673 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f8e488-bfb1-4fde-8923-8fda6915b797 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:32.407189 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f8e488-bfb1-4fde-8923-8fda6915b797 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:32.407293 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f8e488-bfb1-4fde-8923-8fda6915b797 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:32.408710 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 105/209] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:10:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:10:32.414255 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cde40b-7433-41aa-8f32-b1f8369d64dc None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:32.415415 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cde40b-7433-41aa-8f32-b1f8369d64dc None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:32.415889 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cde40b-7433-41aa-8f32-b1f8369d64dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:32.435104 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-b3cde40b-7433-41aa-8f32-b1f8369d64dc None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:10:32.436659 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-b3cde40b-7433-41aa-8f32-b1f8369d64dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:10:32.507837 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 105/210] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:10:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 10:10:32.531805 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f8e488-bfb1-4fde-8923-8fda6915b797 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:32.561603 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7940013-7117-4399-b298-9543471740f6 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:32.562244 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7940013-7117-4399-b298-9543471740f6 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:32.563008 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7940013-7117-4399-b298-9543471740f6 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:32.565662 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 106/211] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:10:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:10:32.573157 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb417ee8-da58-4944-9cf5-0499a5df50b5 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:32.573678 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb417ee8-da58-4944-9cf5-0499a5df50b5 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:32.574163 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb417ee8-da58-4944-9cf5-0499a5df50b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:32.598936 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-eb417ee8-da58-4944-9cf5-0499a5df50b5 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:10:32.601077 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-eb417ee8-da58-4944-9cf5-0499a5df50b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:10:32.615328 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:32.657492 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f8e488-bfb1-4fde-8923-8fda6915b797 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:32.693380 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90aa480-6e4c-41b7-983e-2e358d390a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:32.694072 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90aa480-6e4c-41b7-983e-2e358d390a9b None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:32.694370 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90aa480-6e4c-41b7-983e-2e358d390a9b None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:32.694646 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90aa480-6e4c-41b7-983e-2e358d390a9b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:32.698339 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 107/212] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:10:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 10:10:32.706839 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90aa480-6e4c-41b7-983e-2e358d390a9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 10:10:32.711946 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-b90aa480-6e4c-41b7-983e-2e358d390a9b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 10:10:32.711946 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:10:32.711946 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:10:32.711946 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:10:32.711946 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:10:32.711946 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:10:32.711946 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:10:32.711946 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:10:32.711946 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:10:32.711946 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:10:32.711946 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:10:32.711946 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:10:32.711946 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 10:10:32.711946 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 10:10:32.711946 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 10:10:32.711946 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 10:10:32.712786 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 10:10:32.712786 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 10:10:32.712786 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 10:10:32.712786 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 10:10:32.712786 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:10:32.712786 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:10:32.712786 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:10:32.712786 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:10:32.712786 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:10:32.712786 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:10:32.712786 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:10:32.712786 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:10:32.712786 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:10:32.712786 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:10:32.712786 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:10:32.712786 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:10:32.713575 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:10:32.713575 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:10:32.713575 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:10:32.713575 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:10:32.713575 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 10:10:32.713575 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 10:10:32.713575 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 10:10:32.713575 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 10:10:32.713575 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 10:10:32.713575 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 10:10:32.713575 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 10:10:32.713575 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:10:32.715897 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 106/213] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Aug 9 10:10:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:10:32.722249 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb417ee8-da58-4944-9cf5-0499a5df50b5 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:32.727535 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90aa480-6e4c-41b7-983e-2e358d390a9b None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:32.742267 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:32.839629 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90aa480-6e4c-41b7-983e-2e358d390a9b None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:32.859990 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb417ee8-da58-4944-9cf5-0499a5df50b5 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:32.876473 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:32.883107 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99473be-f1f1-4088-afca-2c8a90848b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:32.883738 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99473be-f1f1-4088-afca-2c8a90848b53 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:32.884015 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99473be-f1f1-4088-afca-2c8a90848b53 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:32.884288 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99473be-f1f1-4088-afca-2c8a90848b53 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:32.885609 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99473be-f1f1-4088-afca-2c8a90848b53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:32.887078 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99473be-f1f1-4088-afca-2c8a90848b53 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:32.889646 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 107/214] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:10:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:32.890670 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce23f22f-372e-4778-9a16-5481acce81e2 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:32.890953 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce23f22f-372e-4778-9a16-5481acce81e2 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:32.891221 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce23f22f-372e-4778-9a16-5481acce81e2 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:32.892556 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 108/215] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:10:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:10:32.897093 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce23f22f-372e-4778-9a16-5481acce81e2 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:32.900444 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e85bc2-c3a8-41c1-bb3c-afa24db8ca70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:32.901877 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e85bc2-c3a8-41c1-bb3c-afa24db8ca70 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:32.902163 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e85bc2-c3a8-41c1-bb3c-afa24db8ca70 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:32.902438 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e85bc2-c3a8-41c1-bb3c-afa24db8ca70 None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:32.903631 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e85bc2-c3a8-41c1-bb3c-afa24db8ca70 None admin] RBAC: Adding query filter params (name=member) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:10:32.903947 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e85bc2-c3a8-41c1-bb3c-afa24db8ca70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:32.905337 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e85bc2-c3a8-41c1-bb3c-afa24db8ca70 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:32.920240 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 108/216] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Aug 9 10:10:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:10:32.920240 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d807f-4ab2-47cf-a2b3-fb0181fc2ee0 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:32.920240 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d807f-4ab2-47cf-a2b3-fb0181fc2ee0 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:32.920240 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d807f-4ab2-47cf-a2b3-fb0181fc2ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:32.937923 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-3d0d807f-4ab2-47cf-a2b3-fb0181fc2ee0 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:10:32.939100 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-3d0d807f-4ab2-47cf-a2b3-fb0181fc2ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:10:33.013766 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce23f22f-372e-4778-9a16-5481acce81e2 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:33.014649 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 109/217] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:10:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 10:10:33.015286 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d807f-4ab2-47cf-a2b3-fb0181fc2ee0 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:33.022958 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:33.065698 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a49afc1-1ca5-412d-bd2d-25c209cdfbc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:33.066351 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a49afc1-1ca5-412d-bd2d-25c209cdfbc8 None admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:33.066631 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a49afc1-1ca5-412d-bd2d-25c209cdfbc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:33.066908 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a49afc1-1ca5-412d-bd2d-25c209cdfbc8 None admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:33.067548 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a49afc1-1ca5-412d-bd2d-25c209cdfbc8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:33.068977 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a49afc1-1ca5-412d-bd2d-25c209cdfbc8 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:33.092506 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 109/218] 10.222.0.36 () {60 vars in 1132 bytes} [Tue Aug 9 10:10:32 2022] POST /identity/v3/users => generated 297 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:10:33.093328 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a49afc1-1ca5-412d-bd2d-25c209cdfbc8 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:33.156341 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d807f-4ab2-47cf-a2b3-fb0181fc2ee0 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:33.159094 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:33.214790 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1e5ddc-a37d-4c8b-9c14-e6abab935a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:33.217226 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e5ddc-a37d-4c8b-9c14-e6abab935a20 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:33.217754 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e5ddc-a37d-4c8b-9c14-e6abab935a20 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:33.218239 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e5ddc-a37d-4c8b-9c14-e6abab935a20 None admin] PATH_INFO: `/v3/users/7970fb6ae80a4b6d89e257409e95126a` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:33.219180 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a49afc1-1ca5-412d-bd2d-25c209cdfbc8 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:33.239297 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1e5ddc-a37d-4c8b-9c14-e6abab935a20 None admin] RBAC: Authorizing `identity:get_user(user_id=7970fb6ae80a4b6d89e257409e95126a)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:33.241176 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1e5ddc-a37d-4c8b-9c14-e6abab935a20 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:33.244080 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 110/219] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Aug 9 10:10:33 2022] GET /identity/v3/users/7970fb6ae80a4b6d89e257409e95126a => generated 297 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:33.250914 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1e5ddc-a37d-4c8b-9c14-e6abab935a20 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:33.261314 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffadf82-ca54-478f-a810-f7db3b84480f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:33.263378 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffadf82-ca54-478f-a810-f7db3b84480f None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:33.263672 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffadf82-ca54-478f-a810-f7db3b84480f None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:33.263946 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffadf82-ca54-478f-a810-f7db3b84480f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:33.280844 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffadf82-ca54-478f-a810-f7db3b84480f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 10:10:33.287312 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-3ffadf82-ca54-478f-a810-f7db3b84480f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 10:10:33.287312 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:10:33.287312 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:10:33.287312 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:10:33.287312 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:10:33.287312 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:10:33.287312 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:10:33.287312 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:10:33.287312 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:10:33.287312 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:10:33.287312 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:10:33.287312 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:10:33.287312 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 10:10:33.287312 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 10:10:33.287312 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 10:10:33.287312 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 10:10:33.288195 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 10:10:33.288195 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 10:10:33.288195 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 10:10:33.288195 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 10:10:33.288195 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:10:33.288195 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:10:33.288195 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:10:33.288195 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:10:33.288195 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:10:33.288195 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:10:33.288195 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:10:33.288195 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:10:33.288195 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:10:33.288195 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:10:33.288195 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:10:33.288195 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:10:33.289073 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:10:33.289073 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:10:33.289073 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:10:33.289073 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:10:33.289073 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 10:10:33.289073 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 10:10:33.289073 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 10:10:33.289073 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 10:10:33.289073 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 10:10:33.289073 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 10:10:33.289073 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 10:10:33.289073 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:10:33.291250 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 110/220] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Aug 9 10:10:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:10:33.298447 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffadf82-ca54-478f-a810-f7db3b84480f None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:33.335115 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:33.392367 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1e5ddc-a37d-4c8b-9c14-e6abab935a20 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:33.437449 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffadf82-ca54-478f-a810-f7db3b84480f None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:33.439882 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f036cdaf-d212-42e5-966b-58eba8469705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:33.440497 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f036cdaf-d212-42e5-966b-58eba8469705 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:33.440776 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f036cdaf-d212-42e5-966b-58eba8469705 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:33.441050 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f036cdaf-d212-42e5-966b-58eba8469705 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:33.457160 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:33.487374 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe55b0d-4c48-4211-850e-d2ae1b6a8f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:33.489087 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe55b0d-4c48-4211-850e-d2ae1b6a8f2d None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:33.489511 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe55b0d-4c48-4211-850e-d2ae1b6a8f2d None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:33.489971 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe55b0d-4c48-4211-850e-d2ae1b6a8f2d None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:33.490783 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe55b0d-4c48-4211-850e-d2ae1b6a8f2d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:10:33.491226 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe55b0d-4c48-4211-850e-d2ae1b6a8f2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:33.492745 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe55b0d-4c48-4211-850e-d2ae1b6a8f2d None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:33.505959 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 111/221] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Aug 9 10:10:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:10:33.507436 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f25ca0-0e92-45f8-9213-68c5ff590b28 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:33.508423 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f25ca0-0e92-45f8-9213-68c5ff590b28 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:33.508847 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f25ca0-0e92-45f8-9213-68c5ff590b28 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:33.511133 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 112/222] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:10:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:10:33.512003 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f25ca0-0e92-45f8-9213-68c5ff590b28 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:33.530426 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f036cdaf-d212-42e5-966b-58eba8469705 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:33.532284 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f036cdaf-d212-42e5-966b-58eba8469705 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:33.611202 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:33.628794 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f25ca0-0e92-45f8-9213-68c5ff590b28 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:33.660980 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 111/223] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Aug 9 10:10:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 10:10:33.665807 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854a509-eaca-459e-a73d-216a0b438292 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:33.665807 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854a509-eaca-459e-a73d-216a0b438292 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:33.665807 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854a509-eaca-459e-a73d-216a0b438292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:33.676250 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26491ca3-7260-4fdd-a995-0c0dae564d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:33.677598 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26491ca3-7260-4fdd-a995-0c0dae564d56 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:33.678054 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26491ca3-7260-4fdd-a995-0c0dae564d56 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:33.678485 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26491ca3-7260-4fdd-a995-0c0dae564d56 None admin] PATH_INFO: `/v3/users/3fcb59cb02c043d5963d092efc198d4a` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:33.679999 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26491ca3-7260-4fdd-a995-0c0dae564d56 None admin] RBAC: Authorizing `identity:get_user(user_id=3fcb59cb02c043d5963d092efc198d4a)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:33.681574 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26491ca3-7260-4fdd-a995-0c0dae564d56 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:33.683369 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-7854a509-eaca-459e-a73d-216a0b438292 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:10:33.683745 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 113/224] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Aug 9 10:10:33 2022] GET /identity/v3/users/3fcb59cb02c043d5963d092efc198d4a => generated 283 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:33.685207 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26491ca3-7260-4fdd-a995-0c0dae564d56 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:33.685521 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-7854a509-eaca-459e-a73d-216a0b438292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:10:33.735189 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:33.780550 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 112/225] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:10:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 10:10:33.781933 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7854a509-eaca-459e-a73d-216a0b438292 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:33.794054 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26491ca3-7260-4fdd-a995-0c0dae564d56 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:33.830480 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f4f7b0-cb41-4ab9-886b-35e4780696ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:33.831111 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f4f7b0-cb41-4ab9-886b-35e4780696ae None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:33.831387 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f4f7b0-cb41-4ab9-886b-35e4780696ae None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:33.831651 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f4f7b0-cb41-4ab9-886b-35e4780696ae None admin] PATH_INFO: `/v3/projects/a0b7ec3eb0324b10934f50e12805a4e4` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:33.832814 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f4f7b0-cb41-4ab9-886b-35e4780696ae None admin] RBAC: Authorizing `identity:get_project(project_id=a0b7ec3eb0324b10934f50e12805a4e4)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:33.834324 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f4f7b0-cb41-4ab9-886b-35e4780696ae None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:33.835989 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 114/226] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Aug 9 10:10:33 2022] GET /identity/v3/projects/a0b7ec3eb0324b10934f50e12805a4e4 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:33.836814 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f4f7b0-cb41-4ab9-886b-35e4780696ae None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:33.900660 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:33.910348 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7854a509-eaca-459e-a73d-216a0b438292 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:33.951050 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f4f7b0-cb41-4ab9-886b-35e4780696ae None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:33.960262 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d925a1-b376-4f0b-829f-76e5851fbb96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:33.960968 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d925a1-b376-4f0b-829f-76e5851fbb96 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:33.961248 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d925a1-b376-4f0b-829f-76e5851fbb96 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:33.961520 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d925a1-b376-4f0b-829f-76e5851fbb96 None admin] PATH_INFO: `/v3/projects/a0b7ec3eb0324b10934f50e12805a4e4` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:33.962709 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d925a1-b376-4f0b-829f-76e5851fbb96 None admin] RBAC: Authorizing `identity:get_project(project_id=a0b7ec3eb0324b10934f50e12805a4e4)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:33.964363 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d925a1-b376-4f0b-829f-76e5851fbb96 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:33.966307 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 113/227] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Aug 9 10:10:33 2022] GET /identity/v3/projects/a0b7ec3eb0324b10934f50e12805a4e4 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:33.972003 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d925a1-b376-4f0b-829f-76e5851fbb96 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:33.986226 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:33.998608 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda74668-3d90-4c9b-93b3-5241fecc3b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:33.999639 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda74668-3d90-4c9b-93b3-5241fecc3b81 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:34.000434 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda74668-3d90-4c9b-93b3-5241fecc3b81 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:34.001163 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda74668-3d90-4c9b-93b3-5241fecc3b81 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:34.016819 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda74668-3d90-4c9b-93b3-5241fecc3b81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 10:10:34.023989 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-cda74668-3d90-4c9b-93b3-5241fecc3b81 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 10:10:34.023989 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:10:34.023989 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:10:34.023989 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:10:34.023989 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:10:34.023989 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:10:34.023989 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:10:34.023989 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:10:34.023989 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:10:34.023989 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:10:34.023989 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:10:34.023989 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:10:34.023989 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 10:10:34.023989 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 10:10:34.023989 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 10:10:34.023989 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 10:10:34.024845 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 10:10:34.024845 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 10:10:34.024845 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 10:10:34.024845 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 10:10:34.024845 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:10:34.024845 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:10:34.024845 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:10:34.024845 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:10:34.024845 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:10:34.024845 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:10:34.024845 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:10:34.024845 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:10:34.024845 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:10:34.024845 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:10:34.024845 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:10:34.024845 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:10:34.025630 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:10:34.025630 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:10:34.025630 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:10:34.025630 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:10:34.025630 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 10:10:34.025630 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 10:10:34.025630 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 10:10:34.025630 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 10:10:34.025630 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 10:10:34.025630 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 10:10:34.025630 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 10:10:34.025630 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:10:34.027081 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 115/228] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Aug 9 10:10:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:10:34.029953 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda74668-3d90-4c9b-93b3-5241fecc3b81 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:34.088334 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d925a1-b376-4f0b-829f-76e5851fbb96 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:34.123989 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4025dce9-6217-44fd-a777-b8c4fc085009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:34.124608 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4025dce9-6217-44fd-a777-b8c4fc085009 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:34.124882 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4025dce9-6217-44fd-a777-b8c4fc085009 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:34.125151 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4025dce9-6217-44fd-a777-b8c4fc085009 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:34.126043 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4025dce9-6217-44fd-a777-b8c4fc085009 None admin] RBAC: Adding query filter params (role.id=a9895331e9694fa8b2b50908bb057bcb, scope.project.id=a0b7ec3eb0324b10934f50e12805a4e4, user.id=7970fb6ae80a4b6d89e257409e95126a) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:10:34.126393 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4025dce9-6217-44fd-a777-b8c4fc085009 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:34.127982 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4025dce9-6217-44fd-a777-b8c4fc085009 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:34.133672 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 114/229] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Aug 9 10:10:33 2022] GET /identity/v3/role_assignments?user.id=7970fb6ae80a4b6d89e257409e95126a&scope.project.id=a0b7ec3eb0324b10934f50e12805a4e4&role.id=a9895331e9694fa8b2b50908bb057bcb => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:34.134596 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4025dce9-6217-44fd-a777-b8c4fc085009 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:34.165502 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda74668-3d90-4c9b-93b3-5241fecc3b81 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:34.165953 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:34.219798 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb749611-2563-4fb7-8378-6435b77d2363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:34.220492 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb749611-2563-4fb7-8378-6435b77d2363 None admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:34.220767 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb749611-2563-4fb7-8378-6435b77d2363 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:34.221041 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb749611-2563-4fb7-8378-6435b77d2363 None admin] PATH_INFO: `/v3/projects/a0b7ec3eb0324b10934f50e12805a4e4/users/3fcb59cb02c043d5963d092efc198d4a/roles/89ca30cbbb634be8a96e9921aa56626b` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:34.227037 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb749611-2563-4fb7-8378-6435b77d2363 None admin] RBAC: Authorizing `identity:create_grant(project_id=a0b7ec3eb0324b10934f50e12805a4e4, user_id=3fcb59cb02c043d5963d092efc198d4a, role_id=89ca30cbbb634be8a96e9921aa56626b)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:34.228527 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb749611-2563-4fb7-8378-6435b77d2363 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:34.256977 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 116/230] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Aug 9 10:10:34 2022] PUT /identity/v3/projects/a0b7ec3eb0324b10934f50e12805a4e4/users/3fcb59cb02c043d5963d092efc198d4a/roles/89ca30cbbb634be8a96e9921aa56626b => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:10:34.285823 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4025dce9-6217-44fd-a777-b8c4fc085009 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:34.337014 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbc713a-1a00-4895-9d88-ac9b6cd2c415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:34.337639 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbc713a-1a00-4895-9d88-ac9b6cd2c415 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:34.337945 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbc713a-1a00-4895-9d88-ac9b6cd2c415 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:34.338216 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbc713a-1a00-4895-9d88-ac9b6cd2c415 None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:34.339015 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbc713a-1a00-4895-9d88-ac9b6cd2c415 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:10:34.339263 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbc713a-1a00-4895-9d88-ac9b6cd2c415 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:34.341349 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbc713a-1a00-4895-9d88-ac9b6cd2c415 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:34.351720 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 115/231] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Aug 9 10:10:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:34.362937 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb749611-2563-4fb7-8378-6435b77d2363 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:34.413311 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:34.505973 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb749611-2563-4fb7-8378-6435b77d2363 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:34.544228 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7490af-5a5d-49ef-a0b0-cbe698cb5df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:34.544866 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7490af-5a5d-49ef-a0b0-cbe698cb5df2 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:34.545145 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7490af-5a5d-49ef-a0b0-cbe698cb5df2 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:34.545420 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7490af-5a5d-49ef-a0b0-cbe698cb5df2 None admin] PATH_INFO: `/v3/users/3fcb59cb02c043d5963d092efc198d4a` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:34.546579 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7490af-5a5d-49ef-a0b0-cbe698cb5df2 None admin] RBAC: Authorizing `identity:get_user(user_id=3fcb59cb02c043d5963d092efc198d4a)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:34.548031 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7490af-5a5d-49ef-a0b0-cbe698cb5df2 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:34.549936 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 117/232] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Aug 9 10:10:34 2022] GET /identity/v3/users/3fcb59cb02c043d5963d092efc198d4a => generated 283 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:34.555418 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbc713a-1a00-4895-9d88-ac9b6cd2c415 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:34.647265 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:34.660379 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbc713a-1a00-4895-9d88-ac9b6cd2c415 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:34.695400 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958c346e-bdd3-49f9-8272-e2f946a8ad77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:34.696036 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c346e-bdd3-49f9-8272-e2f946a8ad77 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:34.696319 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c346e-bdd3-49f9-8272-e2f946a8ad77 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:34.696597 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c346e-bdd3-49f9-8272-e2f946a8ad77 None admin] PATH_INFO: `/v3/projects/a0b7ec3eb0324b10934f50e12805a4e4` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:34.697721 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958c346e-bdd3-49f9-8272-e2f946a8ad77 None admin] RBAC: Authorizing `identity:get_project(project_id=a0b7ec3eb0324b10934f50e12805a4e4)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:34.699224 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958c346e-bdd3-49f9-8272-e2f946a8ad77 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:34.701786 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 116/233] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Aug 9 10:10:34 2022] GET /identity/v3/projects/a0b7ec3eb0324b10934f50e12805a4e4 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:34.707721 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7490af-5a5d-49ef-a0b0-cbe698cb5df2 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:34.809246 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:34.818002 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7490af-5a5d-49ef-a0b0-cbe698cb5df2 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:34.864121 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9d5005-a000-4cbe-b631-f84a68636c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:34.865164 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d5005-a000-4cbe-b631-f84a68636c9b None admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:34.865645 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d5005-a000-4cbe-b631-f84a68636c9b None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:34.866144 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d5005-a000-4cbe-b631-f84a68636c9b None admin] PATH_INFO: `/v3/projects/a0b7ec3eb0324b10934f50e12805a4e4/users/3fcb59cb02c043d5963d092efc198d4a/roles/af19908af5d6489696eb27791925a5aa` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:34.868545 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9d5005-a000-4cbe-b631-f84a68636c9b None admin] RBAC: Authorizing `identity:create_grant(project_id=a0b7ec3eb0324b10934f50e12805a4e4, user_id=3fcb59cb02c043d5963d092efc198d4a, role_id=af19908af5d6489696eb27791925a5aa)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:34.870230 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9d5005-a000-4cbe-b631-f84a68636c9b None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:34.896153 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 118/234] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Aug 9 10:10:34 2022] PUT /identity/v3/projects/a0b7ec3eb0324b10934f50e12805a4e4/users/3fcb59cb02c043d5963d092efc198d4a/roles/af19908af5d6489696eb27791925a5aa => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:10:35.530367 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b732ea6-b9fc-4d61-a08d-8725d29d312f None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:35.530747 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b732ea6-b9fc-4d61-a08d-8725d29d312f None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:35.531044 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b732ea6-b9fc-4d61-a08d-8725d29d312f None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:35.532570 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 117/235] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:10:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:10:35.538010 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b4d924-a3e9-4142-815b-58634373d4bb None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:35.538898 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b4d924-a3e9-4142-815b-58634373d4bb None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:35.539373 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b4d924-a3e9-4142-815b-58634373d4bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:35.565898 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-97b4d924-a3e9-4142-815b-58634373d4bb None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:10:35.567455 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-97b4d924-a3e9-4142-815b-58634373d4bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:10:35.596507 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d9bc8-02f6-429a-8fb8-fb5a06a81683 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:35.597434 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d9bc8-02f6-429a-8fb8-fb5a06a81683 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:35.597962 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d9bc8-02f6-429a-8fb8-fb5a06a81683 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:35.599772 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 118/236] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:10:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 10:10:35.605139 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9d0964-9bd3-43d9-9d19-d96c0a7e82cd None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:35.605723 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9d0964-9bd3-43d9-9d19-d96c0a7e82cd None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:35.606819 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9d0964-9bd3-43d9-9d19-d96c0a7e82cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:35.637387 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-3b9d0964-9bd3-43d9-9d19-d96c0a7e82cd None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:10:35.639201 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-3b9d0964-9bd3-43d9-9d19-d96c0a7e82cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:10:35.673672 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 119/237] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:10:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 10:10:35.697255 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b4d924-a3e9-4142-815b-58634373d4bb None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:35.728715 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 119/238] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:10:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 10:10:35.761704 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9d0964-9bd3-43d9-9d19-d96c0a7e82cd None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:35.850279 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:35.869188 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b4d924-a3e9-4142-815b-58634373d4bb None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:35.908434 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949d6ec8-477f-4188-9df7-edb706017fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:35.909406 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d6ec8-477f-4188-9df7-edb706017fcb None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:35.909934 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d6ec8-477f-4188-9df7-edb706017fcb None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:35.910398 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d6ec8-477f-4188-9df7-edb706017fcb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:35.926321 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949d6ec8-477f-4188-9df7-edb706017fcb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 10:10:35.931980 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-949d6ec8-477f-4188-9df7-edb706017fcb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 10:10:35.931980 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:10:35.931980 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:10:35.931980 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:10:35.931980 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:10:35.931980 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:10:35.931980 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:10:35.931980 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:10:35.931980 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:10:35.931980 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:10:35.931980 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:10:35.931980 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:10:35.931980 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 10:10:35.931980 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 10:10:35.931980 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 10:10:35.931980 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 10:10:35.932827 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 10:10:35.932827 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 10:10:35.932827 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 10:10:35.932827 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 10:10:35.932827 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:10:35.932827 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:10:35.932827 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:10:35.932827 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:10:35.932827 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:10:35.932827 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:10:35.932827 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:10:35.932827 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:10:35.932827 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:10:35.932827 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:10:35.932827 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:10:35.932827 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:10:35.933592 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:10:35.933592 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:10:35.933592 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:10:35.933592 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:10:35.933592 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 10:10:35.933592 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 10:10:35.933592 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 10:10:35.933592 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 10:10:35.933592 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 10:10:35.933592 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 10:10:35.933592 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 10:10:35.933592 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:10:35.937332 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:35.941741 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 120/239] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Aug 9 10:10:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 10:10:35.951045 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949d6ec8-477f-4188-9df7-edb706017fcb None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:35.968146 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9d0964-9bd3-43d9-9d19-d96c0a7e82cd None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:36.020524 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6fe6e1-176d-4403-b38c-ef5768049db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:36.022595 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6fe6e1-176d-4403-b38c-ef5768049db0 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:36.022892 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6fe6e1-176d-4403-b38c-ef5768049db0 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:36.023174 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6fe6e1-176d-4403-b38c-ef5768049db0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:36.026507 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6fe6e1-176d-4403-b38c-ef5768049db0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:36.030576 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6fe6e1-176d-4403-b38c-ef5768049db0 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:36.032315 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 120/240] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:10:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:36.042754 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6fe6e1-176d-4403-b38c-ef5768049db0 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:36.153683 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949d6ec8-477f-4188-9df7-edb706017fcb None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:36.177506 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6fe6e1-176d-4403-b38c-ef5768049db0 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:36.215326 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e16de8-548a-4c6c-8490-e81e568388e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:36.216342 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e16de8-548a-4c6c-8490-e81e568388e0 None admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:36.217340 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e16de8-548a-4c6c-8490-e81e568388e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:36.217934 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e16de8-548a-4c6c-8490-e81e568388e0 None admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:36.219182 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e16de8-548a-4c6c-8490-e81e568388e0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:36.221639 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e16de8-548a-4c6c-8490-e81e568388e0 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:36.225524 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426dfbda-c3ac-4112-afe4-ab8cfefe9838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:36.228049 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426dfbda-c3ac-4112-afe4-ab8cfefe9838 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:36.228479 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426dfbda-c3ac-4112-afe4-ab8cfefe9838 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:36.228917 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426dfbda-c3ac-4112-afe4-ab8cfefe9838 None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:36.230782 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426dfbda-c3ac-4112-afe4-ab8cfefe9838 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:10:36.231283 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426dfbda-c3ac-4112-afe4-ab8cfefe9838 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:36.237056 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426dfbda-c3ac-4112-afe4-ab8cfefe9838 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:36.250952 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 121/241] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Aug 9 10:10:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:10:36.257358 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426dfbda-c3ac-4112-afe4-ab8cfefe9838 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:36.260330 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 121/242] 10.222.0.36 () {60 vars in 1132 bytes} [Tue Aug 9 10:10:36 2022] POST /identity/v3/users => generated 293 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:10:36.277142 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:36.386754 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426dfbda-c3ac-4112-afe4-ab8cfefe9838 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:36.462814 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631c3802-6bd4-4c2d-9ce3-44eadf06ff3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:36.463392 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c3802-6bd4-4c2d-9ce3-44eadf06ff3e None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:36.463672 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c3802-6bd4-4c2d-9ce3-44eadf06ff3e None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:36.463945 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c3802-6bd4-4c2d-9ce3-44eadf06ff3e None admin] PATH_INFO: `/v3/users/ca63eb4c1fdf4dbb9fca729e4801ad47` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:36.494326 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631c3802-6bd4-4c2d-9ce3-44eadf06ff3e None admin] RBAC: Authorizing `identity:get_user(user_id=ca63eb4c1fdf4dbb9fca729e4801ad47)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:36.495816 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631c3802-6bd4-4c2d-9ce3-44eadf06ff3e None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:36.498438 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 122/243] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Aug 9 10:10:36 2022] GET /identity/v3/users/ca63eb4c1fdf4dbb9fca729e4801ad47 => generated 297 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:36.506305 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e16de8-548a-4c6c-8490-e81e568388e0 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:36.524025 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:36.621396 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e16de8-548a-4c6c-8490-e81e568388e0 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:36.657484 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6b2bad-6f65-46a2-9f80-18746f661c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:36.658489 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b2bad-6f65-46a2-9f80-18746f661c1b None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:36.658970 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b2bad-6f65-46a2-9f80-18746f661c1b None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:36.659461 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b2bad-6f65-46a2-9f80-18746f661c1b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:36.732590 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6b2bad-6f65-46a2-9f80-18746f661c1b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:36.734520 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6b2bad-6f65-46a2-9f80-18746f661c1b None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:36.746195 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:36.846282 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 122/244] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Aug 9 10:10:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 10:10:36.852930 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631c3802-6bd4-4c2d-9ce3-44eadf06ff3e None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:37.006196 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c256b1a6-e7ad-40c9-9aa6-4ef0645d0a16 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:37.006488 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c256b1a6-e7ad-40c9-9aa6-4ef0645d0a16 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:37.006674 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c256b1a6-e7ad-40c9-9aa6-4ef0645d0a16 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:37.009552 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 123/245] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:10:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 10:10:37.015291 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de23d33c-4634-44b3-80a0-5b5f6cc40160 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:37.015569 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de23d33c-4634-44b3-80a0-5b5f6cc40160 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:37.015840 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de23d33c-4634-44b3-80a0-5b5f6cc40160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:37.033162 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:37.046906 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-de23d33c-4634-44b3-80a0-5b5f6cc40160 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:10:37.048155 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-de23d33c-4634-44b3-80a0-5b5f6cc40160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:10:37.071704 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631c3802-6bd4-4c2d-9ce3-44eadf06ff3e None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:37.112248 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caa688b-2852-46c2-98fa-4f6f3fcefbd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:37.112805 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa688b-2852-46c2-98fa-4f6f3fcefbd2 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:37.113089 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa688b-2852-46c2-98fa-4f6f3fcefbd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:37.113361 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa688b-2852-46c2-98fa-4f6f3fcefbd2 None admin] PATH_INFO: `/v3/projects/a0b7ec3eb0324b10934f50e12805a4e4` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:37.114500 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caa688b-2852-46c2-98fa-4f6f3fcefbd2 None admin] RBAC: Authorizing `identity:get_project(project_id=a0b7ec3eb0324b10934f50e12805a4e4)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:37.115942 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caa688b-2852-46c2-98fa-4f6f3fcefbd2 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:37.117555 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 123/246] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Aug 9 10:10:36 2022] GET /identity/v3/projects/a0b7ec3eb0324b10934f50e12805a4e4 => generated 302 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:37.122024 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a00d5d3-c65a-4a4f-a4fc-5199f253c1f7 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:37.122024 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a00d5d3-c65a-4a4f-a4fc-5199f253c1f7 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:37.122024 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a00d5d3-c65a-4a4f-a4fc-5199f253c1f7 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:37.122024 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 124/247] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:10:37 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:10:37.127181 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f2be52-7ee7-4e2d-a33e-d29e490d458b None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:37.127461 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f2be52-7ee7-4e2d-a33e-d29e490d458b None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:37.127728 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f2be52-7ee7-4e2d-a33e-d29e490d458b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:37.144027 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 124/248] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:10:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 10:10:37.145320 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de23d33c-4634-44b3-80a0-5b5f6cc40160 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:37.149800 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-63f2be52-7ee7-4e2d-a33e-d29e490d458b None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:10:37.151005 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-63f2be52-7ee7-4e2d-a33e-d29e490d458b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:10:37.197464 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:37.265885 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de23d33c-4634-44b3-80a0-5b5f6cc40160 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:37.284237 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 125/249] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:10:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 10:10:37.285098 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f2be52-7ee7-4e2d-a33e-d29e490d458b None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:37.302928 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70989b3-417f-4c43-a221-780e1f2efa6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:37.303937 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70989b3-417f-4c43-a221-780e1f2efa6d None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:37.304417 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70989b3-417f-4c43-a221-780e1f2efa6d None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:37.304890 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70989b3-417f-4c43-a221-780e1f2efa6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:37.305864 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70989b3-417f-4c43-a221-780e1f2efa6d None admin] RBAC: Adding query filter params (role.id=b2850f278b2d4b32b2b56324509a5a01, scope.project.id=a0b7ec3eb0324b10934f50e12805a4e4, user.id=ca63eb4c1fdf4dbb9fca729e4801ad47) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:10:37.306378 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70989b3-417f-4c43-a221-780e1f2efa6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:37.308031 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70989b3-417f-4c43-a221-780e1f2efa6d None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:37.314584 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 125/250] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Aug 9 10:10:37 2022] GET /identity/v3/role_assignments?user.id=ca63eb4c1fdf4dbb9fca729e4801ad47&scope.project.id=a0b7ec3eb0324b10934f50e12805a4e4&role.id=b2850f278b2d4b32b2b56324509a5a01 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:37.376125 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70989b3-417f-4c43-a221-780e1f2efa6d None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:37.443848 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:37.503895 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f2be52-7ee7-4e2d-a33e-d29e490d458b None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:37.572270 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb0b4cf-daac-43ea-8974-e971454aa658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:37.572942 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb0b4cf-daac-43ea-8974-e971454aa658 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:37.573134 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb0b4cf-daac-43ea-8974-e971454aa658 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:37.573366 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb0b4cf-daac-43ea-8974-e971454aa658 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:37.592616 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70989b3-417f-4c43-a221-780e1f2efa6d None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:37.595689 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:37.613878 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb0b4cf-daac-43ea-8974-e971454aa658 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 10:10:37.613878 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-8cb0b4cf-daac-43ea-8974-e971454aa658 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 10:10:37.613878 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:10:37.613878 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:10:37.613878 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:10:37.613878 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:10:37.613878 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:10:37.613878 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:10:37.613878 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:10:37.613878 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:10:37.613878 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:10:37.613878 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:10:37.613878 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:10:37.613878 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 10:10:37.614764 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 10:10:37.614764 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 10:10:37.614764 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 10:10:37.614764 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 10:10:37.614764 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 10:10:37.614764 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 10:10:37.614764 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 10:10:37.614764 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:10:37.614764 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:10:37.614764 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:10:37.614764 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:10:37.614764 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:10:37.614764 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:10:37.614764 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:10:37.614764 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:10:37.614764 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:10:37.614764 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:10:37.615666 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:10:37.615666 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:10:37.615666 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:10:37.615666 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:10:37.615666 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:10:37.615666 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:10:37.615666 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 10:10:37.615666 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 10:10:37.615666 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 10:10:37.615666 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 10:10:37.615666 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 10:10:37.615666 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 10:10:37.615666 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 10:10:37.615666 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:10:37.615666 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 126/251] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Aug 9 10:10:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:10:37.616416 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8742f848-312f-4414-bab4-cf0ed4cf8418 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:37.616416 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8742f848-312f-4414-bab4-cf0ed4cf8418 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:37.616416 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8742f848-312f-4414-bab4-cf0ed4cf8418 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:37.617525 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 127/252] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:10:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:10:37.624439 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8742f848-312f-4414-bab4-cf0ed4cf8418 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:37.667407 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39164160-3eb7-4470-9113-4ecb5b51c20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:37.668074 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39164160-3eb7-4470-9113-4ecb5b51c20c None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:37.668332 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39164160-3eb7-4470-9113-4ecb5b51c20c None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:37.668608 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39164160-3eb7-4470-9113-4ecb5b51c20c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:37.695035 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39164160-3eb7-4470-9113-4ecb5b51c20c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 10:10:37.702072 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-39164160-3eb7-4470-9113-4ecb5b51c20c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 10:10:37.702072 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:10:37.702072 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:10:37.702072 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:10:37.702072 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:10:37.702072 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:10:37.702072 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:10:37.702072 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:10:37.702072 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:10:37.702072 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:10:37.702072 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:10:37.702072 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:10:37.702072 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 10:10:37.702072 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 10:10:37.702072 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 10:10:37.702072 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 10:10:37.702935 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 10:10:37.702935 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 10:10:37.702935 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 10:10:37.702935 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 10:10:37.702935 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:10:37.702935 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:10:37.702935 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:10:37.702935 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:10:37.702935 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:10:37.702935 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:10:37.702935 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:10:37.702935 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:10:37.702935 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:10:37.702935 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:10:37.702935 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:10:37.702935 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:10:37.703720 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:10:37.703720 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:10:37.703720 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:10:37.703720 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:10:37.703720 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 10:10:37.703720 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 10:10:37.703720 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 10:10:37.703720 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 10:10:37.703720 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 10:10:37.703720 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 10:10:37.703720 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 10:10:37.703720 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:10:37.707402 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 126/253] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Aug 9 10:10:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 10:10:37.708859 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b3c78-5a99-40ca-82c7-de01da487a61 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:37.709382 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b3c78-5a99-40ca-82c7-de01da487a61 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:37.709870 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b3c78-5a99-40ca-82c7-de01da487a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:37.742895 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-df0b3c78-5a99-40ca-82c7-de01da487a61 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:10:37.744076 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-df0b3c78-5a99-40ca-82c7-de01da487a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:10:37.746536 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8742f848-312f-4414-bab4-cf0ed4cf8418 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:37.798218 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:37.814383 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e1cda-ed44-4615-a8f0-84b5e24c7b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:37.816592 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e1cda-ed44-4615-a8f0-84b5e24c7b13 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:37.816874 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e1cda-ed44-4615-a8f0-84b5e24c7b13 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:37.817146 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e1cda-ed44-4615-a8f0-84b5e24c7b13 None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:37.817810 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7e1cda-ed44-4615-a8f0-84b5e24c7b13 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:10:37.818558 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7e1cda-ed44-4615-a8f0-84b5e24c7b13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:37.820767 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7e1cda-ed44-4615-a8f0-84b5e24c7b13 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:37.838891 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 128/254] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Aug 9 10:10:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:10:37.840042 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e1cda-ed44-4615-a8f0-84b5e24c7b13 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:37.884750 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 127/255] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:10:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 10:10:37.886144 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0b3c78-5a99-40ca-82c7-de01da487a61 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:38.007977 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e1cda-ed44-4615-a8f0-84b5e24c7b13 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:38.058259 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ebbfcc-339a-4c0e-b99e-e4065b9e6412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:38.059156 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ebbfcc-339a-4c0e-b99e-e4065b9e6412 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:38.060186 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ebbfcc-339a-4c0e-b99e-e4065b9e6412 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:38.060773 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ebbfcc-339a-4c0e-b99e-e4065b9e6412 None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:38.061579 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ebbfcc-339a-4c0e-b99e-e4065b9e6412 None admin] RBAC: Adding query filter params (name=member) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:10:38.062055 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ebbfcc-339a-4c0e-b99e-e4065b9e6412 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:38.063569 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ebbfcc-339a-4c0e-b99e-e4065b9e6412 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:38.084071 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 129/256] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Aug 9 10:10:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:38.085111 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ebbfcc-339a-4c0e-b99e-e4065b9e6412 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:38.096333 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:38.108410 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0b3c78-5a99-40ca-82c7-de01da487a61 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:38.154390 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:38.188432 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f78063-4b8c-4750-a332-5fba24f31fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:38.189090 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f78063-4b8c-4750-a332-5fba24f31fb9 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:38.189367 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f78063-4b8c-4750-a332-5fba24f31fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:38.189834 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f78063-4b8c-4750-a332-5fba24f31fb9 None admin] PATH_INFO: `/v3/users/3fcb59cb02c043d5963d092efc198d4a` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:38.194525 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f78063-4b8c-4750-a332-5fba24f31fb9 None admin] RBAC: Authorizing `identity:get_user(user_id=3fcb59cb02c043d5963d092efc198d4a)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:38.196343 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f78063-4b8c-4750-a332-5fba24f31fb9 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:38.198397 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 128/257] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Aug 9 10:10:37 2022] GET /identity/v3/users/3fcb59cb02c043d5963d092efc198d4a => generated 283 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:38.199379 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f78063-4b8c-4750-a332-5fba24f31fb9 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:38.212627 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ebbfcc-339a-4c0e-b99e-e4065b9e6412 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:38.254555 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442539fa-01a9-455b-a4f9-948f29d26750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:38.255594 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442539fa-01a9-455b-a4f9-948f29d26750 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:38.257005 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442539fa-01a9-455b-a4f9-948f29d26750 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:38.258617 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442539fa-01a9-455b-a4f9-948f29d26750 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:38.283412 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442539fa-01a9-455b-a4f9-948f29d26750 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 10:10:38.289583 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-442539fa-01a9-455b-a4f9-948f29d26750 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 10:10:38.289583 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:10:38.289583 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:10:38.289583 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:10:38.289583 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:10:38.289583 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:10:38.289583 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:10:38.289583 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:10:38.289583 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:10:38.289583 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:10:38.289583 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:10:38.289583 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:10:38.289583 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 10:10:38.289583 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 10:10:38.289583 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 10:10:38.289583 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 10:10:38.290750 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 10:10:38.290750 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 10:10:38.290750 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 10:10:38.290750 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 10:10:38.290750 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:10:38.290750 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:10:38.290750 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:10:38.290750 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:10:38.290750 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:10:38.290750 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:10:38.290750 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:10:38.290750 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:10:38.290750 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:10:38.290750 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:10:38.290750 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:10:38.290750 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:10:38.291534 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:10:38.291534 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:10:38.291534 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:10:38.291534 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:10:38.291534 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 10:10:38.291534 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 10:10:38.291534 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 10:10:38.291534 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 10:10:38.291534 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 10:10:38.291534 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 10:10:38.291534 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 10:10:38.291534 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:10:38.293892 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 130/258] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Aug 9 10:10:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:10:38.294988 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442539fa-01a9-455b-a4f9-948f29d26750 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:38.403626 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442539fa-01a9-455b-a4f9-948f29d26750 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:38.411726 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f78063-4b8c-4750-a332-5fba24f31fb9 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:38.431645 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:38.474067 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b60845-4401-449c-851c-372676157318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:38.475430 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b60845-4401-449c-851c-372676157318 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:38.476203 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b60845-4401-449c-851c-372676157318 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:38.477146 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b60845-4401-449c-851c-372676157318 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:38.477957 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be9e55d-1699-452c-94ab-e431ac53c34a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:38.478812 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9e55d-1699-452c-94ab-e431ac53c34a None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:38.479274 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9e55d-1699-452c-94ab-e431ac53c34a None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:38.479799 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9e55d-1699-452c-94ab-e431ac53c34a None admin] PATH_INFO: `/v3/users/7970fb6ae80a4b6d89e257409e95126a` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:38.481660 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be9e55d-1699-452c-94ab-e431ac53c34a None admin] RBAC: Authorizing `identity:get_user(user_id=7970fb6ae80a4b6d89e257409e95126a)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:38.483686 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be9e55d-1699-452c-94ab-e431ac53c34a None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:38.485779 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 129/259] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Aug 9 10:10:38 2022] GET /identity/v3/users/7970fb6ae80a4b6d89e257409e95126a => generated 297 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:38.486813 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be9e55d-1699-452c-94ab-e431ac53c34a None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:38.519231 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:38.622547 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b60845-4401-449c-851c-372676157318 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:38.624042 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b60845-4401-449c-851c-372676157318 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:38.645974 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be9e55d-1699-452c-94ab-e431ac53c34a None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:38.700938 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95605222-a7de-4613-8124-25a118655fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:38.702378 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95605222-a7de-4613-8124-25a118655fdb None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:38.704221 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95605222-a7de-4613-8124-25a118655fdb None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:38.705461 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95605222-a7de-4613-8124-25a118655fdb None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:38.707436 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95605222-a7de-4613-8124-25a118655fdb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:10:38.709082 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95605222-a7de-4613-8124-25a118655fdb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:38.711294 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95605222-a7de-4613-8124-25a118655fdb None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:38.728944 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 130/260] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Aug 9 10:10:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:38.729996 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95605222-a7de-4613-8124-25a118655fdb None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:38.828362 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:38.830319 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 131/261] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Aug 9 10:10:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 10:10:38.832368 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b60845-4401-449c-851c-372676157318 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:38.838331 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95605222-a7de-4613-8124-25a118655fdb None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:38.860734 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:38.876996 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06ad692-bc3e-4b35-ad89-8315133ee2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:38.877974 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ad692-bc3e-4b35-ad89-8315133ee2da None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:38.878390 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ad692-bc3e-4b35-ad89-8315133ee2da None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:38.878797 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ad692-bc3e-4b35-ad89-8315133ee2da None admin] PATH_INFO: `/v3/projects/a0b7ec3eb0324b10934f50e12805a4e4` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:38.882832 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06ad692-bc3e-4b35-ad89-8315133ee2da None admin] RBAC: Authorizing `identity:get_project(project_id=a0b7ec3eb0324b10934f50e12805a4e4)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:38.884516 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06ad692-bc3e-4b35-ad89-8315133ee2da None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:38.886349 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 131/262] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Aug 9 10:10:38 2022] GET /identity/v3/projects/a0b7ec3eb0324b10934f50e12805a4e4 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:38.888467 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06ad692-bc3e-4b35-ad89-8315133ee2da None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:39.022482 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b60845-4401-449c-851c-372676157318 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:39.032425 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06ad692-bc3e-4b35-ad89-8315133ee2da None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:39.067271 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be921bc8-adef-49bd-99ca-82e6e997ea03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:39.068238 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be921bc8-adef-49bd-99ca-82e6e997ea03 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:39.068706 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be921bc8-adef-49bd-99ca-82e6e997ea03 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:39.069188 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be921bc8-adef-49bd-99ca-82e6e997ea03 None admin] PATH_INFO: `/v3/projects/a0b7ec3eb0324b10934f50e12805a4e4` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:39.070519 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be921bc8-adef-49bd-99ca-82e6e997ea03 None admin] RBAC: Authorizing `identity:get_project(project_id=a0b7ec3eb0324b10934f50e12805a4e4)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:39.073607 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be921bc8-adef-49bd-99ca-82e6e997ea03 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:39.075513 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 132/263] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Aug 9 10:10:38 2022] GET /identity/v3/projects/a0b7ec3eb0324b10934f50e12805a4e4 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:39.076662 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be921bc8-adef-49bd-99ca-82e6e997ea03 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:39.086473 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2fc940-6494-424d-b2af-ecfecb5815e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:39.087111 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2fc940-6494-424d-b2af-ecfecb5815e4 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:39.087386 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2fc940-6494-424d-b2af-ecfecb5815e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:39.087655 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2fc940-6494-424d-b2af-ecfecb5815e4 None admin] PATH_INFO: `/v3/users/3fcb59cb02c043d5963d092efc198d4a` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:39.094692 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2fc940-6494-424d-b2af-ecfecb5815e4 None admin] RBAC: Authorizing `identity:get_user(user_id=3fcb59cb02c043d5963d092efc198d4a)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:39.096154 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2fc940-6494-424d-b2af-ecfecb5815e4 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:39.097892 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 132/264] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Aug 9 10:10:38 2022] GET /identity/v3/users/3fcb59cb02c043d5963d092efc198d4a => generated 283 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:39.098741 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2fc940-6494-424d-b2af-ecfecb5815e4 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:39.114272 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:39.183336 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be921bc8-adef-49bd-99ca-82e6e997ea03 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:39.212450 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:39.222061 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242d5c1f-5419-4a4f-ba9b-e9f66018535b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:39.223885 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242d5c1f-5419-4a4f-ba9b-e9f66018535b None admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:39.224272 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242d5c1f-5419-4a4f-ba9b-e9f66018535b None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:39.224640 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242d5c1f-5419-4a4f-ba9b-e9f66018535b None admin] PATH_INFO: `/v3/projects/a0b7ec3eb0324b10934f50e12805a4e4/users/7970fb6ae80a4b6d89e257409e95126a/roles/a9895331e9694fa8b2b50908bb057bcb` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:39.226761 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242d5c1f-5419-4a4f-ba9b-e9f66018535b None admin] RBAC: Authorizing `identity:create_grant(project_id=a0b7ec3eb0324b10934f50e12805a4e4, user_id=7970fb6ae80a4b6d89e257409e95126a, role_id=a9895331e9694fa8b2b50908bb057bcb)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:39.228263 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242d5c1f-5419-4a4f-ba9b-e9f66018535b None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:39.236919 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2fc940-6494-424d-b2af-ecfecb5815e4 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:39.253643 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 133/265] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Aug 9 10:10:39 2022] PUT /identity/v3/projects/a0b7ec3eb0324b10934f50e12805a4e4/users/7970fb6ae80a4b6d89e257409e95126a/roles/a9895331e9694fa8b2b50908bb057bcb => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:10:39.254788 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242d5c1f-5419-4a4f-ba9b-e9f66018535b None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:39.285626 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a01ded-d60e-445c-aa35-7ac2b7c78360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:39.286711 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a01ded-d60e-445c-aa35-7ac2b7c78360 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:39.287244 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a01ded-d60e-445c-aa35-7ac2b7c78360 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:39.287806 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a01ded-d60e-445c-aa35-7ac2b7c78360 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:39.288886 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a01ded-d60e-445c-aa35-7ac2b7c78360 None admin] RBAC: Adding query filter params (role.id=89ca30cbbb634be8a96e9921aa56626b, scope.project.id=a0b7ec3eb0324b10934f50e12805a4e4, user.id=3fcb59cb02c043d5963d092efc198d4a) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:10:39.289407 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a01ded-d60e-445c-aa35-7ac2b7c78360 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:39.291511 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a01ded-d60e-445c-aa35-7ac2b7c78360 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:39.299763 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 133/266] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Aug 9 10:10:39 2022] GET /identity/v3/role_assignments?user.id=3fcb59cb02c043d5963d092efc198d4a&scope.project.id=a0b7ec3eb0324b10934f50e12805a4e4&role.id=89ca30cbbb634be8a96e9921aa56626b => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:39.301267 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db9e78-b249-4b37-8582-1c49e9bb2886 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:39.301745 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db9e78-b249-4b37-8582-1c49e9bb2886 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:39.302243 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db9e78-b249-4b37-8582-1c49e9bb2886 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:39.303702 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 134/267] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:10:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:10:39.312471 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d706e8-4eba-4e8f-9591-99b5f671baa4 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:39.313096 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d706e8-4eba-4e8f-9591-99b5f671baa4 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:39.313565 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d706e8-4eba-4e8f-9591-99b5f671baa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:39.335649 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-78d706e8-4eba-4e8f-9591-99b5f671baa4 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:10:39.337577 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-78d706e8-4eba-4e8f-9591-99b5f671baa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:10:39.365578 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:39.380976 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242d5c1f-5419-4a4f-ba9b-e9f66018535b None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:39.420855 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2010d601-3927-4af7-8243-c06a341ccefc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:39.421474 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2010d601-3927-4af7-8243-c06a341ccefc None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:39.421835 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2010d601-3927-4af7-8243-c06a341ccefc None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:39.422138 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2010d601-3927-4af7-8243-c06a341ccefc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:39.428397 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 135/268] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:10:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 10:10:39.515416 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d706e8-4eba-4e8f-9591-99b5f671baa4 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:39.517475 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2010d601-3927-4af7-8243-c06a341ccefc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:39.519078 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2010d601-3927-4af7-8243-c06a341ccefc None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:39.628847 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:39.649344 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 134/269] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Aug 9 10:10:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 10:10:39.650894 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:39.658397 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2010d601-3927-4af7-8243-c06a341ccefc None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:39.692551 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d706e8-4eba-4e8f-9591-99b5f671baa4 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:39.736171 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1554818a-35a1-4bde-89b5-552661b16047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:39.736976 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1554818a-35a1-4bde-89b5-552661b16047 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:39.737251 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1554818a-35a1-4bde-89b5-552661b16047 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:39.737518 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1554818a-35a1-4bde-89b5-552661b16047 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:39.753106 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1554818a-35a1-4bde-89b5-552661b16047 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 10:10:39.759250 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-1554818a-35a1-4bde-89b5-552661b16047 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 10:10:39.759250 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:10:39.759250 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:10:39.759250 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:10:39.759250 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:10:39.759250 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:10:39.759250 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:10:39.759250 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:10:39.759250 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:10:39.759250 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:10:39.759250 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:10:39.759250 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:10:39.759250 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 10:10:39.759250 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 10:10:39.759250 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 10:10:39.759250 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 10:10:39.760124 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 10:10:39.760124 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 10:10:39.760124 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 10:10:39.760124 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 10:10:39.760124 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:10:39.760124 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:10:39.760124 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:10:39.760124 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:10:39.760124 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:10:39.760124 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:10:39.760124 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:10:39.760124 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:10:39.760124 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:10:39.760124 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:10:39.760124 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:10:39.760124 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:10:39.760908 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:10:39.760908 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:10:39.760908 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:10:39.760908 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:10:39.760908 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 10:10:39.760908 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 10:10:39.760908 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 10:10:39.760908 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 10:10:39.760908 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 10:10:39.760908 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 10:10:39.760908 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 10:10:39.760908 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:10:39.760908 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 136/270] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Aug 9 10:10:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 10:10:39.763813 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b6de17-84cd-478b-addf-d8b33d8718d8 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:39.763813 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b6de17-84cd-478b-addf-d8b33d8718d8 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:39.763813 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b6de17-84cd-478b-addf-d8b33d8718d8 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:39.764990 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 137/271] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:10:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:10:39.769309 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b6de17-84cd-478b-addf-d8b33d8718d8 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:39.797741 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2010d601-3927-4af7-8243-c06a341ccefc None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:39.836839 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046e6c9b-567a-4348-81a5-20606b6ac06d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:39.837632 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e6c9b-567a-4348-81a5-20606b6ac06d None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:39.837984 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e6c9b-567a-4348-81a5-20606b6ac06d None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:39.838264 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e6c9b-567a-4348-81a5-20606b6ac06d None admin] PATH_INFO: `/v3/projects/a0b7ec3eb0324b10934f50e12805a4e4` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:39.839438 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046e6c9b-567a-4348-81a5-20606b6ac06d None admin] RBAC: Authorizing `identity:get_project(project_id=a0b7ec3eb0324b10934f50e12805a4e4)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:39.841471 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046e6c9b-567a-4348-81a5-20606b6ac06d None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:39.843549 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 135/272] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Aug 9 10:10:39 2022] GET /identity/v3/projects/a0b7ec3eb0324b10934f50e12805a4e4 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:39.844751 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ace9e2-2fa4-4a03-937e-8eb68a00dddb None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:39.845035 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ace9e2-2fa4-4a03-937e-8eb68a00dddb None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:39.845409 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ace9e2-2fa4-4a03-937e-8eb68a00dddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:39.865104 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-e2ace9e2-2fa4-4a03-937e-8eb68a00dddb None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:10:39.866319 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-e2ace9e2-2fa4-4a03-937e-8eb68a00dddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:10:39.912455 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b6de17-84cd-478b-addf-d8b33d8718d8 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:39.923801 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:39.943589 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 136/273] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:10:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 10:10:39.943589 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ace9e2-2fa4-4a03-937e-8eb68a00dddb None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:39.965082 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e082b792-c144-4754-820c-179e98d6cb19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:39.969904 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e082b792-c144-4754-820c-179e98d6cb19 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:39.969904 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e082b792-c144-4754-820c-179e98d6cb19 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:39.969904 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e082b792-c144-4754-820c-179e98d6cb19 None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:39.969904 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e082b792-c144-4754-820c-179e98d6cb19 None admin] RBAC: Adding query filter params (name=member) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:10:39.969904 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e082b792-c144-4754-820c-179e98d6cb19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:39.969904 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e082b792-c144-4754-820c-179e98d6cb19 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:39.970889 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:39.981653 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 138/274] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Aug 9 10:10:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:10:39.987442 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e082b792-c144-4754-820c-179e98d6cb19 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:40.090988 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ace9e2-2fa4-4a03-937e-8eb68a00dddb None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:40.097932 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e082b792-c144-4754-820c-179e98d6cb19 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:40.126014 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8076e8a3-0f2b-4ecb-996c-27569a644eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:40.126680 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8076e8a3-0f2b-4ecb-996c-27569a644eaf None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:40.126888 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8076e8a3-0f2b-4ecb-996c-27569a644eaf None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:40.127156 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8076e8a3-0f2b-4ecb-996c-27569a644eaf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:40.127885 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8076e8a3-0f2b-4ecb-996c-27569a644eaf None admin] RBAC: Adding query filter params (role.id=af19908af5d6489696eb27791925a5aa, scope.project.id=a0b7ec3eb0324b10934f50e12805a4e4, user.id=3fcb59cb02c043d5963d092efc198d4a) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:10:40.128181 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8076e8a3-0f2b-4ecb-996c-27569a644eaf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:40.129629 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8076e8a3-0f2b-4ecb-996c-27569a644eaf None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:40.134719 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6702a2cf-b70b-4339-b1f8-1c162713053c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:40.135342 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702a2cf-b70b-4339-b1f8-1c162713053c None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:40.135618 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702a2cf-b70b-4339-b1f8-1c162713053c None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:40.135786 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 137/275] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Aug 9 10:10:39 2022] GET /identity/v3/role_assignments?user.id=3fcb59cb02c043d5963d092efc198d4a&scope.project.id=a0b7ec3eb0324b10934f50e12805a4e4&role.id=af19908af5d6489696eb27791925a5aa => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:40.136550 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8076e8a3-0f2b-4ecb-996c-27569a644eaf None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:40.146055 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702a2cf-b70b-4339-b1f8-1c162713053c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:40.147575 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6702a2cf-b70b-4339-b1f8-1c162713053c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:40.149801 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6702a2cf-b70b-4339-b1f8-1c162713053c None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:40.152529 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 139/276] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:10:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:10:40.158393 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04a2054-18a6-4d9b-b8a4-a949a37c8a9a None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:40.158393 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04a2054-18a6-4d9b-b8a4-a949a37c8a9a None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:40.158393 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04a2054-18a6-4d9b-b8a4-a949a37c8a9a None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:40.158393 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 140/277] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:10:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:10:40.161956 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04a2054-18a6-4d9b-b8a4-a949a37c8a9a None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:40.212997 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:40.267503 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:40.288524 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8076e8a3-0f2b-4ecb-996c-27569a644eaf None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:40.320042 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04a2054-18a6-4d9b-b8a4-a949a37c8a9a None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:40.337676 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2475d14d-a21d-4185-a7c2-c52624390226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:40.338668 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2475d14d-a21d-4185-a7c2-c52624390226 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:40.339278 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2475d14d-a21d-4185-a7c2-c52624390226 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:40.340119 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2475d14d-a21d-4185-a7c2-c52624390226 None admin] PATH_INFO: `/v3/users/1847193370904739a814cc84c1da8d90` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:40.360643 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2475d14d-a21d-4185-a7c2-c52624390226 None admin] RBAC: Authorizing `identity:get_user(user_id=1847193370904739a814cc84c1da8d90)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:40.362164 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2475d14d-a21d-4185-a7c2-c52624390226 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:40.363840 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 138/278] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Aug 9 10:10:40 2022] GET /identity/v3/users/1847193370904739a814cc84c1da8d90 => generated 293 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:40.365107 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f6f763-b20a-4e0c-ad77-b6cc14df4524 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:40.365414 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f6f763-b20a-4e0c-ad77-b6cc14df4524 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:40.365693 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f6f763-b20a-4e0c-ad77-b6cc14df4524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:40.373764 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7793b8fc-5577-4938-b7a2-7140858b360c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:40.375302 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7793b8fc-5577-4938-b7a2-7140858b360c None admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:40.375585 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7793b8fc-5577-4938-b7a2-7140858b360c None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:40.375888 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7793b8fc-5577-4938-b7a2-7140858b360c None admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:40.376531 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7793b8fc-5577-4938-b7a2-7140858b360c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:40.378021 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7793b8fc-5577-4938-b7a2-7140858b360c None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:40.385663 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-a3f6f763-b20a-4e0c-ad77-b6cc14df4524 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:10:40.386903 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-a3f6f763-b20a-4e0c-ad77-b6cc14df4524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:10:40.407044 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 141/279] 10.222.0.36 () {60 vars in 1132 bytes} [Tue Aug 9 10:10:40 2022] POST /identity/v3/users => generated 293 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:10:40.407726 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7793b8fc-5577-4938-b7a2-7140858b360c None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:40.502432 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 139/280] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:10:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 10:10:40.525461 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f6f763-b20a-4e0c-ad77-b6cc14df4524 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:40.530671 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7793b8fc-5577-4938-b7a2-7140858b360c None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:40.553215 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:40.569863 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0846324c-c054-4a59-ace8-2f84dad9c404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:40.570744 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846324c-c054-4a59-ace8-2f84dad9c404 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:40.571076 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846324c-c054-4a59-ace8-2f84dad9c404 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:40.571356 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846324c-c054-4a59-ace8-2f84dad9c404 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:40.572084 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0846324c-c054-4a59-ace8-2f84dad9c404 None admin] RBAC: Adding query filter params (role.id=a9895331e9694fa8b2b50908bb057bcb, user.id=1847193370904739a814cc84c1da8d90, scope.system=all) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:10:40.572389 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0846324c-c054-4a59-ace8-2f84dad9c404 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:40.573865 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0846324c-c054-4a59-ace8-2f84dad9c404 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:40.578548 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:40.579620 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 142/281] 10.222.0.36 () {56 vars in 1308 bytes} [Tue Aug 9 10:10:40 2022] GET /identity/v3/role_assignments?user.id=1847193370904739a814cc84c1da8d90&scope.system=all&role.id=a9895331e9694fa8b2b50908bb057bcb => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:40.651449 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f6f763-b20a-4e0c-ad77-b6cc14df4524 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:40.691881 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05b7266-89f5-4778-9624-c5fcecd6a96e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:40.692579 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b7266-89f5-4778-9624-c5fcecd6a96e None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:40.692862 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b7266-89f5-4778-9624-c5fcecd6a96e None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:40.693183 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b7266-89f5-4778-9624-c5fcecd6a96e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:40.707847 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05b7266-89f5-4778-9624-c5fcecd6a96e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 10:10:40.712898 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-b05b7266-89f5-4778-9624-c5fcecd6a96e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 10:10:40.712898 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:10:40.712898 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:10:40.712898 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:10:40.712898 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:10:40.712898 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:10:40.712898 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:10:40.712898 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:10:40.712898 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:10:40.712898 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:10:40.712898 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:10:40.712898 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:10:40.712898 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 10:10:40.712898 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 10:10:40.712898 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 10:10:40.712898 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 10:10:40.713946 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 10:10:40.713946 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 10:10:40.713946 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 10:10:40.713946 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 10:10:40.713946 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:10:40.713946 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:10:40.713946 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:10:40.713946 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:10:40.713946 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:10:40.713946 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:10:40.713946 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:10:40.713946 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:10:40.713946 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:10:40.713946 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:10:40.713946 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:10:40.713946 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:10:40.714796 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:10:40.714796 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:10:40.714796 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:10:40.714796 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:10:40.714796 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 10:10:40.714796 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 10:10:40.714796 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 10:10:40.714796 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 10:10:40.714796 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 10:10:40.714796 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 10:10:40.714796 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 10:10:40.714796 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:10:40.714796 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 140/282] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Aug 9 10:10:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 10:10:40.720573 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0846324c-c054-4a59-ace8-2f84dad9c404 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:40.832113 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0846324c-c054-4a59-ace8-2f84dad9c404 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:40.869361 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f78a9f-eb7d-4a74-b46e-6cf1c16f8562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:40.870052 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f78a9f-eb7d-4a74-b46e-6cf1c16f8562 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:40.870343 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f78a9f-eb7d-4a74-b46e-6cf1c16f8562 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:40.870616 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f78a9f-eb7d-4a74-b46e-6cf1c16f8562 None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:40.871278 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f78a9f-eb7d-4a74-b46e-6cf1c16f8562 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:10:40.871581 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f78a9f-eb7d-4a74-b46e-6cf1c16f8562 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:40.873288 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f78a9f-eb7d-4a74-b46e-6cf1c16f8562 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:40.882625 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 143/283] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Aug 9 10:10:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:40.888948 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05b7266-89f5-4778-9624-c5fcecd6a96e None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:41.006469 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:41.012148 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05b7266-89f5-4778-9624-c5fcecd6a96e None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:41.059025 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9bdcf6-0f98-497a-bfbb-c4cd9b3e208a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:41.060468 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9bdcf6-0f98-497a-bfbb-c4cd9b3e208a None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:41.060744 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9bdcf6-0f98-497a-bfbb-c4cd9b3e208a None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:41.061012 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9bdcf6-0f98-497a-bfbb-c4cd9b3e208a None admin] PATH_INFO: `/v3/users/ca63eb4c1fdf4dbb9fca729e4801ad47` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:41.062190 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9bdcf6-0f98-497a-bfbb-c4cd9b3e208a None admin] RBAC: Authorizing `identity:get_user(user_id=ca63eb4c1fdf4dbb9fca729e4801ad47)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:41.063651 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9bdcf6-0f98-497a-bfbb-c4cd9b3e208a None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:41.065549 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 141/284] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Aug 9 10:10:40 2022] GET /identity/v3/users/ca63eb4c1fdf4dbb9fca729e4801ad47 => generated 297 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:41.070941 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f78a9f-eb7d-4a74-b46e-6cf1c16f8562 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:41.151724 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:41.216692 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f78a9f-eb7d-4a74-b46e-6cf1c16f8562 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:41.262874 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3951bb9-ad3d-4ed3-ba43-043691659417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:41.263691 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3951bb9-ad3d-4ed3-ba43-043691659417 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:41.263970 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3951bb9-ad3d-4ed3-ba43-043691659417 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:41.264243 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3951bb9-ad3d-4ed3-ba43-043691659417 None admin] PATH_INFO: `/v3/projects/a0b7ec3eb0324b10934f50e12805a4e4` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:41.265388 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3951bb9-ad3d-4ed3-ba43-043691659417 None admin] RBAC: Authorizing `identity:get_project(project_id=a0b7ec3eb0324b10934f50e12805a4e4)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:41.266954 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3951bb9-ad3d-4ed3-ba43-043691659417 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:41.268902 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 144/285] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Aug 9 10:10:41 2022] GET /identity/v3/projects/a0b7ec3eb0324b10934f50e12805a4e4 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:41.274457 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9bdcf6-0f98-497a-bfbb-c4cd9b3e208a None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:41.409549 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9bdcf6-0f98-497a-bfbb-c4cd9b3e208a None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:41.457310 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd341cf1-7b5b-4b43-a7c1-06e2bdb3172b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:41.458004 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd341cf1-7b5b-4b43-a7c1-06e2bdb3172b None admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:41.458285 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd341cf1-7b5b-4b43-a7c1-06e2bdb3172b None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:41.458559 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd341cf1-7b5b-4b43-a7c1-06e2bdb3172b None admin] PATH_INFO: `/v3/projects/a0b7ec3eb0324b10934f50e12805a4e4/users/ca63eb4c1fdf4dbb9fca729e4801ad47/roles/b2850f278b2d4b32b2b56324509a5a01` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:41.460591 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd341cf1-7b5b-4b43-a7c1-06e2bdb3172b None admin] RBAC: Authorizing `identity:create_grant(project_id=a0b7ec3eb0324b10934f50e12805a4e4, user_id=ca63eb4c1fdf4dbb9fca729e4801ad47, role_id=b2850f278b2d4b32b2b56324509a5a01)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:41.462077 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd341cf1-7b5b-4b43-a7c1-06e2bdb3172b None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:41.475932 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 142/286] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Aug 9 10:10:41 2022] PUT /identity/v3/projects/a0b7ec3eb0324b10934f50e12805a4e4/users/ca63eb4c1fdf4dbb9fca729e4801ad47/roles/b2850f278b2d4b32b2b56324509a5a01 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:10:42.129357 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ca23a-a813-470d-8679-c198ce11c13f None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:42.129727 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ca23a-a813-470d-8679-c198ce11c13f None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:42.129922 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ca23a-a813-470d-8679-c198ce11c13f None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:42.131500 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 145/287] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:10:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:10:42.136547 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa258fed-5028-4c07-94e4-85143d0c1757 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:42.136976 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa258fed-5028-4c07-94e4-85143d0c1757 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:42.137135 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa258fed-5028-4c07-94e4-85143d0c1757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:42.166787 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-aa258fed-5028-4c07-94e4-85143d0c1757 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:10:42.167980 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-aa258fed-5028-4c07-94e4-85143d0c1757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:10:42.193093 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:42.246439 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 143/288] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:10:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 10:10:42.275486 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9ca23a-a813-470d-8679-c198ce11c13f None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:42.420025 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9ca23a-a813-470d-8679-c198ce11c13f None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:42.437552 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:42.467487 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f286d4-ed29-4701-9ea2-ef018baa27d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:42.468136 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f286d4-ed29-4701-9ea2-ef018baa27d0 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:42.468420 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f286d4-ed29-4701-9ea2-ef018baa27d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:42.468679 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f286d4-ed29-4701-9ea2-ef018baa27d0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:42.483657 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f286d4-ed29-4701-9ea2-ef018baa27d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 10:10:42.488525 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-22f286d4-ed29-4701-9ea2-ef018baa27d0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 10:10:42.488525 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:10:42.488525 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:10:42.488525 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:10:42.488525 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:10:42.488525 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:10:42.488525 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:10:42.488525 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:10:42.488525 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:10:42.488525 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:10:42.488525 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:10:42.488525 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:10:42.488525 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 10:10:42.488525 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 10:10:42.488525 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 10:10:42.488525 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 10:10:42.489400 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 10:10:42.489400 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 10:10:42.489400 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 10:10:42.489400 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 10:10:42.489400 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:10:42.489400 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:10:42.489400 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:10:42.489400 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:10:42.489400 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:10:42.489400 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:10:42.489400 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:10:42.489400 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:10:42.489400 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:10:42.489400 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:10:42.489400 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:10:42.489400 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:10:42.490235 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:10:42.490235 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:10:42.490235 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:10:42.490235 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:10:42.490235 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 10:10:42.490235 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 10:10:42.490235 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 10:10:42.490235 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 10:10:42.490235 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 10:10:42.490235 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 10:10:42.490235 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 10:10:42.490235 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:10:42.490235 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 146/289] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Aug 9 10:10:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:10:42.499017 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa258fed-5028-4c07-94e4-85143d0c1757 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:42.640599 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa258fed-5028-4c07-94e4-85143d0c1757 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:42.688528 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f564f2-0e89-48c2-b486-bd1840cd2429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:42.689132 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f564f2-0e89-48c2-b486-bd1840cd2429 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:42.689406 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f564f2-0e89-48c2-b486-bd1840cd2429 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:42.689677 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f564f2-0e89-48c2-b486-bd1840cd2429 None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:42.690365 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f564f2-0e89-48c2-b486-bd1840cd2429 None admin] RBAC: Adding query filter params (name=member) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:10:42.690661 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f564f2-0e89-48c2-b486-bd1840cd2429 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:42.692029 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f564f2-0e89-48c2-b486-bd1840cd2429 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:42.705525 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 144/290] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Aug 9 10:10:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:42.711053 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f286d4-ed29-4701-9ea2-ef018baa27d0 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:42.857037 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f286d4-ed29-4701-9ea2-ef018baa27d0 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:42.902699 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0985c3ff-9e66-4f99-a3de-f8c4f5349553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:42.903394 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0985c3ff-9e66-4f99-a3de-f8c4f5349553 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:42.903726 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0985c3ff-9e66-4f99-a3de-f8c4f5349553 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:42.904007 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0985c3ff-9e66-4f99-a3de-f8c4f5349553 None admin] PATH_INFO: `/v3/users/7970fb6ae80a4b6d89e257409e95126a` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:42.905189 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0985c3ff-9e66-4f99-a3de-f8c4f5349553 None admin] RBAC: Authorizing `identity:get_user(user_id=7970fb6ae80a4b6d89e257409e95126a)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:42.906683 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0985c3ff-9e66-4f99-a3de-f8c4f5349553 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:42.908570 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 147/291] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Aug 9 10:10:42 2022] GET /identity/v3/users/7970fb6ae80a4b6d89e257409e95126a => generated 297 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:42.913683 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f564f2-0e89-48c2-b486-bd1840cd2429 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:42.947516 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:43.069359 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f564f2-0e89-48c2-b486-bd1840cd2429 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:43.093417 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe692c17-7e60-4293-aecb-cede40800871 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:43.093725 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe692c17-7e60-4293-aecb-cede40800871 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:43.093979 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe692c17-7e60-4293-aecb-cede40800871 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:43.095314 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 148/292] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:10:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 10:10:43.100544 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd99445-7cfb-4538-822a-09c2ee875007 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:43.100823 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd99445-7cfb-4538-822a-09c2ee875007 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:43.101097 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd99445-7cfb-4538-822a-09c2ee875007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:43.126305 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3160bad2-3539-4cb5-b96e-a21ba131cf1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:43.126921 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3160bad2-3539-4cb5-b96e-a21ba131cf1b None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:43.127202 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3160bad2-3539-4cb5-b96e-a21ba131cf1b None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:43.133869 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3160bad2-3539-4cb5-b96e-a21ba131cf1b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:43.135068 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-bbd99445-7cfb-4538-822a-09c2ee875007 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:10:43.136504 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-bbd99445-7cfb-4538-822a-09c2ee875007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:10:43.200637 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3160bad2-3539-4cb5-b96e-a21ba131cf1b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:43.202248 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3160bad2-3539-4cb5-b96e-a21ba131cf1b None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:43.221561 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:43.222545 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:43.256144 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 149/293] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:10:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 10:10:43.259210 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5dbdf5-f74f-40ec-9bee-7125f9de1441 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:43.259493 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5dbdf5-f74f-40ec-9bee-7125f9de1441 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:43.259765 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5dbdf5-f74f-40ec-9bee-7125f9de1441 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:43.261181 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 150/294] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:10:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:10:43.266049 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590daf38-c733-454b-9388-c672df6dec04 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:43.266049 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590daf38-c733-454b-9388-c672df6dec04 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:43.266049 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590daf38-c733-454b-9388-c672df6dec04 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:43.266049 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 151/295] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:10:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:10:43.268811 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d71ac-09ae-4943-8045-f2d56b95accd None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:43.269116 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d71ac-09ae-4943-8045-f2d56b95accd None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:43.269527 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d71ac-09ae-4943-8045-f2d56b95accd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:43.289054 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-297d71ac-09ae-4943-8045-f2d56b95accd None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:10:43.290534 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-297d71ac-09ae-4943-8045-f2d56b95accd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:10:43.320117 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 145/296] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Aug 9 10:10:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 10:10:43.321242 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a53f880-2781-429d-8bf1-247804963068 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:43.321531 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a53f880-2781-429d-8bf1-247804963068 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:43.321878 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a53f880-2781-429d-8bf1-247804963068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:43.339904 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-2a53f880-2781-429d-8bf1-247804963068 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:10:43.341144 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-2a53f880-2781-429d-8bf1-247804963068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:10:43.366215 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 152/297] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:10:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 10:10:43.374046 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297d71ac-09ae-4943-8045-f2d56b95accd None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:43.422965 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 146/298] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:10:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 10:10:43.424026 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a53f880-2781-429d-8bf1-247804963068 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:43.484438 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:43.485316 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297d71ac-09ae-4943-8045-f2d56b95accd None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:43.487138 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:43.524972 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889bd349-3266-4935-afd5-d0892334cfdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:43.525607 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889bd349-3266-4935-afd5-d0892334cfdc None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:43.525910 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889bd349-3266-4935-afd5-d0892334cfdc None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:43.526183 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889bd349-3266-4935-afd5-d0892334cfdc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:43.536642 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a53f880-2781-429d-8bf1-247804963068 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:43.537078 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889bd349-3266-4935-afd5-d0892334cfdc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 10:10:43.542364 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-889bd349-3266-4935-afd5-d0892334cfdc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 10:10:43.542364 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:10:43.542364 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:10:43.542364 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:10:43.542364 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:10:43.542364 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:10:43.542364 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:10:43.542364 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:10:43.542364 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:10:43.542364 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:10:43.542364 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:10:43.542364 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:10:43.542364 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 10:10:43.542364 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 10:10:43.542364 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 10:10:43.542364 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 10:10:43.543275 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 10:10:43.543275 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 10:10:43.543275 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 10:10:43.543275 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 10:10:43.543275 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:10:43.543275 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:10:43.543275 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:10:43.543275 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:10:43.543275 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:10:43.543275 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:10:43.543275 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:10:43.543275 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:10:43.543275 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:10:43.543275 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:10:43.543275 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:10:43.543275 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:10:43.544069 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:10:43.544069 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:10:43.544069 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:10:43.544069 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:10:43.544069 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 10:10:43.544069 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 10:10:43.544069 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 10:10:43.544069 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 10:10:43.544069 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 10:10:43.544069 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 10:10:43.544069 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 10:10:43.544069 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:10:43.544069 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 153/299] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Aug 9 10:10:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:10:43.544823 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889bd349-3266-4935-afd5-d0892334cfdc None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:43.578422 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1b9cb8-de62-4cc5-bf08-774f4f6c7aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:43.579095 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b9cb8-de62-4cc5-bf08-774f4f6c7aa8 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:43.579378 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b9cb8-de62-4cc5-bf08-774f4f6c7aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:43.579660 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b9cb8-de62-4cc5-bf08-774f4f6c7aa8 None admin] PATH_INFO: `/v3/projects/a0b7ec3eb0324b10934f50e12805a4e4` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:43.580781 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1b9cb8-de62-4cc5-bf08-774f4f6c7aa8 None admin] RBAC: Authorizing `identity:get_project(project_id=a0b7ec3eb0324b10934f50e12805a4e4)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:43.582244 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1b9cb8-de62-4cc5-bf08-774f4f6c7aa8 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:43.584160 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 147/300] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Aug 9 10:10:43 2022] GET /identity/v3/projects/a0b7ec3eb0324b10934f50e12805a4e4 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:43.584931 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1b9cb8-de62-4cc5-bf08-774f4f6c7aa8 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:43.652549 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889bd349-3266-4935-afd5-d0892334cfdc None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:43.689786 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f09c094-da2a-42d5-893a-35d9fb73154f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:43.690646 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09c094-da2a-42d5-893a-35d9fb73154f None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:43.691070 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09c094-da2a-42d5-893a-35d9fb73154f None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:43.691484 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09c094-da2a-42d5-893a-35d9fb73154f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:43.691595 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1b9cb8-de62-4cc5-bf08-774f4f6c7aa8 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:43.703046 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f09c094-da2a-42d5-893a-35d9fb73154f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 10:10:43.708440 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:43.708669 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-9f09c094-da2a-42d5-893a-35d9fb73154f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 10:10:43.708669 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:10:43.708669 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:10:43.708669 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:10:43.708669 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:10:43.708669 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:10:43.708669 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:10:43.708669 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:10:43.708669 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:10:43.708669 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:10:43.708669 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:10:43.708669 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:10:43.708669 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 10:10:43.708669 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 10:10:43.708669 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 10:10:43.708669 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 10:10:43.709742 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 10:10:43.709742 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 10:10:43.709742 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 10:10:43.709742 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 10:10:43.709742 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:10:43.709742 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:10:43.709742 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:10:43.709742 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:10:43.709742 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:10:43.709742 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:10:43.709742 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:10:43.709742 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:10:43.709742 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:10:43.709742 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:10:43.709742 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:10:43.709742 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:10:43.710759 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:10:43.710759 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:10:43.710759 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:10:43.710759 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:10:43.710759 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 10:10:43.710759 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 10:10:43.710759 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 10:10:43.710759 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 10:10:43.710759 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 10:10:43.710759 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 10:10:43.710759 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 10:10:43.710759 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:10:43.713409 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 154/301] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Aug 9 10:10:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:10:43.714519 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f09c094-da2a-42d5-893a-35d9fb73154f None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:43.732690 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f577b616-6dcb-4b7b-9bc9-a6ef00c3b9b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:43.733539 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f577b616-6dcb-4b7b-9bc9-a6ef00c3b9b9 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:43.733820 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f577b616-6dcb-4b7b-9bc9-a6ef00c3b9b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:43.734122 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f577b616-6dcb-4b7b-9bc9-a6ef00c3b9b9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:43.735223 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f577b616-6dcb-4b7b-9bc9-a6ef00c3b9b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:43.736654 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f577b616-6dcb-4b7b-9bc9-a6ef00c3b9b9 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:43.742646 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 148/302] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:10:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:43.742646 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f577b616-6dcb-4b7b-9bc9-a6ef00c3b9b9 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:43.745226 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:43.833956 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f09c094-da2a-42d5-893a-35d9fb73154f None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:43.844639 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f577b616-6dcb-4b7b-9bc9-a6ef00c3b9b9 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:43.869899 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65769383-e61f-49ea-b60b-7af5ee5dbd8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:43.870509 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65769383-e61f-49ea-b60b-7af5ee5dbd8c None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:43.870792 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65769383-e61f-49ea-b60b-7af5ee5dbd8c None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:43.871062 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65769383-e61f-49ea-b60b-7af5ee5dbd8c None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:43.871880 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65769383-e61f-49ea-b60b-7af5ee5dbd8c None admin] RBAC: Adding query filter params (name=member) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:10:43.872184 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65769383-e61f-49ea-b60b-7af5ee5dbd8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:43.873612 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65769383-e61f-49ea-b60b-7af5ee5dbd8c None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:43.880431 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d10e8a8-2dad-461a-893a-3f688a7582f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:43.881027 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d10e8a8-2dad-461a-893a-3f688a7582f9 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:43.881301 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d10e8a8-2dad-461a-893a-3f688a7582f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:43.881569 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d10e8a8-2dad-461a-893a-3f688a7582f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:43.886694 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 155/303] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Aug 9 10:10:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:43.886827 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d10e8a8-2dad-461a-893a-3f688a7582f9 None admin] RBAC: Adding query filter params (role.id=a9895331e9694fa8b2b50908bb057bcb, scope.project.id=a0b7ec3eb0324b10934f50e12805a4e4, user.id=7970fb6ae80a4b6d89e257409e95126a) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:10:43.886827 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d10e8a8-2dad-461a-893a-3f688a7582f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:43.886992 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65769383-e61f-49ea-b60b-7af5ee5dbd8c None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:43.887061 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d10e8a8-2dad-461a-893a-3f688a7582f9 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:43.893167 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 149/304] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Aug 9 10:10:43 2022] GET /identity/v3/role_assignments?user.id=7970fb6ae80a4b6d89e257409e95126a&scope.project.id=a0b7ec3eb0324b10934f50e12805a4e4&role.id=a9895331e9694fa8b2b50908bb057bcb => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:43.893946 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d10e8a8-2dad-461a-893a-3f688a7582f9 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:43.952910 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:44.009199 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:44.016273 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d10e8a8-2dad-461a-893a-3f688a7582f9 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:44.028678 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65769383-e61f-49ea-b60b-7af5ee5dbd8c None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:44.061642 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565bfb01-ebcd-4b33-89dd-b0c15ddec063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:44.062545 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565bfb01-ebcd-4b33-89dd-b0c15ddec063 None admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:44.062970 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565bfb01-ebcd-4b33-89dd-b0c15ddec063 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:44.063402 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565bfb01-ebcd-4b33-89dd-b0c15ddec063 None admin] PATH_INFO: `/v3/groups` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:44.064180 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565bfb01-ebcd-4b33-89dd-b0c15ddec063 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:44.065638 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565bfb01-ebcd-4b33-89dd-b0c15ddec063 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:44.069219 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31645115-a9bf-470f-affa-b3703c7c4db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:44.069830 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31645115-a9bf-470f-affa-b3703c7c4db4 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:44.070128 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31645115-a9bf-470f-affa-b3703c7c4db4 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:44.070401 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31645115-a9bf-470f-affa-b3703c7c4db4 None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:44.071069 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31645115-a9bf-470f-affa-b3703c7c4db4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:10:44.071473 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31645115-a9bf-470f-affa-b3703c7c4db4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:44.072844 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31645115-a9bf-470f-affa-b3703c7c4db4 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:44.083554 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 156/305] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Aug 9 10:10:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:44.084488 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31645115-a9bf-470f-affa-b3703c7c4db4 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:44.086351 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 150/306] 10.222.0.36 () {60 vars in 1134 bytes} [Tue Aug 9 10:10:43 2022] POST /identity/v3/groups => generated 229 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:10:44.088845 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7be3ad5-71cc-4384-a985-b917bffcbeab None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:44.089367 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7be3ad5-71cc-4384-a985-b917bffcbeab None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:44.089841 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7be3ad5-71cc-4384-a985-b917bffcbeab None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:44.092074 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 151/307] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:10:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:10:44.098418 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a64e8-d78e-4726-a84d-12c6b664582c None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:44.098934 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a64e8-d78e-4726-a84d-12c6b664582c None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:44.099066 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a64e8-d78e-4726-a84d-12c6b664582c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:44.119206 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-914a64e8-d78e-4726-a84d-12c6b664582c None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:10:44.120429 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-914a64e8-d78e-4726-a84d-12c6b664582c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:10:44.211661 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31645115-a9bf-470f-affa-b3703c7c4db4 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:44.218220 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 152/308] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:10:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 10:10:44.219783 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914a64e8-d78e-4726-a84d-12c6b664582c None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:44.263562 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:44.265935 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6bffcc-fa62-4d93-87de-b0cf17756336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:44.266579 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6bffcc-fa62-4d93-87de-b0cf17756336 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:44.267605 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6bffcc-fa62-4d93-87de-b0cf17756336 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:44.267605 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6bffcc-fa62-4d93-87de-b0cf17756336 None admin] PATH_INFO: `/v3/users/1847193370904739a814cc84c1da8d90` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:44.268246 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6bffcc-fa62-4d93-87de-b0cf17756336 None admin] RBAC: Authorizing `identity:get_user(user_id=1847193370904739a814cc84c1da8d90)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:44.270209 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6bffcc-fa62-4d93-87de-b0cf17756336 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:44.271801 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 157/309] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Aug 9 10:10:44 2022] GET /identity/v3/users/1847193370904739a814cc84c1da8d90 => generated 293 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:44.272754 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6bffcc-fa62-4d93-87de-b0cf17756336 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:44.290984 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:44.335050 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914a64e8-d78e-4726-a84d-12c6b664582c None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:44.372660 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49efa2bf-788d-49ce-834f-2bb6b87e1cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:44.373408 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49efa2bf-788d-49ce-834f-2bb6b87e1cd2 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:44.373690 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49efa2bf-788d-49ce-834f-2bb6b87e1cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:44.373993 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49efa2bf-788d-49ce-834f-2bb6b87e1cd2 None admin] PATH_INFO: `/v3/users/e4ad14df44f840e69d5a5962e06b0128` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:44.382481 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6bffcc-fa62-4d93-87de-b0cf17756336 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:44.388085 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49efa2bf-788d-49ce-834f-2bb6b87e1cd2 None admin] RBAC: Authorizing `identity:get_user(user_id=e4ad14df44f840e69d5a5962e06b0128)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:44.389590 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49efa2bf-788d-49ce-834f-2bb6b87e1cd2 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:44.391433 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 153/310] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Aug 9 10:10:44 2022] GET /identity/v3/users/e4ad14df44f840e69d5a5962e06b0128 => generated 293 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:44.392070 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49efa2bf-788d-49ce-834f-2bb6b87e1cd2 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:44.426264 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e28ca02-2e6f-43b3-95e5-a7e259abaedb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:44.426890 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28ca02-2e6f-43b3-95e5-a7e259abaedb None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:44.427172 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28ca02-2e6f-43b3-95e5-a7e259abaedb None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:44.427446 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28ca02-2e6f-43b3-95e5-a7e259abaedb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:44.438690 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e28ca02-2e6f-43b3-95e5-a7e259abaedb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 10:10:44.444306 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-6e28ca02-2e6f-43b3-95e5-a7e259abaedb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 10:10:44.444306 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:10:44.444306 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:10:44.444306 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:10:44.444306 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:10:44.444306 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:10:44.444306 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:10:44.444306 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:10:44.444306 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:10:44.444306 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:10:44.444306 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:10:44.444306 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:10:44.444306 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 10:10:44.444306 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 10:10:44.444306 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 10:10:44.444306 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 10:10:44.445275 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 10:10:44.445275 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 10:10:44.445275 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 10:10:44.445275 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 10:10:44.445275 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:10:44.445275 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:10:44.445275 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:10:44.445275 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:10:44.445275 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:10:44.445275 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:10:44.445275 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:10:44.445275 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:10:44.445275 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:10:44.445275 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:10:44.445275 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:10:44.445275 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:10:44.446092 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:10:44.446092 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:10:44.446092 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:10:44.446092 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:10:44.446092 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 10:10:44.446092 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 10:10:44.446092 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 10:10:44.446092 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 10:10:44.446092 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 10:10:44.446092 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 10:10:44.446092 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 10:10:44.446092 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:10:44.446092 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 158/311] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Aug 9 10:10:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:10:44.446734 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e28ca02-2e6f-43b3-95e5-a7e259abaedb None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:44.491724 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:44.499630 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49efa2bf-788d-49ce-834f-2bb6b87e1cd2 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:44.526538 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:44.537564 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f3b2cb-87a2-4f87-8791-813eb6e299ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:44.538252 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f3b2cb-87a2-4f87-8791-813eb6e299ff None admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:44.538533 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f3b2cb-87a2-4f87-8791-813eb6e299ff None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:44.538802 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f3b2cb-87a2-4f87-8791-813eb6e299ff None admin] PATH_INFO: `/v3/system/users/1847193370904739a814cc84c1da8d90/roles/a9895331e9694fa8b2b50908bb057bcb` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:44.540859 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f3b2cb-87a2-4f87-8791-813eb6e299ff None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=1847193370904739a814cc84c1da8d90, role_id=a9895331e9694fa8b2b50908bb057bcb)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:44.542408 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f3b2cb-87a2-4f87-8791-813eb6e299ff None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:44.552543 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e28ca02-2e6f-43b3-95e5-a7e259abaedb None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:44.558153 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 154/312] 10.222.0.36 () {58 vars in 1334 bytes} [Tue Aug 9 10:10:44 2022] PUT /identity/v3/system/users/1847193370904739a814cc84c1da8d90/roles/a9895331e9694fa8b2b50908bb057bcb => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:10:44.558153 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f3b2cb-87a2-4f87-8791-813eb6e299ff None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:44.591127 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e651266-6a00-4e1d-8382-2652c546b338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:44.591825 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e651266-6a00-4e1d-8382-2652c546b338 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:44.592088 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e651266-6a00-4e1d-8382-2652c546b338 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:44.592364 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e651266-6a00-4e1d-8382-2652c546b338 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:44.593146 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e651266-6a00-4e1d-8382-2652c546b338 None admin] RBAC: Adding query filter params (role.id=b2850f278b2d4b32b2b56324509a5a01, user.id=e4ad14df44f840e69d5a5962e06b0128, scope.system=all) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:10:44.593461 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e651266-6a00-4e1d-8382-2652c546b338 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:44.595032 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e651266-6a00-4e1d-8382-2652c546b338 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:44.608200 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 159/313] 10.222.0.36 () {56 vars in 1308 bytes} [Tue Aug 9 10:10:44 2022] GET /identity/v3/role_assignments?user.id=e4ad14df44f840e69d5a5962e06b0128&scope.system=all&role.id=b2850f278b2d4b32b2b56324509a5a01 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:44.696547 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f3b2cb-87a2-4f87-8791-813eb6e299ff None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:44.735582 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cb519d-22e8-43a0-971b-bb86aea44374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:44.736243 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb519d-22e8-43a0-971b-bb86aea44374 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:44.736519 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb519d-22e8-43a0-971b-bb86aea44374 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:44.736834 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb519d-22e8-43a0-971b-bb86aea44374 None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:44.737511 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cb519d-22e8-43a0-971b-bb86aea44374 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:10:44.737811 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cb519d-22e8-43a0-971b-bb86aea44374 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:44.739217 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cb519d-22e8-43a0-971b-bb86aea44374 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:44.749989 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 155/314] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Aug 9 10:10:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:44.758406 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e651266-6a00-4e1d-8382-2652c546b338 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:44.886461 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e651266-6a00-4e1d-8382-2652c546b338 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:44.922357 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9523c76-d434-449c-bf74-902c15190815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:44.922982 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9523c76-d434-449c-bf74-902c15190815 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:44.923255 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9523c76-d434-449c-bf74-902c15190815 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:44.923522 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9523c76-d434-449c-bf74-902c15190815 None admin] PATH_INFO: `/v3/users/ca63eb4c1fdf4dbb9fca729e4801ad47` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:44.924645 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9523c76-d434-449c-bf74-902c15190815 None admin] RBAC: Authorizing `identity:get_user(user_id=ca63eb4c1fdf4dbb9fca729e4801ad47)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:44.926105 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9523c76-d434-449c-bf74-902c15190815 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:44.927978 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 160/315] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Aug 9 10:10:44 2022] GET /identity/v3/users/ca63eb4c1fdf4dbb9fca729e4801ad47 => generated 297 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:44.933235 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cb519d-22e8-43a0-971b-bb86aea44374 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:44.963319 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:45.056878 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cb519d-22e8-43a0-971b-bb86aea44374 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:45.093881 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfe7f7b-3edf-43e8-9987-6e4203e8ac1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:45.094827 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfe7f7b-3edf-43e8-9987-6e4203e8ac1f None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:45.095299 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfe7f7b-3edf-43e8-9987-6e4203e8ac1f None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:45.095756 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfe7f7b-3edf-43e8-9987-6e4203e8ac1f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:45.164632 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfe7f7b-3edf-43e8-9987-6e4203e8ac1f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:45.166749 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfe7f7b-3edf-43e8-9987-6e4203e8ac1f None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:45.198210 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:45.275004 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 156/316] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Aug 9 10:10:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 10:10:45.280609 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9523c76-d434-449c-bf74-902c15190815 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:45.290823 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:45.389038 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9523c76-d434-449c-bf74-902c15190815 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:45.423924 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41c18a7-b7b5-435d-a1dc-de30229ea81e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:45.424548 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c18a7-b7b5-435d-a1dc-de30229ea81e None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:45.424823 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c18a7-b7b5-435d-a1dc-de30229ea81e None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:45.425089 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c18a7-b7b5-435d-a1dc-de30229ea81e None admin] PATH_INFO: `/v3/projects/a0b7ec3eb0324b10934f50e12805a4e4` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:45.426219 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41c18a7-b7b5-435d-a1dc-de30229ea81e None admin] RBAC: Authorizing `identity:get_project(project_id=a0b7ec3eb0324b10934f50e12805a4e4)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:45.427644 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41c18a7-b7b5-435d-a1dc-de30229ea81e None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:45.429561 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 161/317] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Aug 9 10:10:45 2022] GET /identity/v3/projects/a0b7ec3eb0324b10934f50e12805a4e4 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:45.435399 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfe7f7b-3edf-43e8-9987-6e4203e8ac1f None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:45.538220 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfe7f7b-3edf-43e8-9987-6e4203e8ac1f None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:45.562008 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:45.573687 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f5f16e-557d-4b12-b2ba-58d75f6b509e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:45.574353 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f5f16e-557d-4b12-b2ba-58d75f6b509e None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:45.575088 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f5f16e-557d-4b12-b2ba-58d75f6b509e None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:45.575412 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f5f16e-557d-4b12-b2ba-58d75f6b509e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:45.576528 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f5f16e-557d-4b12-b2ba-58d75f6b509e None admin] RBAC: Adding query filter params (role.id=b2850f278b2d4b32b2b56324509a5a01, scope.project.id=a0b7ec3eb0324b10934f50e12805a4e4, user.id=ca63eb4c1fdf4dbb9fca729e4801ad47) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:10:45.577169 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f5f16e-557d-4b12-b2ba-58d75f6b509e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:45.578637 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f5f16e-557d-4b12-b2ba-58d75f6b509e None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:45.584720 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 157/318] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Aug 9 10:10:45 2022] GET /identity/v3/role_assignments?user.id=ca63eb4c1fdf4dbb9fca729e4801ad47&scope.project.id=a0b7ec3eb0324b10934f50e12805a4e4&role.id=b2850f278b2d4b32b2b56324509a5a01 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:46.203904 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961e8e5a-922c-4982-a44d-69834e144d22 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:46.204092 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961e8e5a-922c-4982-a44d-69834e144d22 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:46.204359 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961e8e5a-922c-4982-a44d-69834e144d22 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:46.205703 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 162/319] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:10:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:10:46.210997 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff805f39-5c4c-4f88-b4bb-e5c2346ee64d None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:46.211288 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff805f39-5c4c-4f88-b4bb-e5c2346ee64d None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:46.211565 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff805f39-5c4c-4f88-b4bb-e5c2346ee64d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:46.229227 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-ff805f39-5c4c-4f88-b4bb-e5c2346ee64d None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:10:46.230437 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-ff805f39-5c4c-4f88-b4bb-e5c2346ee64d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:10:46.302049 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 158/320] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:10:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 10:10:46.322419 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961e8e5a-922c-4982-a44d-69834e144d22 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:46.399892 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:46.429334 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961e8e5a-922c-4982-a44d-69834e144d22 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:46.462672 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f837e12a-7387-4644-b385-fbb024c78d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:46.463223 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f837e12a-7387-4644-b385-fbb024c78d7b None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:46.463500 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f837e12a-7387-4644-b385-fbb024c78d7b None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:46.463767 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f837e12a-7387-4644-b385-fbb024c78d7b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:46.464854 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f837e12a-7387-4644-b385-fbb024c78d7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:46.466976 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f837e12a-7387-4644-b385-fbb024c78d7b None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:46.468695 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 163/321] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:10:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:46.474189 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff805f39-5c4c-4f88-b4bb-e5c2346ee64d None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:46.572916 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff805f39-5c4c-4f88-b4bb-e5c2346ee64d None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:46.590085 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:46.609515 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca96bbc4-084c-4382-bd4a-ce75a1a94494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:46.610155 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca96bbc4-084c-4382-bd4a-ce75a1a94494 None admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:46.610434 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca96bbc4-084c-4382-bd4a-ce75a1a94494 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:46.610708 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca96bbc4-084c-4382-bd4a-ce75a1a94494 None admin] PATH_INFO: `/v3/groups` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:46.611339 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca96bbc4-084c-4382-bd4a-ce75a1a94494 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:46.612789 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca96bbc4-084c-4382-bd4a-ce75a1a94494 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:46.629284 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 159/322] 10.222.0.36 () {60 vars in 1134 bytes} [Tue Aug 9 10:10:46 2022] POST /identity/v3/groups => generated 226 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 10:10:46.732428 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5f36da-1ba2-4c4b-9c6a-644243247fb1 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:46.732746 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5f36da-1ba2-4c4b-9c6a-644243247fb1 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:46.732875 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5f36da-1ba2-4c4b-9c6a-644243247fb1 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:46.734412 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 164/323] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:10:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:10:46.739786 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603fad68-d62e-4314-8ab4-35967b7d9805 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:46.740078 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603fad68-d62e-4314-8ab4-35967b7d9805 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:46.740358 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603fad68-d62e-4314-8ab4-35967b7d9805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:46.759272 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-603fad68-d62e-4314-8ab4-35967b7d9805 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:10:46.760478 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-603fad68-d62e-4314-8ab4-35967b7d9805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:10:46.808698 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d41b7ca-3388-496b-be32-2f237c249fae None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:46.809089 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d41b7ca-3388-496b-be32-2f237c249fae None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:46.809544 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d41b7ca-3388-496b-be32-2f237c249fae None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:46.811296 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 165/324] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:10:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 10:10:46.816571 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de07a50-bb57-4908-ad0a-917df34022c2 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:46.817110 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de07a50-bb57-4908-ad0a-917df34022c2 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:46.817460 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de07a50-bb57-4908-ad0a-917df34022c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:46.835146 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 160/325] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:10:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 10:10:46.841465 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-6de07a50-bb57-4908-ad0a-917df34022c2 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:10:46.842746 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-6de07a50-bb57-4908-ad0a-917df34022c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:10:46.858642 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603fad68-d62e-4314-8ab4-35967b7d9805 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:46.926339 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 166/326] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:10:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 10:10:46.947116 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de07a50-bb57-4908-ad0a-917df34022c2 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:46.993445 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603fad68-d62e-4314-8ab4-35967b7d9805 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:47.003345 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:47.038758 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:47.041043 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a96142-ee1e-484d-92db-9647c41294b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:47.041927 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a96142-ee1e-484d-92db-9647c41294b5 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:47.042425 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a96142-ee1e-484d-92db-9647c41294b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:47.042979 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a96142-ee1e-484d-92db-9647c41294b5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:47.058320 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a96142-ee1e-484d-92db-9647c41294b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 10:10:47.063877 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-43a96142-ee1e-484d-92db-9647c41294b5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 10:10:47.063877 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:10:47.063877 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:10:47.063877 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:10:47.063877 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:10:47.063877 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:10:47.063877 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:10:47.063877 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:10:47.063877 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:10:47.063877 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:10:47.063877 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:10:47.063877 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:10:47.063877 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 10:10:47.063877 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 10:10:47.063877 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 10:10:47.063877 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 10:10:47.064774 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 10:10:47.064774 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 10:10:47.064774 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 10:10:47.064774 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 10:10:47.064774 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:10:47.064774 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:10:47.064774 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:10:47.064774 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:10:47.064774 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:10:47.064774 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:10:47.064774 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:10:47.064774 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:10:47.064774 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:10:47.064774 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:10:47.064774 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:10:47.064774 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:10:47.065545 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:10:47.065545 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:10:47.065545 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:10:47.065545 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:10:47.065545 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 10:10:47.065545 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 10:10:47.065545 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 10:10:47.065545 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 10:10:47.065545 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 10:10:47.065545 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 10:10:47.065545 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 10:10:47.065545 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:10:47.065545 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 161/327] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Aug 9 10:10:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 10:10:47.071261 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a96142-ee1e-484d-92db-9647c41294b5 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:47.076800 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de07a50-bb57-4908-ad0a-917df34022c2 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:47.120599 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122dc41c-016b-44ee-86c8-0f6f733032c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:47.122335 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122dc41c-016b-44ee-86c8-0f6f733032c3 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:47.123144 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122dc41c-016b-44ee-86c8-0f6f733032c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:47.123888 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122dc41c-016b-44ee-86c8-0f6f733032c3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:47.139040 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122dc41c-016b-44ee-86c8-0f6f733032c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 10:10:47.144113 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-122dc41c-016b-44ee-86c8-0f6f733032c3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 10:10:47.144113 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:10:47.144113 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:10:47.144113 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:10:47.144113 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:10:47.144113 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:10:47.144113 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:10:47.144113 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:10:47.144113 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:10:47.144113 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:10:47.144113 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:10:47.144113 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:10:47.144113 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 10:10:47.144113 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 10:10:47.144113 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 10:10:47.144113 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 10:10:47.144987 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 10:10:47.144987 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 10:10:47.144987 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 10:10:47.144987 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 10:10:47.144987 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:10:47.144987 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:10:47.144987 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:10:47.144987 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:10:47.144987 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:10:47.144987 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:10:47.144987 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:10:47.144987 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:10:47.144987 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:10:47.144987 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:10:47.144987 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:10:47.144987 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:10:47.145761 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:10:47.145761 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:10:47.145761 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:10:47.145761 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:10:47.145761 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 10:10:47.145761 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 10:10:47.145761 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 10:10:47.145761 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 10:10:47.145761 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 10:10:47.145761 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 10:10:47.145761 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 10:10:47.145761 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:10:47.145761 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 167/328] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Aug 9 10:10:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 10:10:47.151012 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122dc41c-016b-44ee-86c8-0f6f733032c3 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:47.198643 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a96142-ee1e-484d-92db-9647c41294b5 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:47.242797 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34d7140-140d-4be0-a106-5daad3432e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:47.243410 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d7140-140d-4be0-a106-5daad3432e0b None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:47.243741 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d7140-140d-4be0-a106-5daad3432e0b None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:47.243963 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d7140-140d-4be0-a106-5daad3432e0b None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:47.244738 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34d7140-140d-4be0-a106-5daad3432e0b None admin] RBAC: Adding query filter params (name=member) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:10:47.245097 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34d7140-140d-4be0-a106-5daad3432e0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:47.246550 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34d7140-140d-4be0-a106-5daad3432e0b None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:47.256336 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 162/329] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Aug 9 10:10:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:10:47.261538 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34d7140-140d-4be0-a106-5daad3432e0b None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:47.273431 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122dc41c-016b-44ee-86c8-0f6f733032c3 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:47.294384 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:47.308355 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:47.314864 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04e6375-0b77-490b-8d07-f5639d55c1be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:47.315573 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04e6375-0b77-490b-8d07-f5639d55c1be None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:47.315950 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04e6375-0b77-490b-8d07-f5639d55c1be None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:47.316232 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04e6375-0b77-490b-8d07-f5639d55c1be None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:47.316904 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04e6375-0b77-490b-8d07-f5639d55c1be None admin] RBAC: Adding query filter params (name=reader) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:10:47.317210 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04e6375-0b77-490b-8d07-f5639d55c1be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:47.318698 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04e6375-0b77-490b-8d07-f5639d55c1be None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:47.329008 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 168/330] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Aug 9 10:10:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:47.335509 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04e6375-0b77-490b-8d07-f5639d55c1be None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:47.389440 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34d7140-140d-4be0-a106-5daad3432e0b None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:47.432145 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2041275e-4fdc-41b9-8f00-abbee091bba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:47.432787 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2041275e-4fdc-41b9-8f00-abbee091bba3 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:47.433070 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2041275e-4fdc-41b9-8f00-abbee091bba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:47.433348 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2041275e-4fdc-41b9-8f00-abbee091bba3 None admin] PATH_INFO: `/v3/users/1847193370904739a814cc84c1da8d90` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:47.436066 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2041275e-4fdc-41b9-8f00-abbee091bba3 None admin] RBAC: Authorizing `identity:get_user(user_id=1847193370904739a814cc84c1da8d90)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:47.437550 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2041275e-4fdc-41b9-8f00-abbee091bba3 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:47.439590 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 163/331] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Aug 9 10:10:47 2022] GET /identity/v3/users/1847193370904739a814cc84c1da8d90 => generated 293 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:47.445732 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2041275e-4fdc-41b9-8f00-abbee091bba3 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:47.462129 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04e6375-0b77-490b-8d07-f5639d55c1be None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:47.503375 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8211071-8275-43b8-b5de-479038ec9175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:47.503933 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8211071-8275-43b8-b5de-479038ec9175 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:47.504208 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8211071-8275-43b8-b5de-479038ec9175 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:47.504476 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8211071-8275-43b8-b5de-479038ec9175 None admin] PATH_INFO: `/v3/users/e4ad14df44f840e69d5a5962e06b0128` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:47.505600 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8211071-8275-43b8-b5de-479038ec9175 None admin] RBAC: Authorizing `identity:get_user(user_id=e4ad14df44f840e69d5a5962e06b0128)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:47.507079 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8211071-8275-43b8-b5de-479038ec9175 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:47.513942 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 169/332] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Aug 9 10:10:47 2022] GET /identity/v3/users/e4ad14df44f840e69d5a5962e06b0128 => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:47.515204 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8211071-8275-43b8-b5de-479038ec9175 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:47.572159 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:47.581643 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2041275e-4fdc-41b9-8f00-abbee091bba3 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:47.582874 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:47.625429 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8211071-8275-43b8-b5de-479038ec9175 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:47.631464 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f84f16-2583-460f-89da-02cbb03b2392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:47.632382 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f84f16-2583-460f-89da-02cbb03b2392 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:47.632861 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f84f16-2583-460f-89da-02cbb03b2392 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:47.633329 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f84f16-2583-460f-89da-02cbb03b2392 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:47.634731 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f84f16-2583-460f-89da-02cbb03b2392 None admin] RBAC: Adding query filter params (role.id=a9895331e9694fa8b2b50908bb057bcb, user.id=1847193370904739a814cc84c1da8d90, scope.system=all) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:10:47.635262 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f84f16-2583-460f-89da-02cbb03b2392 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:47.637912 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f84f16-2583-460f-89da-02cbb03b2392 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:47.656958 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 164/333] 10.222.0.36 () {56 vars in 1308 bytes} [Tue Aug 9 10:10:47 2022] GET /identity/v3/role_assignments?user.id=1847193370904739a814cc84c1da8d90&scope.system=all&role.id=a9895331e9694fa8b2b50908bb057bcb => generated 510 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:47.691514 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c4f324-79e1-4efc-8179-dcce7ef4f3d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:47.692183 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c4f324-79e1-4efc-8179-dcce7ef4f3d7 None admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:47.692460 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c4f324-79e1-4efc-8179-dcce7ef4f3d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:47.692727 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c4f324-79e1-4efc-8179-dcce7ef4f3d7 None admin] PATH_INFO: `/v3/system/users/e4ad14df44f840e69d5a5962e06b0128/roles/b2850f278b2d4b32b2b56324509a5a01` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:47.694158 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c4f324-79e1-4efc-8179-dcce7ef4f3d7 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=e4ad14df44f840e69d5a5962e06b0128, role_id=b2850f278b2d4b32b2b56324509a5a01)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:47.695596 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c4f324-79e1-4efc-8179-dcce7ef4f3d7 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:47.717001 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 170/334] 10.222.0.36 () {58 vars in 1334 bytes} [Tue Aug 9 10:10:47 2022] PUT /identity/v3/system/users/e4ad14df44f840e69d5a5962e06b0128/roles/b2850f278b2d4b32b2b56324509a5a01 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 10:10:49.230956 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2095a6c4-0851-4b3e-bcfa-e07b41a891f1 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:49.231438 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2095a6c4-0851-4b3e-bcfa-e07b41a891f1 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:49.231438 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2095a6c4-0851-4b3e-bcfa-e07b41a891f1 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:49.233122 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 165/335] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:10:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:10:49.238728 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7cd5ff-4549-4fd1-a3a4-f2a36fc36827 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:49.239146 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7cd5ff-4549-4fd1-a3a4-f2a36fc36827 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:49.239218 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7cd5ff-4549-4fd1-a3a4-f2a36fc36827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:49.264723 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-ca7cd5ff-4549-4fd1-a3a4-f2a36fc36827 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:10:49.265934 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-ca7cd5ff-4549-4fd1-a3a4-f2a36fc36827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:10:49.346997 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 171/336] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:10:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 10:10:49.382634 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2095a6c4-0851-4b3e-bcfa-e07b41a891f1 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:49.414762 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68394dec-214a-42a2-aeac-abb929fd70b6 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:49.415065 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68394dec-214a-42a2-aeac-abb929fd70b6 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:49.415555 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68394dec-214a-42a2-aeac-abb929fd70b6 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:49.417010 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 172/337] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:10:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 10:10:49.422152 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae2584-7621-4e38-8a77-9421f6ae02ab None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:49.422433 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae2584-7621-4e38-8a77-9421f6ae02ab None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:49.422708 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae2584-7621-4e38-8a77-9421f6ae02ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:49.443076 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-3bae2584-7621-4e38-8a77-9421f6ae02ab None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:10:49.444390 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-3bae2584-7621-4e38-8a77-9421f6ae02ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:10:49.537301 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:49.559822 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 173/338] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:10:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 10:10:49.560467 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2095a6c4-0851-4b3e-bcfa-e07b41a891f1 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:49.588351 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bae2584-7621-4e38-8a77-9421f6ae02ab None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:49.646070 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0941bbc8-4a27-4502-9b80-b75020aaafb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:49.646774 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0941bbc8-4a27-4502-9b80-b75020aaafb7 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:49.647057 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0941bbc8-4a27-4502-9b80-b75020aaafb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:49.647327 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0941bbc8-4a27-4502-9b80-b75020aaafb7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:49.676910 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0941bbc8-4a27-4502-9b80-b75020aaafb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 10:10:49.682324 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-0941bbc8-4a27-4502-9b80-b75020aaafb7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 10:10:49.682324 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:10:49.682324 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:10:49.682324 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:10:49.682324 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:10:49.682324 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:10:49.682324 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:10:49.682324 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:10:49.682324 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:10:49.682324 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:10:49.682324 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:10:49.682324 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:10:49.682324 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 10:10:49.682324 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 10:10:49.682324 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 10:10:49.682324 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 10:10:49.683327 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 10:10:49.683327 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 10:10:49.683327 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 10:10:49.683327 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 10:10:49.683327 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:10:49.683327 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:10:49.683327 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:10:49.683327 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:10:49.683327 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:10:49.683327 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:10:49.683327 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:10:49.683327 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:10:49.683327 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:10:49.683327 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:10:49.683327 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:10:49.683327 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:10:49.684203 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:10:49.684203 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:10:49.684203 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:10:49.684203 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:10:49.684203 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 10:10:49.684203 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 10:10:49.684203 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 10:10:49.684203 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 10:10:49.684203 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 10:10:49.684203 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 10:10:49.684203 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 10:10:49.684203 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:10:49.684203 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 166/339] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Aug 9 10:10:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 10:10:49.690601 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0941bbc8-4a27-4502-9b80-b75020aaafb7 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:49.710385 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:49.777733 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bae2584-7621-4e38-8a77-9421f6ae02ab None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:49.837053 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98153bba-e0c1-4dc9-92e4-f1c144a19d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:49.839536 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98153bba-e0c1-4dc9-92e4-f1c144a19d5f None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:49.841259 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98153bba-e0c1-4dc9-92e4-f1c144a19d5f None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:49.841770 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98153bba-e0c1-4dc9-92e4-f1c144a19d5f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:49.843227 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0941bbc8-4a27-4502-9b80-b75020aaafb7 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:49.863922 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98153bba-e0c1-4dc9-92e4-f1c144a19d5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 10:10:49.871780 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-98153bba-e0c1-4dc9-92e4-f1c144a19d5f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 10:10:49.871780 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:10:49.871780 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:10:49.871780 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:10:49.871780 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:10:49.871780 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:10:49.871780 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:10:49.871780 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:10:49.871780 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:10:49.871780 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:10:49.871780 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:10:49.871780 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:10:49.871780 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 10:10:49.871780 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 10:10:49.871780 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 10:10:49.871780 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 10:10:49.872667 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 10:10:49.872667 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 10:10:49.872667 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 10:10:49.872667 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 10:10:49.872667 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:10:49.872667 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:10:49.872667 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:10:49.872667 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:10:49.872667 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:10:49.872667 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:10:49.872667 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:10:49.872667 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:10:49.872667 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:10:49.872667 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:10:49.872667 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:10:49.872667 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:10:49.873486 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:10:49.873486 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:10:49.873486 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:10:49.873486 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:10:49.873486 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 10:10:49.873486 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 10:10:49.873486 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 10:10:49.873486 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 10:10:49.873486 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 10:10:49.873486 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 10:10:49.873486 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 10:10:49.873486 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:10:49.875282 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 174/340] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Aug 9 10:10:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:10:49.881701 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98153bba-e0c1-4dc9-92e4-f1c144a19d5f None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:49.918057 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782e1409-97eb-43ad-a58d-a1da1cf63bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:49.919698 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782e1409-97eb-43ad-a58d-a1da1cf63bdc None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:49.921134 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782e1409-97eb-43ad-a58d-a1da1cf63bdc None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:49.922759 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782e1409-97eb-43ad-a58d-a1da1cf63bdc None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:49.923639 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782e1409-97eb-43ad-a58d-a1da1cf63bdc None admin] RBAC: Adding query filter params (name=member) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:10:49.924365 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782e1409-97eb-43ad-a58d-a1da1cf63bdc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:49.926631 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782e1409-97eb-43ad-a58d-a1da1cf63bdc None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:49.940376 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 167/341] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Aug 9 10:10:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:10:49.946308 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782e1409-97eb-43ad-a58d-a1da1cf63bdc None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:49.975708 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:50.081977 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98153bba-e0c1-4dc9-92e4-f1c144a19d5f None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:50.097075 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:50.138449 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782e1409-97eb-43ad-a58d-a1da1cf63bdc None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:50.171505 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad747cd4-efce-44ff-820d-7369142995bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:50.172121 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad747cd4-efce-44ff-820d-7369142995bf None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:50.172399 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad747cd4-efce-44ff-820d-7369142995bf None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:50.172670 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad747cd4-efce-44ff-820d-7369142995bf None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:50.173335 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad747cd4-efce-44ff-820d-7369142995bf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:10:50.173637 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad747cd4-efce-44ff-820d-7369142995bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:50.175040 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad747cd4-efce-44ff-820d-7369142995bf None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:50.178424 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1416e8a-c700-4848-8f69-987be3633267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:50.179027 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1416e8a-c700-4848-8f69-987be3633267 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:50.179306 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1416e8a-c700-4848-8f69-987be3633267 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:50.179580 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1416e8a-c700-4848-8f69-987be3633267 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:50.193295 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 175/342] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Aug 9 10:10:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:10:50.219927 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad747cd4-efce-44ff-820d-7369142995bf None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:50.263674 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1416e8a-c700-4848-8f69-987be3633267 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:50.265259 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1416e8a-c700-4848-8f69-987be3633267 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:50.371949 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:50.418432 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 168/343] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Aug 9 10:10:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 09 10:10:50.419791 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8676d86c-90e1-4e61-a00f-4b74a244babd None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:50.420078 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8676d86c-90e1-4e61-a00f-4b74a244babd None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:50.420365 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8676d86c-90e1-4e61-a00f-4b74a244babd None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:50.421612 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 169/344] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:10:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:10:50.427779 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8c4a86-1683-470b-ae95-28049fbc4e63 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:50.428062 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8c4a86-1683-470b-ae95-28049fbc4e63 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:50.428336 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8c4a86-1683-470b-ae95-28049fbc4e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:50.447100 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-6f8c4a86-1683-470b-ae95-28049fbc4e63 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:10:50.448308 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-6f8c4a86-1683-470b-ae95-28049fbc4e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:10:50.452212 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad747cd4-efce-44ff-820d-7369142995bf None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:50.471863 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:50.529741 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 170/345] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:10:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 10:10:50.530886 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8c4a86-1683-470b-ae95-28049fbc4e63 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:50.546572 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e82c1b6-76aa-49a8-b074-e76a0d554583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:50.547529 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e82c1b6-76aa-49a8-b074-e76a0d554583 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:50.548015 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e82c1b6-76aa-49a8-b074-e76a0d554583 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:50.548516 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e82c1b6-76aa-49a8-b074-e76a0d554583 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:50.641015 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8c4a86-1683-470b-ae95-28049fbc4e63 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:50.648831 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:50.680726 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fecae06-a4a4-47b8-be90-fe992e878d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:50.681457 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fecae06-a4a4-47b8-be90-fe992e878d96 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:50.681742 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fecae06-a4a4-47b8-be90-fe992e878d96 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:50.682040 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fecae06-a4a4-47b8-be90-fe992e878d96 None admin] PATH_INFO: `/v3/projects/5a0951c053754bea9df8fb8448e1b42f` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:50.683444 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fecae06-a4a4-47b8-be90-fe992e878d96 None admin] RBAC: Authorizing `identity:get_project(project_id=5a0951c053754bea9df8fb8448e1b42f)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:50.684976 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fecae06-a4a4-47b8-be90-fe992e878d96 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:50.687173 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 171/346] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Aug 9 10:10:50 2022] GET /identity/v3/projects/5a0951c053754bea9df8fb8448e1b42f => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:50.687950 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fecae06-a4a4-47b8-be90-fe992e878d96 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:50.702889 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e82c1b6-76aa-49a8-b074-e76a0d554583 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:50.704692 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e82c1b6-76aa-49a8-b074-e76a0d554583 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:50.800074 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fecae06-a4a4-47b8-be90-fe992e878d96 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:50.844963 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8976c81e-1bb3-4f7c-b441-fde56a5829a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:50.845600 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8976c81e-1bb3-4f7c-b441-fde56a5829a9 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:50.845898 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8976c81e-1bb3-4f7c-b441-fde56a5829a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:50.846174 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8976c81e-1bb3-4f7c-b441-fde56a5829a9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:50.869063 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8976c81e-1bb3-4f7c-b441-fde56a5829a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 10:10:50.875225 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-8976c81e-1bb3-4f7c-b441-fde56a5829a9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 10:10:50.875225 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:10:50.875225 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:10:50.875225 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:10:50.875225 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:10:50.875225 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:10:50.875225 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:10:50.875225 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:10:50.875225 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:10:50.875225 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:10:50.875225 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:10:50.875225 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:10:50.875225 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 10:10:50.875225 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 10:10:50.875225 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 10:10:50.875225 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 10:10:50.876129 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 10:10:50.876129 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 10:10:50.876129 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 10:10:50.876129 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 10:10:50.876129 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:10:50.876129 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:10:50.876129 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:10:50.876129 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:10:50.876129 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:10:50.876129 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:10:50.876129 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:10:50.876129 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:10:50.876129 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:10:50.876129 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:10:50.876129 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:10:50.876129 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:10:50.876933 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:10:50.876933 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:10:50.876933 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:10:50.876933 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:10:50.876933 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 10:10:50.876933 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 10:10:50.876933 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 10:10:50.876933 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 10:10:50.876933 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 10:10:50.876933 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 10:10:50.876933 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 10:10:50.876933 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:10:50.876933 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 172/347] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Aug 9 10:10:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:10:50.877601 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8976c81e-1bb3-4f7c-b441-fde56a5829a9 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:50.908440 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 176/348] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Aug 9 10:10:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 689 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 09 10:10:50.909386 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e82c1b6-76aa-49a8-b074-e76a0d554583 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:50.922213 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:50.944738 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:51.036559 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8976c81e-1bb3-4f7c-b441-fde56a5829a9 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:51.059585 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e82c1b6-76aa-49a8-b074-e76a0d554583 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:51.080408 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a51e024-472c-4b08-9e04-07ea978208d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:51.081107 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a51e024-472c-4b08-9e04-07ea978208d9 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:51.081302 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a51e024-472c-4b08-9e04-07ea978208d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:51.081582 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a51e024-472c-4b08-9e04-07ea978208d9 None admin] PATH_INFO: `/v3/groups/c347f72d01b04bbf8e150c1e32efeb16` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:51.087749 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a51e024-472c-4b08-9e04-07ea978208d9 None admin] RBAC: Authorizing `identity:get_group(group_id=c347f72d01b04bbf8e150c1e32efeb16)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:51.089213 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a51e024-472c-4b08-9e04-07ea978208d9 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:51.091727 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 173/349] 10.222.0.36 () {56 vars in 1180 bytes} [Tue Aug 9 10:10:50 2022] GET /identity/v3/groups/c347f72d01b04bbf8e150c1e32efeb16 => generated 226 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:51.093248 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d08a0b0-0a4f-4c9c-846c-c1b781e23ff3 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:51.093248 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d08a0b0-0a4f-4c9c-846c-c1b781e23ff3 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:51.093504 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d08a0b0-0a4f-4c9c-846c-c1b781e23ff3 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:51.094744 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 174/350] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:10:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:10:51.095426 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d08a0b0-0a4f-4c9c-846c-c1b781e23ff3 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:51.106985 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aba1339-4205-4376-a853-ea879c819d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:51.108358 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aba1339-4205-4376-a853-ea879c819d08 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:51.109282 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aba1339-4205-4376-a853-ea879c819d08 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:51.109747 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aba1339-4205-4376-a853-ea879c819d08 None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:51.110606 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aba1339-4205-4376-a853-ea879c819d08 None admin] RBAC: Adding query filter params (name=member) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:10:51.111084 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aba1339-4205-4376-a853-ea879c819d08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:51.112825 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aba1339-4205-4376-a853-ea879c819d08 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:51.122213 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 177/351] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Aug 9 10:10:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:51.123822 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c45cfe4-f2b6-4738-801b-0f96f0125168 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:51.124317 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c45cfe4-f2b6-4738-801b-0f96f0125168 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:51.124791 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c45cfe4-f2b6-4738-801b-0f96f0125168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:51.146802 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-4c45cfe4-f2b6-4738-801b-0f96f0125168 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:10:51.148426 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-4c45cfe4-f2b6-4738-801b-0f96f0125168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:10:51.206868 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:51.211743 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d08a0b0-0a4f-4c9c-846c-c1b781e23ff3 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:51.221594 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:51.227094 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 178/352] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:10:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 10:10:51.229072 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c45cfe4-f2b6-4738-801b-0f96f0125168 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:51.247974 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970a7584-3e6e-4962-a5ff-692e3612e8c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:51.248628 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970a7584-3e6e-4962-a5ff-692e3612e8c5 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:51.248947 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970a7584-3e6e-4962-a5ff-692e3612e8c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:51.249473 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970a7584-3e6e-4962-a5ff-692e3612e8c5 None admin] PATH_INFO: `/v3/projects/5a0951c053754bea9df8fb8448e1b42f` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:51.250751 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970a7584-3e6e-4962-a5ff-692e3612e8c5 None admin] RBAC: Authorizing `identity:get_project(project_id=5a0951c053754bea9df8fb8448e1b42f)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:51.252722 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970a7584-3e6e-4962-a5ff-692e3612e8c5 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:51.254457 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 175/353] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Aug 9 10:10:51 2022] GET /identity/v3/projects/5a0951c053754bea9df8fb8448e1b42f => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:51.255088 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970a7584-3e6e-4962-a5ff-692e3612e8c5 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:51.360788 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c45cfe4-f2b6-4738-801b-0f96f0125168 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:51.388753 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970a7584-3e6e-4962-a5ff-692e3612e8c5 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:51.408309 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f4814c-4f8b-4552-853e-34e9f93e0312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:51.408922 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f4814c-4f8b-4552-853e-34e9f93e0312 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:51.409340 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f4814c-4f8b-4552-853e-34e9f93e0312 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:51.409618 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f4814c-4f8b-4552-853e-34e9f93e0312 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:51.410696 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f4814c-4f8b-4552-853e-34e9f93e0312 None admin] RBAC: Adding query filter params (group.id=c347f72d01b04bbf8e150c1e32efeb16, role.id=a9895331e9694fa8b2b50908bb057bcb, scope.project.id=5a0951c053754bea9df8fb8448e1b42f) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:10:51.411009 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f4814c-4f8b-4552-853e-34e9f93e0312 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:51.412435 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f4814c-4f8b-4552-853e-34e9f93e0312 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:51.424054 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 179/354] 10.222.0.36 () {56 vars in 1376 bytes} [Tue Aug 9 10:10:51 2022] GET /identity/v3/role_assignments?group.id=c347f72d01b04bbf8e150c1e32efeb16&scope.project.id=5a0951c053754bea9df8fb8448e1b42f&role.id=a9895331e9694fa8b2b50908bb057bcb => generated 260 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:51.424054 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b559f0-c6bf-47af-97ba-c9fe889836cf None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:51.424054 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b559f0-c6bf-47af-97ba-c9fe889836cf None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:51.424054 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b559f0-c6bf-47af-97ba-c9fe889836cf None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:51.424054 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 180/355] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:10:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:10:51.424719 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b559f0-c6bf-47af-97ba-c9fe889836cf None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:51.432878 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea57950-3a71-41b0-bfe6-2b3022db85d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:51.434111 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea57950-3a71-41b0-bfe6-2b3022db85d9 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:51.434111 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea57950-3a71-41b0-bfe6-2b3022db85d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:51.434476 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea57950-3a71-41b0-bfe6-2b3022db85d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:51.484197 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:51.523216 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:51.544905 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea57950-3a71-41b0-bfe6-2b3022db85d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:51.546990 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea57950-3a71-41b0-bfe6-2b3022db85d9 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:51.579501 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b559f0-c6bf-47af-97ba-c9fe889836cf None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:51.627963 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53099bc-c318-47db-b40c-0f3d90376a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:51.628716 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53099bc-c318-47db-b40c-0f3d90376a67 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:51.628992 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53099bc-c318-47db-b40c-0f3d90376a67 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:51.629433 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53099bc-c318-47db-b40c-0f3d90376a67 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:51.642748 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53099bc-c318-47db-b40c-0f3d90376a67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 10:10:51.647892 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-e53099bc-c318-47db-b40c-0f3d90376a67 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 10:10:51.647892 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:10:51.647892 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:10:51.647892 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:10:51.647892 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:10:51.647892 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:10:51.647892 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:10:51.647892 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:10:51.647892 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:10:51.647892 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:10:51.647892 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:10:51.647892 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:10:51.647892 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 10:10:51.647892 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 10:10:51.647892 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 10:10:51.647892 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 10:10:51.648948 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 10:10:51.648948 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 10:10:51.648948 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 10:10:51.648948 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 10:10:51.648948 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:10:51.648948 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:10:51.648948 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:10:51.648948 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:10:51.648948 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:10:51.648948 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:10:51.648948 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:10:51.648948 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:10:51.648948 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:10:51.648948 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:10:51.648948 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:10:51.648948 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:10:51.650035 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:10:51.650035 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:10:51.650035 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:10:51.650035 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:10:51.650035 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 10:10:51.650035 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 10:10:51.650035 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 10:10:51.650035 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 10:10:51.650035 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 10:10:51.650035 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 10:10:51.650035 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 10:10:51.650035 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:10:51.650035 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 181/356] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Aug 9 10:10:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:10:51.650837 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53099bc-c318-47db-b40c-0f3d90376a67 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:51.685806 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 176/357] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Aug 9 10:10:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 10:10:51.687673 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e42388-b6eb-455b-b055-a42f63d604aa None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:51.687963 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e42388-b6eb-455b-b055-a42f63d604aa None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:51.688239 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e42388-b6eb-455b-b055-a42f63d604aa None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:51.689517 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 177/358] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:10:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:10:51.691096 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603faa7c-c421-478a-a105-3262d821c3ac None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:51.691378 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603faa7c-c421-478a-a105-3262d821c3ac None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:51.691647 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603faa7c-c421-478a-a105-3262d821c3ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:51.710463 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-603faa7c-c421-478a-a105-3262d821c3ac None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:10:51.711677 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-603faa7c-c421-478a-a105-3262d821c3ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:10:51.780957 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53099bc-c318-47db-b40c-0f3d90376a67 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:51.796219 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:51.810467 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:51.811270 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 178/359] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:10:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 10:10:51.812252 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603faa7c-c421-478a-a105-3262d821c3ac None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:51.830183 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1f7fa6-6623-4cb5-a601-1bbd0727f55d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:51.831132 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f7fa6-6623-4cb5-a601-1bbd0727f55d None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:51.831593 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f7fa6-6623-4cb5-a601-1bbd0727f55d None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:51.831998 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f7fa6-6623-4cb5-a601-1bbd0727f55d None admin] PATH_INFO: `/v3/groups/c347f72d01b04bbf8e150c1e32efeb16` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:51.833277 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1f7fa6-6623-4cb5-a601-1bbd0727f55d None admin] RBAC: Authorizing `identity:get_group(group_id=c347f72d01b04bbf8e150c1e32efeb16)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:51.834855 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1f7fa6-6623-4cb5-a601-1bbd0727f55d None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:51.836680 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 182/360] 10.222.0.36 () {56 vars in 1180 bytes} [Tue Aug 9 10:10:51 2022] GET /identity/v3/groups/c347f72d01b04bbf8e150c1e32efeb16 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:51.837561 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1f7fa6-6623-4cb5-a601-1bbd0727f55d None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:51.943742 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603faa7c-c421-478a-a105-3262d821c3ac None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:51.983478 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1f7fa6-6623-4cb5-a601-1bbd0727f55d None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:51.996196 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716d353a-0265-4b30-815e-3ca51eab7b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:51.997708 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d353a-0265-4b30-815e-3ca51eab7b60 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:51.998112 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d353a-0265-4b30-815e-3ca51eab7b60 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:51.998493 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d353a-0265-4b30-815e-3ca51eab7b60 None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:51.999490 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716d353a-0265-4b30-815e-3ca51eab7b60 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:10:51.999896 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716d353a-0265-4b30-815e-3ca51eab7b60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:52.001940 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716d353a-0265-4b30-815e-3ca51eab7b60 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:52.013509 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 179/361] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Aug 9 10:10:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:52.014921 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d498e19-5cd1-4c50-9ca1-7a90b5acc190 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:52.015275 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d498e19-5cd1-4c50-9ca1-7a90b5acc190 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:52.015618 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d498e19-5cd1-4c50-9ca1-7a90b5acc190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:52.022954 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a96293-1a1d-4cf0-9277-e7c92e583a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:52.024615 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a96293-1a1d-4cf0-9277-e7c92e583a20 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:52.025080 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a96293-1a1d-4cf0-9277-e7c92e583a20 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:52.025525 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a96293-1a1d-4cf0-9277-e7c92e583a20 None admin] PATH_INFO: `/v3/projects/a0b7ec3eb0324b10934f50e12805a4e4` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:52.026943 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a96293-1a1d-4cf0-9277-e7c92e583a20 None admin] RBAC: Authorizing `identity:get_project(project_id=a0b7ec3eb0324b10934f50e12805a4e4)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:52.028617 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a96293-1a1d-4cf0-9277-e7c92e583a20 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:52.030777 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 183/362] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Aug 9 10:10:51 2022] GET /identity/v3/projects/a0b7ec3eb0324b10934f50e12805a4e4 => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:52.031769 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a96293-1a1d-4cf0-9277-e7c92e583a20 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:52.039015 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-9d498e19-5cd1-4c50-9ca1-7a90b5acc190 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:10:52.040570 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-9d498e19-5cd1-4c50-9ca1-7a90b5acc190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:10:52.119631 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:52.123242 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:52.145495 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 180/363] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:10:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 10:10:52.146592 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d498e19-5cd1-4c50-9ca1-7a90b5acc190 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:52.172638 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a96293-1a1d-4cf0-9277-e7c92e583a20 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:52.219704 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b571efb6-cdf1-4767-bf56-689193dda0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:52.220349 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b571efb6-cdf1-4767-bf56-689193dda0f9 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:52.220892 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b571efb6-cdf1-4767-bf56-689193dda0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:52.220892 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b571efb6-cdf1-4767-bf56-689193dda0f9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:52.237335 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b571efb6-cdf1-4767-bf56-689193dda0f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 10:10:52.244607 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-b571efb6-cdf1-4767-bf56-689193dda0f9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 10:10:52.244607 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:10:52.244607 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:10:52.244607 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:10:52.244607 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:10:52.244607 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:10:52.244607 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:10:52.244607 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:10:52.244607 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:10:52.244607 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:10:52.244607 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:10:52.244607 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:10:52.244607 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 10:10:52.244607 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 10:10:52.244607 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 10:10:52.244607 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 10:10:52.245644 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 10:10:52.245644 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 10:10:52.245644 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 10:10:52.245644 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 10:10:52.245644 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:10:52.245644 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:10:52.245644 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:10:52.245644 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:10:52.245644 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:10:52.245644 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:10:52.245644 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:10:52.245644 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:10:52.245644 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:10:52.245644 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:10:52.245644 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:10:52.245644 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:10:52.247116 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:10:52.247116 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:10:52.247116 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:10:52.247116 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:10:52.247116 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 10:10:52.247116 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 10:10:52.247116 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 10:10:52.247116 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 10:10:52.247116 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 10:10:52.247116 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 10:10:52.247116 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 09 10:10:52.247116 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:10:52.249133 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 184/364] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Aug 9 10:10:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:10:52.250347 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b571efb6-cdf1-4767-bf56-689193dda0f9 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:52.277499 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d498e19-5cd1-4c50-9ca1-7a90b5acc190 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:52.324184 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0aeb4b-8886-4ea3-bdc7-1bcf54924bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:52.325333 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0aeb4b-8886-4ea3-bdc7-1bcf54924bda None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:52.325624 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0aeb4b-8886-4ea3-bdc7-1bcf54924bda None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:52.325906 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0aeb4b-8886-4ea3-bdc7-1bcf54924bda None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:52.326628 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0aeb4b-8886-4ea3-bdc7-1bcf54924bda None admin] RBAC: Adding query filter params (group.id=c347f72d01b04bbf8e150c1e32efeb16, role.id=af19908af5d6489696eb27791925a5aa, scope.project.id=5a0951c053754bea9df8fb8448e1b42f) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:10:52.326933 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0aeb4b-8886-4ea3-bdc7-1bcf54924bda None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:52.328638 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0aeb4b-8886-4ea3-bdc7-1bcf54924bda None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:52.335521 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 181/365] 10.222.0.36 () {56 vars in 1376 bytes} [Tue Aug 9 10:10:52 2022] GET /identity/v3/role_assignments?group.id=c347f72d01b04bbf8e150c1e32efeb16&scope.project.id=5a0951c053754bea9df8fb8448e1b42f&role.id=af19908af5d6489696eb27791925a5aa => generated 260 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:52.336323 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0aeb4b-8886-4ea3-bdc7-1bcf54924bda None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:52.405543 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b571efb6-cdf1-4767-bf56-689193dda0f9 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:52.417627 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:52.426349 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:52.461756 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a181a1bf-6afa-4917-a9e9-79e23af462b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:52.462723 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a181a1bf-6afa-4917-a9e9-79e23af462b7 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:52.463213 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a181a1bf-6afa-4917-a9e9-79e23af462b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:52.463751 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a181a1bf-6afa-4917-a9e9-79e23af462b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:52.482337 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0aeb4b-8886-4ea3-bdc7-1bcf54924bda None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:52.520660 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d318440-cdb8-4259-bc97-498f30329da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:52.521298 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d318440-cdb8-4259-bc97-498f30329da4 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:52.521928 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d318440-cdb8-4259-bc97-498f30329da4 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:52.522044 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d318440-cdb8-4259-bc97-498f30329da4 None admin] PATH_INFO: `/v3/groups/c347f72d01b04bbf8e150c1e32efeb16` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:52.523233 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d318440-cdb8-4259-bc97-498f30329da4 None admin] RBAC: Authorizing `identity:get_group(group_id=c347f72d01b04bbf8e150c1e32efeb16)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:52.524679 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d318440-cdb8-4259-bc97-498f30329da4 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:52.526851 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 182/366] 10.222.0.36 () {56 vars in 1180 bytes} [Tue Aug 9 10:10:52 2022] GET /identity/v3/groups/c347f72d01b04bbf8e150c1e32efeb16 => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:52.527644 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d318440-cdb8-4259-bc97-498f30329da4 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:52.553304 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a181a1bf-6afa-4917-a9e9-79e23af462b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:52.555477 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a181a1bf-6afa-4917-a9e9-79e23af462b7 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:52.663673 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d318440-cdb8-4259-bc97-498f30329da4 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:52.693939 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:52.701208 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 185/367] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Aug 9 10:10:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 10:10:52.702088 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a181a1bf-6afa-4917-a9e9-79e23af462b7 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:52.713891 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d135371c-679f-4d27-aa4c-b83da76717bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:52.713891 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d135371c-679f-4d27-aa4c-b83da76717bb None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:52.714142 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d135371c-679f-4d27-aa4c-b83da76717bb None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:52.714308 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d135371c-679f-4d27-aa4c-b83da76717bb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:52.731849 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d135371c-679f-4d27-aa4c-b83da76717bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 10:10:52.737281 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:52.739135 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-d135371c-679f-4d27-aa4c-b83da76717bb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 10:10:52.739135 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:10:52.739135 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:10:52.739135 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:10:52.739135 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:10:52.739135 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:10:52.739135 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:10:52.739135 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:10:52.739135 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:10:52.739135 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:10:52.739135 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:10:52.739135 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:10:52.739135 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 10:10:52.739135 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 10:10:52.739135 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 10:10:52.739135 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 10:10:52.740104 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 10:10:52.740104 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 10:10:52.740104 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 10:10:52.740104 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 10:10:52.740104 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:10:52.740104 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:10:52.740104 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:10:52.740104 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:10:52.740104 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:10:52.740104 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:10:52.740104 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:10:52.740104 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:10:52.740104 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:10:52.740104 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:10:52.740104 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:10:52.740104 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:10:52.740887 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:10:52.740887 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:10:52.740887 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:10:52.740887 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:10:52.740887 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 10:10:52.740887 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 10:10:52.740887 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 10:10:52.740887 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 10:10:52.740887 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 10:10:52.740887 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 10:10:52.740887 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 10:10:52.740887 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:10:52.740887 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 183/368] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Aug 9 10:10:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:10:52.741531 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d135371c-679f-4d27-aa4c-b83da76717bb None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:52.851985 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a181a1bf-6afa-4917-a9e9-79e23af462b7 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:52.864491 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d135371c-679f-4d27-aa4c-b83da76717bb None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:52.891694 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afe290d-1a6b-4a8e-aa82-9425c8116d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:52.892341 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe290d-1a6b-4a8e-aa82-9425c8116d34 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:52.892622 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe290d-1a6b-4a8e-aa82-9425c8116d34 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:52.892892 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe290d-1a6b-4a8e-aa82-9425c8116d34 None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:52.893552 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afe290d-1a6b-4a8e-aa82-9425c8116d34 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:10:52.893877 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afe290d-1a6b-4a8e-aa82-9425c8116d34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:52.895260 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afe290d-1a6b-4a8e-aa82-9425c8116d34 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:52.901943 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d5dd22-2609-4401-9e66-810fa833b5ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:52.902546 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d5dd22-2609-4401-9e66-810fa833b5ef None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:52.902856 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d5dd22-2609-4401-9e66-810fa833b5ef None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:52.903128 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d5dd22-2609-4401-9e66-810fa833b5ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:52.903850 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d5dd22-2609-4401-9e66-810fa833b5ef None admin] RBAC: Adding query filter params (group.id=c347f72d01b04bbf8e150c1e32efeb16, role.id=a9895331e9694fa8b2b50908bb057bcb, scope.project.id=a0b7ec3eb0324b10934f50e12805a4e4) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:10:52.904153 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d5dd22-2609-4401-9e66-810fa833b5ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:52.905287 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 186/369] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Aug 9 10:10:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:52.905600 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d5dd22-2609-4401-9e66-810fa833b5ef None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:52.906134 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afe290d-1a6b-4a8e-aa82-9425c8116d34 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:52.917206 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 184/370] 10.222.0.36 () {56 vars in 1376 bytes} [Tue Aug 9 10:10:52 2022] GET /identity/v3/role_assignments?group.id=c347f72d01b04bbf8e150c1e32efeb16&scope.project.id=a0b7ec3eb0324b10934f50e12805a4e4&role.id=a9895331e9694fa8b2b50908bb057bcb => generated 260 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:52.918097 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d5dd22-2609-4401-9e66-810fa833b5ef None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:53.009017 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:53.009719 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:53.032133 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afe290d-1a6b-4a8e-aa82-9425c8116d34 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:53.071739 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e2d98f-d40d-4080-aad7-68cc4e5be62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:53.072400 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e2d98f-d40d-4080-aad7-68cc4e5be62f None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:53.072724 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e2d98f-d40d-4080-aad7-68cc4e5be62f None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:53.073003 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e2d98f-d40d-4080-aad7-68cc4e5be62f None admin] PATH_INFO: `/v3/projects/a0b7ec3eb0324b10934f50e12805a4e4` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:53.074323 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e2d98f-d40d-4080-aad7-68cc4e5be62f None admin] RBAC: Authorizing `identity:get_project(project_id=a0b7ec3eb0324b10934f50e12805a4e4)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:53.075933 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e2d98f-d40d-4080-aad7-68cc4e5be62f None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:53.076818 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d5dd22-2609-4401-9e66-810fa833b5ef None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:53.078016 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 187/371] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Aug 9 10:10:52 2022] GET /identity/v3/projects/a0b7ec3eb0324b10934f50e12805a4e4 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:53.078919 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e2d98f-d40d-4080-aad7-68cc4e5be62f None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:53.116290 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6276b5d5-2710-4165-961c-59df56865896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:53.116975 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6276b5d5-2710-4165-961c-59df56865896 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:53.117256 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6276b5d5-2710-4165-961c-59df56865896 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:53.117626 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6276b5d5-2710-4165-961c-59df56865896 None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:53.118329 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6276b5d5-2710-4165-961c-59df56865896 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:10:53.118630 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6276b5d5-2710-4165-961c-59df56865896 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:53.120009 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6276b5d5-2710-4165-961c-59df56865896 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:53.130627 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 185/372] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Aug 9 10:10:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:53.131498 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6276b5d5-2710-4165-961c-59df56865896 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:53.198025 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e2d98f-d40d-4080-aad7-68cc4e5be62f None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:53.235736 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdca1abb-ec82-4bdc-aa29-aed01f454b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:53.236377 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca1abb-ec82-4bdc-aa29-aed01f454b9a None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:53.236656 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca1abb-ec82-4bdc-aa29-aed01f454b9a None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:53.236926 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca1abb-ec82-4bdc-aa29-aed01f454b9a None admin] PATH_INFO: `/v3/users/e4ad14df44f840e69d5a5962e06b0128` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:53.238180 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdca1abb-ec82-4bdc-aa29-aed01f454b9a None admin] RBAC: Authorizing `identity:get_user(user_id=e4ad14df44f840e69d5a5962e06b0128)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:53.239638 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdca1abb-ec82-4bdc-aa29-aed01f454b9a None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:53.242479 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 188/373] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Aug 9 10:10:53 2022] GET /identity/v3/users/e4ad14df44f840e69d5a5962e06b0128 => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:53.243292 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdca1abb-ec82-4bdc-aa29-aed01f454b9a None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:53.254639 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6276b5d5-2710-4165-961c-59df56865896 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:53.263560 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:53.264455 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:53.297210 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6924e2-4f78-46c5-9f24-c0ab353da6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:53.297909 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6924e2-4f78-46c5-9f24-c0ab353da6c0 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:53.298191 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6924e2-4f78-46c5-9f24-c0ab353da6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:53.298583 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6924e2-4f78-46c5-9f24-c0ab353da6c0 None admin] PATH_INFO: `/v3/groups/c347f72d01b04bbf8e150c1e32efeb16` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:53.299821 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6924e2-4f78-46c5-9f24-c0ab353da6c0 None admin] RBAC: Authorizing `identity:get_group(group_id=c347f72d01b04bbf8e150c1e32efeb16)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:53.301290 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6924e2-4f78-46c5-9f24-c0ab353da6c0 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:53.303362 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 186/374] 10.222.0.36 () {56 vars in 1180 bytes} [Tue Aug 9 10:10:53 2022] GET /identity/v3/groups/c347f72d01b04bbf8e150c1e32efeb16 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:53.304274 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6924e2-4f78-46c5-9f24-c0ab353da6c0 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:53.368909 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdca1abb-ec82-4bdc-aa29-aed01f454b9a None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:53.420726 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6924e2-4f78-46c5-9f24-c0ab353da6c0 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:53.460147 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8698efa4-d3ed-4a55-b873-2033fbcdc3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:53.460679 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8698efa4-d3ed-4a55-b873-2033fbcdc3c5 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:53.460953 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8698efa4-d3ed-4a55-b873-2033fbcdc3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:53.461219 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8698efa4-d3ed-4a55-b873-2033fbcdc3c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:53.461991 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8698efa4-d3ed-4a55-b873-2033fbcdc3c5 None admin] RBAC: Adding query filter params (role.id=b2850f278b2d4b32b2b56324509a5a01, user.id=e4ad14df44f840e69d5a5962e06b0128, scope.system=all) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:10:53.462297 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8698efa4-d3ed-4a55-b873-2033fbcdc3c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:53.463897 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8698efa4-d3ed-4a55-b873-2033fbcdc3c5 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:53.477405 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 187/375] 10.222.0.36 () {56 vars in 1308 bytes} [Tue Aug 9 10:10:53 2022] GET /identity/v3/role_assignments?user.id=e4ad14df44f840e69d5a5962e06b0128&scope.system=all&role.id=b2850f278b2d4b32b2b56324509a5a01 => generated 510 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:53.482253 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8698efa4-d3ed-4a55-b873-2033fbcdc3c5 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:53.495006 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fce7a1-d076-4d93-808e-312eab7ca97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:53.495636 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fce7a1-d076-4d93-808e-312eab7ca97f None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:53.495919 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fce7a1-d076-4d93-808e-312eab7ca97f None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:53.496195 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fce7a1-d076-4d93-808e-312eab7ca97f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:53.526346 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:53.610297 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8698efa4-d3ed-4a55-b873-2033fbcdc3c5 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:53.666655 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70876ed6-6410-453d-9253-3afb3a4f652e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:53.667287 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70876ed6-6410-453d-9253-3afb3a4f652e None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:53.667571 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70876ed6-6410-453d-9253-3afb3a4f652e None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:53.667846 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70876ed6-6410-453d-9253-3afb3a4f652e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:53.669218 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70876ed6-6410-453d-9253-3afb3a4f652e None admin] RBAC: Adding query filter params (group.id=c347f72d01b04bbf8e150c1e32efeb16, role.id=af19908af5d6489696eb27791925a5aa, scope.project.id=a0b7ec3eb0324b10934f50e12805a4e4) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:10:53.669642 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70876ed6-6410-453d-9253-3afb3a4f652e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:53.671244 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70876ed6-6410-453d-9253-3afb3a4f652e None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:53.686930 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fce7a1-d076-4d93-808e-312eab7ca97f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:53.688099 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 188/376] 10.222.0.36 () {56 vars in 1376 bytes} [Tue Aug 9 10:10:53 2022] GET /identity/v3/role_assignments?group.id=c347f72d01b04bbf8e150c1e32efeb16&scope.project.id=a0b7ec3eb0324b10934f50e12805a4e4&role.id=af19908af5d6489696eb27791925a5aa => generated 260 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:53.689691 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fce7a1-d076-4d93-808e-312eab7ca97f None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:53.710946 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:53.811976 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 189/377] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Aug 9 10:10:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 569 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 10:10:53.818167 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70876ed6-6410-453d-9253-3afb3a4f652e None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:53.937965 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d338387-5113-4df1-bf07-74b3ae3a7a47 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:53.938508 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d338387-5113-4df1-bf07-74b3ae3a7a47 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:53.938779 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d338387-5113-4df1-bf07-74b3ae3a7a47 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:53.940098 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 190/378] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:10:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:10:53.945999 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f689464a-2e2d-479d-93b6-455cc7621224 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:53.946284 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f689464a-2e2d-479d-93b6-455cc7621224 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:53.946553 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f689464a-2e2d-479d-93b6-455cc7621224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:53.962186 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:53.973750 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70876ed6-6410-453d-9253-3afb3a4f652e None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:53.975526 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-f689464a-2e2d-479d-93b6-455cc7621224 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:10:53.977351 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-f689464a-2e2d-479d-93b6-455cc7621224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:10:54.019176 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885c7d35-22f5-4dbb-a2ef-8abc456f2639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:54.020256 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c7d35-22f5-4dbb-a2ef-8abc456f2639 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:54.020734 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c7d35-22f5-4dbb-a2ef-8abc456f2639 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:54.021220 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885c7d35-22f5-4dbb-a2ef-8abc456f2639 None admin] PATH_INFO: `/v3/projects/182565a8c7ef44d4a6cfcadb2f45a71f` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:54.023419 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885c7d35-22f5-4dbb-a2ef-8abc456f2639 None admin] RBAC: Authorizing `identity:get_project(project_id=182565a8c7ef44d4a6cfcadb2f45a71f)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:54.025185 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885c7d35-22f5-4dbb-a2ef-8abc456f2639 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:54.027564 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 189/379] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Aug 9 10:10:53 2022] GET /identity/v3/projects/182565a8c7ef44d4a6cfcadb2f45a71f => generated 344 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:54.035301 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885c7d35-22f5-4dbb-a2ef-8abc456f2639 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:54.064883 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 191/380] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:10:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 10:10:54.103494 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f689464a-2e2d-479d-93b6-455cc7621224 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:54.174645 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885c7d35-22f5-4dbb-a2ef-8abc456f2639 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:54.180806 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:54.220991 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c114cf5-b3da-42e4-ab96-388cba57503c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:54.223873 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c114cf5-b3da-42e4-ab96-388cba57503c None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:54.224938 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c114cf5-b3da-42e4-ab96-388cba57503c None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:54.226056 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c114cf5-b3da-42e4-ab96-388cba57503c None admin] PATH_INFO: `/v3/groups/28503669151c41b589c080d2375f205f` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:54.239341 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c114cf5-b3da-42e4-ab96-388cba57503c None admin] RBAC: Authorizing `identity:get_group(group_id=28503669151c41b589c080d2375f205f)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:54.241221 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c114cf5-b3da-42e4-ab96-388cba57503c None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:54.243830 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 190/381] 10.222.0.36 () {56 vars in 1180 bytes} [Tue Aug 9 10:10:54 2022] GET /identity/v3/groups/28503669151c41b589c080d2375f205f => generated 229 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:10:54.251639 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c114cf5-b3da-42e4-ab96-388cba57503c None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:54.271625 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f689464a-2e2d-479d-93b6-455cc7621224 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:54.301065 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:54.312053 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f4a337-35d3-4f51-8004-2e39922323a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:54.312697 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f4a337-35d3-4f51-8004-2e39922323a0 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:54.313473 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f4a337-35d3-4f51-8004-2e39922323a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:54.313473 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f4a337-35d3-4f51-8004-2e39922323a0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:54.327145 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f4a337-35d3-4f51-8004-2e39922323a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 10:10:54.332043 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-84f4a337-35d3-4f51-8004-2e39922323a0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 10:10:54.332043 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:10:54.332043 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:10:54.332043 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:10:54.332043 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:10:54.332043 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:10:54.332043 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:10:54.332043 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:10:54.332043 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:10:54.332043 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:10:54.332043 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:10:54.332043 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:10:54.332043 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 10:10:54.332043 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 10:10:54.332043 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 10:10:54.332043 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 10:10:54.332972 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 10:10:54.332972 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 10:10:54.332972 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 10:10:54.332972 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 10:10:54.332972 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:10:54.332972 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:10:54.332972 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:10:54.332972 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:10:54.332972 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:10:54.332972 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:10:54.332972 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:10:54.332972 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:10:54.332972 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:10:54.332972 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:10:54.332972 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:10:54.332972 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:10:54.333764 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:10:54.333764 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:10:54.333764 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:10:54.333764 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:10:54.333764 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 10:10:54.333764 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 10:10:54.333764 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 10:10:54.333764 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 10:10:54.333764 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 10:10:54.333764 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 10:10:54.333764 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 10:10:54.333764 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:10:54.333764 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 192/382] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Aug 9 10:10:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 10:10:54.339269 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f4a337-35d3-4f51-8004-2e39922323a0 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:54.452935 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f4a337-35d3-4f51-8004-2e39922323a0 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:54.466792 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:54.479857 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c114cf5-b3da-42e4-ab96-388cba57503c None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:54.501113 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fb2c3b-9551-4e2c-b256-96a852821798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:54.502016 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fb2c3b-9551-4e2c-b256-96a852821798 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:54.502691 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fb2c3b-9551-4e2c-b256-96a852821798 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:54.503100 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fb2c3b-9551-4e2c-b256-96a852821798 None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:54.503889 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fb2c3b-9551-4e2c-b256-96a852821798 None admin] RBAC: Adding query filter params (name=member) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:10:54.504585 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fb2c3b-9551-4e2c-b256-96a852821798 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:54.506125 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fb2c3b-9551-4e2c-b256-96a852821798 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:54.519304 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 193/383] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Aug 9 10:10:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:54.524740 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fb2c3b-9551-4e2c-b256-96a852821798 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:54.568435 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a2ca33-8bc4-4415-9628-ec704bca6ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:54.569942 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a2ca33-8bc4-4415-9628-ec704bca6ecf None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:54.571114 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a2ca33-8bc4-4415-9628-ec704bca6ecf None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:54.571540 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a2ca33-8bc4-4415-9628-ec704bca6ecf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:54.573745 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a2ca33-8bc4-4415-9628-ec704bca6ecf None admin] RBAC: Adding query filter params (group.id=28503669151c41b589c080d2375f205f, role.id=89ca30cbbb634be8a96e9921aa56626b, scope.project.id=182565a8c7ef44d4a6cfcadb2f45a71f) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:10:54.574221 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a2ca33-8bc4-4415-9628-ec704bca6ecf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:54.575975 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a2ca33-8bc4-4415-9628-ec704bca6ecf None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:54.590071 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 191/384] 10.222.0.36 () {56 vars in 1376 bytes} [Tue Aug 9 10:10:54 2022] GET /identity/v3/role_assignments?group.id=28503669151c41b589c080d2375f205f&scope.project.id=182565a8c7ef44d4a6cfcadb2f45a71f&role.id=89ca30cbbb634be8a96e9921aa56626b => generated 260 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:54.679123 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fb2c3b-9551-4e2c-b256-96a852821798 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:54.726091 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6c410d-e184-4e5d-8ca9-a1a2ff369140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:54.726814 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c410d-e184-4e5d-8ca9-a1a2ff369140 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:54.727072 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c410d-e184-4e5d-8ca9-a1a2ff369140 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:54.727356 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c410d-e184-4e5d-8ca9-a1a2ff369140 None admin] PATH_INFO: `/v3/groups/c347f72d01b04bbf8e150c1e32efeb16` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:54.734828 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6c410d-e184-4e5d-8ca9-a1a2ff369140 None admin] RBAC: Authorizing `identity:get_group(group_id=c347f72d01b04bbf8e150c1e32efeb16)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:54.736224 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6c410d-e184-4e5d-8ca9-a1a2ff369140 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:54.737951 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 194/385] 10.222.0.36 () {56 vars in 1180 bytes} [Tue Aug 9 10:10:54 2022] GET /identity/v3/groups/c347f72d01b04bbf8e150c1e32efeb16 => generated 226 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:10:54.743738 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a2ca33-8bc4-4415-9628-ec704bca6ecf None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:54.895064 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:54.905051 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a2ca33-8bc4-4415-9628-ec704bca6ecf None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:54.940948 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11959da6-e418-4969-88c7-bb2f246b5963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:54.941967 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11959da6-e418-4969-88c7-bb2f246b5963 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:54.942456 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11959da6-e418-4969-88c7-bb2f246b5963 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:54.942942 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11959da6-e418-4969-88c7-bb2f246b5963 None admin] PATH_INFO: `/v3/projects/5a0951c053754bea9df8fb8448e1b42f` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:54.944295 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11959da6-e418-4969-88c7-bb2f246b5963 None admin] RBAC: Authorizing `identity:get_project(project_id=5a0951c053754bea9df8fb8448e1b42f)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:54.951229 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11959da6-e418-4969-88c7-bb2f246b5963 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:54.951229 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 192/386] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Aug 9 10:10:54 2022] GET /identity/v3/projects/5a0951c053754bea9df8fb8448e1b42f => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:54.954639 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6c410d-e184-4e5d-8ca9-a1a2ff369140 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:55.005338 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:55.084746 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6c410d-e184-4e5d-8ca9-a1a2ff369140 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:55.126686 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c70fc02-d60f-4663-9e89-093c733fa159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:55.127667 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c70fc02-d60f-4663-9e89-093c733fa159 None admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:55.128090 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c70fc02-d60f-4663-9e89-093c733fa159 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:55.128512 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c70fc02-d60f-4663-9e89-093c733fa159 None admin] PATH_INFO: `/v3/projects/5a0951c053754bea9df8fb8448e1b42f/groups/c347f72d01b04bbf8e150c1e32efeb16/roles/a9895331e9694fa8b2b50908bb057bcb` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:55.130568 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c70fc02-d60f-4663-9e89-093c733fa159 None admin] RBAC: Authorizing `identity:create_grant(project_id=5a0951c053754bea9df8fb8448e1b42f, group_id=c347f72d01b04bbf8e150c1e32efeb16, role_id=a9895331e9694fa8b2b50908bb057bcb)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:55.132148 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c70fc02-d60f-4663-9e89-093c733fa159 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:55.151612 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 195/387] 10.222.0.36 () {58 vars in 1442 bytes} [Tue Aug 9 10:10:54 2022] PUT /identity/v3/projects/5a0951c053754bea9df8fb8448e1b42f/groups/c347f72d01b04bbf8e150c1e32efeb16/roles/a9895331e9694fa8b2b50908bb057bcb => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 10:10:55.327674 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa46b5d-9f0b-424b-8fe5-2266f084e8b1 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:55.328485 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa46b5d-9f0b-424b-8fe5-2266f084e8b1 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:55.329161 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa46b5d-9f0b-424b-8fe5-2266f084e8b1 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:55.331369 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 193/388] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:10:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:10:55.337469 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863c8490-05f8-4f23-b106-f0f2415a82bf None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:55.338092 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863c8490-05f8-4f23-b106-f0f2415a82bf None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:55.338579 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863c8490-05f8-4f23-b106-f0f2415a82bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:55.359140 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-863c8490-05f8-4f23-b106-f0f2415a82bf None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:10:55.360732 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-863c8490-05f8-4f23-b106-f0f2415a82bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:10:55.440818 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 196/389] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:10:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 10:10:55.461536 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa46b5d-9f0b-424b-8fe5-2266f084e8b1 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:55.577077 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa46b5d-9f0b-424b-8fe5-2266f084e8b1 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:55.614749 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276001c5-68e1-4fe0-8945-9bf90da7b0fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:55.616047 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276001c5-68e1-4fe0-8945-9bf90da7b0fa None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:55.616529 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276001c5-68e1-4fe0-8945-9bf90da7b0fa None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:55.617000 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276001c5-68e1-4fe0-8945-9bf90da7b0fa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:55.629622 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276001c5-68e1-4fe0-8945-9bf90da7b0fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 10:10:55.635614 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-276001c5-68e1-4fe0-8945-9bf90da7b0fa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 10:10:55.635614 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:10:55.635614 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:10:55.635614 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:10:55.635614 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:10:55.635614 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:10:55.635614 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:10:55.635614 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:10:55.635614 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:10:55.635614 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:10:55.635614 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:10:55.635614 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:10:55.635614 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 10:10:55.635614 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 10:10:55.635614 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 10:10:55.635614 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 10:10:55.636568 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 10:10:55.636568 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 10:10:55.636568 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 10:10:55.636568 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 10:10:55.636568 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:10:55.636568 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:10:55.636568 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:10:55.636568 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:10:55.636568 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:10:55.636568 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:10:55.636568 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:10:55.636568 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:10:55.636568 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:10:55.636568 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:10:55.636568 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:10:55.636568 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:10:55.638071 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:10:55.638071 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:10:55.638071 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:10:55.638071 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:10:55.638071 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 10:10:55.638071 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 10:10:55.638071 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 10:10:55.638071 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 10:10:55.638071 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 10:10:55.638071 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 10:10:55.638071 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 10:10:55.638071 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:10:55.643967 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 194/390] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Aug 9 10:10:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:10:55.647989 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863c8490-05f8-4f23-b106-f0f2415a82bf None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:55.680732 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:55.760837 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863c8490-05f8-4f23-b106-f0f2415a82bf None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:55.806836 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c038915-6a76-44b2-a3a8-90a1ae6eb341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:55.807878 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c038915-6a76-44b2-a3a8-90a1ae6eb341 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:55.808348 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c038915-6a76-44b2-a3a8-90a1ae6eb341 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:55.808829 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c038915-6a76-44b2-a3a8-90a1ae6eb341 None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:55.809742 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c038915-6a76-44b2-a3a8-90a1ae6eb341 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:10:55.810256 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c038915-6a76-44b2-a3a8-90a1ae6eb341 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:55.811834 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c038915-6a76-44b2-a3a8-90a1ae6eb341 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:55.825957 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 197/391] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Aug 9 10:10:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:55.828577 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276001c5-68e1-4fe0-8945-9bf90da7b0fa None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:55.846128 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c22277-4d28-40aa-8216-12512fbec7fc None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:55.846745 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c22277-4d28-40aa-8216-12512fbec7fc None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:55.847415 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c22277-4d28-40aa-8216-12512fbec7fc None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:55.849278 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 198/392] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:10:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 10:10:55.867239 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:55.872898 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ed150-7745-471b-81f6-99f29d12c64a None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:55.872898 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ed150-7745-471b-81f6-99f29d12c64a None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:55.873235 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ed150-7745-471b-81f6-99f29d12c64a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:55.905246 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-781ed150-7745-471b-81f6-99f29d12c64a None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:10:55.906456 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-781ed150-7745-471b-81f6-99f29d12c64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:10:56.010004 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276001c5-68e1-4fe0-8945-9bf90da7b0fa None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:56.049058 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f452fd-d5ad-452c-ac19-f343f099c627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:56.049816 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f452fd-d5ad-452c-ac19-f343f099c627 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:56.050125 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f452fd-d5ad-452c-ac19-f343f099c627 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:56.050396 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f452fd-d5ad-452c-ac19-f343f099c627 None admin] PATH_INFO: `/v3/groups/c347f72d01b04bbf8e150c1e32efeb16` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:56.051512 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f452fd-d5ad-452c-ac19-f343f099c627 None admin] RBAC: Authorizing `identity:get_group(group_id=c347f72d01b04bbf8e150c1e32efeb16)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:56.053254 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f452fd-d5ad-452c-ac19-f343f099c627 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:56.060832 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 195/393] 10.222.0.36 () {56 vars in 1180 bytes} [Tue Aug 9 10:10:55 2022] GET /identity/v3/groups/c347f72d01b04bbf8e150c1e32efeb16 => generated 226 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:56.062300 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f452fd-d5ad-452c-ac19-f343f099c627 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:56.089982 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 199/394] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:10:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 10:10:56.123829 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781ed150-7745-471b-81f6-99f29d12c64a None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:56.183266 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:56.183454 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:56.198647 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f452fd-d5ad-452c-ac19-f343f099c627 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:56.250011 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3e3a76-da84-47f2-a608-7c47d24bf0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:56.250659 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e3a76-da84-47f2-a608-7c47d24bf0d7 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:56.250943 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e3a76-da84-47f2-a608-7c47d24bf0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:56.251217 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e3a76-da84-47f2-a608-7c47d24bf0d7 None admin] PATH_INFO: `/v3/projects/5a0951c053754bea9df8fb8448e1b42f` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:56.252422 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3e3a76-da84-47f2-a608-7c47d24bf0d7 None admin] RBAC: Authorizing `identity:get_project(project_id=5a0951c053754bea9df8fb8448e1b42f)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:56.253917 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3e3a76-da84-47f2-a608-7c47d24bf0d7 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:56.255891 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 196/395] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Aug 9 10:10:56 2022] GET /identity/v3/projects/5a0951c053754bea9df8fb8448e1b42f => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:10:56.275576 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3e3a76-da84-47f2-a608-7c47d24bf0d7 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:56.337081 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781ed150-7745-471b-81f6-99f29d12c64a None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:56.375218 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d80c1-5088-4b3d-8335-ec45f9472510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:56.375868 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d80c1-5088-4b3d-8335-ec45f9472510 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:56.376153 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d80c1-5088-4b3d-8335-ec45f9472510 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:56.376429 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d80c1-5088-4b3d-8335-ec45f9472510 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:56.387945 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251d80c1-5088-4b3d-8335-ec45f9472510 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 10:10:56.392925 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-251d80c1-5088-4b3d-8335-ec45f9472510 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 10:10:56.392925 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:10:56.392925 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:10:56.392925 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:10:56.392925 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:10:56.392925 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:10:56.392925 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:10:56.392925 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:10:56.392925 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:10:56.392925 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:10:56.392925 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:10:56.392925 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:10:56.392925 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 10:10:56.392925 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 10:10:56.392925 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 10:10:56.392925 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 10:10:56.393824 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 10:10:56.393824 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 10:10:56.393824 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 10:10:56.393824 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 10:10:56.393824 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:10:56.393824 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:10:56.393824 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:10:56.393824 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:10:56.393824 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:10:56.393824 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:10:56.393824 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:10:56.393824 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:10:56.393824 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:10:56.393824 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:10:56.393824 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:10:56.393824 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:10:56.394641 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:10:56.394641 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:10:56.394641 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:10:56.394641 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:10:56.394641 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 10:10:56.394641 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 10:10:56.394641 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 10:10:56.394641 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 10:10:56.394641 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 10:10:56.394641 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 10:10:56.394641 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 10:10:56.394641 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:10:56.394641 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 200/396] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Aug 9 10:10:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 10:10:56.403324 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d80c1-5088-4b3d-8335-ec45f9472510 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:56.504061 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:56.518503 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d80c1-5088-4b3d-8335-ec45f9472510 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:56.530919 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3e3a76-da84-47f2-a608-7c47d24bf0d7 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:56.568218 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82beb69-b7c7-4ad9-bd9f-bf624b17f2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:56.569086 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82beb69-b7c7-4ad9-bd9f-bf624b17f2da None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:56.569371 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82beb69-b7c7-4ad9-bd9f-bf624b17f2da None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:56.569701 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82beb69-b7c7-4ad9-bd9f-bf624b17f2da None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:56.570843 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82beb69-b7c7-4ad9-bd9f-bf624b17f2da None admin] RBAC: Adding query filter params (name=member) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:10:56.571441 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82beb69-b7c7-4ad9-bd9f-bf624b17f2da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:56.573148 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82beb69-b7c7-4ad9-bd9f-bf624b17f2da None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:56.575922 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e6e12b-8533-4eda-afa9-1beb2380e41d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:56.576653 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e6e12b-8533-4eda-afa9-1beb2380e41d None admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:56.577007 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e6e12b-8533-4eda-afa9-1beb2380e41d None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:56.577354 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e6e12b-8533-4eda-afa9-1beb2380e41d None admin] PATH_INFO: `/v3/projects/5a0951c053754bea9df8fb8448e1b42f/groups/c347f72d01b04bbf8e150c1e32efeb16/roles/af19908af5d6489696eb27791925a5aa` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:56.579654 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e6e12b-8533-4eda-afa9-1beb2380e41d None admin] RBAC: Authorizing `identity:create_grant(project_id=5a0951c053754bea9df8fb8448e1b42f, group_id=c347f72d01b04bbf8e150c1e32efeb16, role_id=af19908af5d6489696eb27791925a5aa)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:56.581174 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e6e12b-8533-4eda-afa9-1beb2380e41d None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:56.586001 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 201/397] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Aug 9 10:10:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:56.587253 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e6bc7-6f22-464c-9a55-063442615c4b None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:56.587538 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e6bc7-6f22-464c-9a55-063442615c4b None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:56.587812 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e6bc7-6f22-464c-9a55-063442615c4b None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:56.589192 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 202/398] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:10:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:10:56.594461 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612e6bc7-6f22-464c-9a55-063442615c4b None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:56.601741 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 197/399] 10.222.0.36 () {58 vars in 1442 bytes} [Tue Aug 9 10:10:56 2022] PUT /identity/v3/projects/5a0951c053754bea9df8fb8448e1b42f/groups/c347f72d01b04bbf8e150c1e32efeb16/roles/af19908af5d6489696eb27791925a5aa => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 10:10:56.603179 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5280c5d-2516-4feb-b0de-6bef92f28ea4 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:56.603468 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5280c5d-2516-4feb-b0de-6bef92f28ea4 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:56.603743 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5280c5d-2516-4feb-b0de-6bef92f28ea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:56.633147 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-f5280c5d-2516-4feb-b0de-6bef92f28ea4 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:10:56.635496 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-f5280c5d-2516-4feb-b0de-6bef92f28ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:10:56.659391 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:56.761301 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612e6bc7-6f22-464c-9a55-063442615c4b None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:56.806906 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8430d69-9d57-45c7-acd0-605372aa20ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:56.807542 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8430d69-9d57-45c7-acd0-605372aa20ac None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:56.807821 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8430d69-9d57-45c7-acd0-605372aa20ac None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:56.808105 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8430d69-9d57-45c7-acd0-605372aa20ac None admin] PATH_INFO: `/v3/groups/c347f72d01b04bbf8e150c1e32efeb16` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:56.809473 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8430d69-9d57-45c7-acd0-605372aa20ac None admin] RBAC: Authorizing `identity:get_group(group_id=c347f72d01b04bbf8e150c1e32efeb16)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:56.813894 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8430d69-9d57-45c7-acd0-605372aa20ac None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:56.814120 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 203/401] 10.222.0.36 () {56 vars in 1180 bytes} [Tue Aug 9 10:10:56 2022] GET /identity/v3/groups/c347f72d01b04bbf8e150c1e32efeb16 => generated 226 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:56.814313 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 198/401] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:10:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 10:10:56.821293 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8430d69-9d57-45c7-acd0-605372aa20ac None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:56.834966 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:56.849079 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5280c5d-2516-4feb-b0de-6bef92f28ea4 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:56.952777 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8430d69-9d57-45c7-acd0-605372aa20ac None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:57.006364 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5280c5d-2516-4feb-b0de-6bef92f28ea4 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:57.008737 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d993dc23-fbb1-49a5-b4ac-6b8398dcca96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:57.010943 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d993dc23-fbb1-49a5-b4ac-6b8398dcca96 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:57.011476 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d993dc23-fbb1-49a5-b4ac-6b8398dcca96 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:57.012002 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d993dc23-fbb1-49a5-b4ac-6b8398dcca96 None admin] PATH_INFO: `/v3/projects/a0b7ec3eb0324b10934f50e12805a4e4` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:57.014570 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d993dc23-fbb1-49a5-b4ac-6b8398dcca96 None admin] RBAC: Authorizing `identity:get_project(project_id=a0b7ec3eb0324b10934f50e12805a4e4)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:57.021983 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d993dc23-fbb1-49a5-b4ac-6b8398dcca96 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:57.029616 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 204/402] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Aug 9 10:10:56 2022] GET /identity/v3/projects/a0b7ec3eb0324b10934f50e12805a4e4 => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:10:57.047325 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d993dc23-fbb1-49a5-b4ac-6b8398dcca96 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:57.073989 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abc68ae-a1ea-4bb0-9c50-afce1dcf980e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:57.075565 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc68ae-a1ea-4bb0-9c50-afce1dcf980e None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:57.076064 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc68ae-a1ea-4bb0-9c50-afce1dcf980e None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:57.076535 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc68ae-a1ea-4bb0-9c50-afce1dcf980e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:57.090689 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abc68ae-a1ea-4bb0-9c50-afce1dcf980e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 10:10:57.096819 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-0abc68ae-a1ea-4bb0-9c50-afce1dcf980e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 10:10:57.096819 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:10:57.096819 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:10:57.096819 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:10:57.096819 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:10:57.096819 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:10:57.096819 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:10:57.096819 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:10:57.096819 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:10:57.096819 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:10:57.096819 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:10:57.096819 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:10:57.096819 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 10:10:57.096819 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 10:10:57.096819 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 10:10:57.096819 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 10:10:57.097721 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 10:10:57.097721 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 10:10:57.097721 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 10:10:57.097721 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 10:10:57.097721 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:10:57.097721 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:10:57.097721 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:10:57.097721 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:10:57.097721 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:10:57.097721 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:10:57.097721 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:10:57.097721 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:10:57.097721 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:10:57.097721 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:10:57.097721 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:10:57.097721 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:10:57.098561 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:10:57.098561 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:10:57.098561 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:10:57.098561 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:10:57.098561 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 10:10:57.098561 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 10:10:57.098561 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 10:10:57.098561 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 10:10:57.098561 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 10:10:57.098561 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 10:10:57.098561 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 10:10:57.098561 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:10:57.106525 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 199/403] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Aug 9 10:10:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 10:10:57.108246 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abc68ae-a1ea-4bb0-9c50-afce1dcf980e None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:57.119406 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:57.222913 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abc68ae-a1ea-4bb0-9c50-afce1dcf980e None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:57.261742 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dbd366-67b7-4bba-849c-b69b4927bb1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:57.263473 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dbd366-67b7-4bba-849c-b69b4927bb1d None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:57.263881 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:57.264166 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dbd366-67b7-4bba-849c-b69b4927bb1d None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:57.264970 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dbd366-67b7-4bba-849c-b69b4927bb1d None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:57.266058 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dbd366-67b7-4bba-849c-b69b4927bb1d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:10:57.266568 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dbd366-67b7-4bba-849c-b69b4927bb1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:57.268174 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dbd366-67b7-4bba-849c-b69b4927bb1d None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:57.281823 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 200/404] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Aug 9 10:10:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:10:57.284235 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dbd366-67b7-4bba-849c-b69b4927bb1d None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:57.304619 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d993dc23-fbb1-49a5-b4ac-6b8398dcca96 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:57.340554 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8e6287-6e4c-487b-aa17-938814cfa988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:57.341291 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8e6287-6e4c-487b-aa17-938814cfa988 None admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:57.341571 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8e6287-6e4c-487b-aa17-938814cfa988 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:57.341868 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8e6287-6e4c-487b-aa17-938814cfa988 None admin] PATH_INFO: `/v3/projects/a0b7ec3eb0324b10934f50e12805a4e4/groups/c347f72d01b04bbf8e150c1e32efeb16/roles/a9895331e9694fa8b2b50908bb057bcb` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:57.344251 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8e6287-6e4c-487b-aa17-938814cfa988 None admin] RBAC: Authorizing `identity:create_grant(project_id=a0b7ec3eb0324b10934f50e12805a4e4, group_id=c347f72d01b04bbf8e150c1e32efeb16, role_id=a9895331e9694fa8b2b50908bb057bcb)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:57.345913 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8e6287-6e4c-487b-aa17-938814cfa988 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:57.373873 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 205/405] 10.222.0.36 () {58 vars in 1442 bytes} [Tue Aug 9 10:10:57 2022] PUT /identity/v3/projects/a0b7ec3eb0324b10934f50e12805a4e4/groups/c347f72d01b04bbf8e150c1e32efeb16/roles/a9895331e9694fa8b2b50908bb057bcb => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 10:10:57.373873 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4718966d-ac11-4a46-807e-4e6edc08ba18 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:57.373873 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4718966d-ac11-4a46-807e-4e6edc08ba18 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:57.373873 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4718966d-ac11-4a46-807e-4e6edc08ba18 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:57.373873 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 206/406] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:10:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:10:57.380292 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4931c478-b08c-4e38-9179-961dd02c3af7 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:57.380686 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4931c478-b08c-4e38-9179-961dd02c3af7 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:57.380965 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4931c478-b08c-4e38-9179-961dd02c3af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:57.390564 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:57.419299 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-4931c478-b08c-4e38-9179-961dd02c3af7 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:10:57.421154 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-4931c478-b08c-4e38-9179-961dd02c3af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:10:57.460871 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dbd366-67b7-4bba-849c-b69b4927bb1d None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:57.504880 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 207/407] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:10:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 10:10:57.526361 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4931c478-b08c-4e38-9179-961dd02c3af7 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:57.541158 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bcff93-c82b-4e17-b4fa-5ca0a37b0e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:57.541800 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bcff93-c82b-4e17-b4fa-5ca0a37b0e2f None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:57.544057 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bcff93-c82b-4e17-b4fa-5ca0a37b0e2f None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:57.544347 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bcff93-c82b-4e17-b4fa-5ca0a37b0e2f None admin] PATH_INFO: `/v3/groups/c347f72d01b04bbf8e150c1e32efeb16` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:57.546499 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bcff93-c82b-4e17-b4fa-5ca0a37b0e2f None admin] RBAC: Authorizing `identity:get_group(group_id=c347f72d01b04bbf8e150c1e32efeb16)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:57.547995 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bcff93-c82b-4e17-b4fa-5ca0a37b0e2f None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:57.549660 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 201/408] 10.222.0.36 () {56 vars in 1180 bytes} [Tue Aug 9 10:10:57 2022] GET /identity/v3/groups/c347f72d01b04bbf8e150c1e32efeb16 => generated 226 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:57.555853 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bcff93-c82b-4e17-b4fa-5ca0a37b0e2f None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:57.632836 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:57.683686 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4931c478-b08c-4e38-9179-961dd02c3af7 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:57.692104 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bcff93-c82b-4e17-b4fa-5ca0a37b0e2f None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:57.719790 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcef6e0-9a9c-409b-839e-5ca82d88d246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:57.720419 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcef6e0-9a9c-409b-839e-5ca82d88d246 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:57.720694 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcef6e0-9a9c-409b-839e-5ca82d88d246 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:57.720964 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcef6e0-9a9c-409b-839e-5ca82d88d246 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:57.734302 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcef6e0-9a9c-409b-839e-5ca82d88d246 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 10:10:57.739159 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed06b2d5-a4a9-4b7d-b61a-6387f3838b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:57.739507 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-3fcef6e0-9a9c-409b-839e-5ca82d88d246 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 10:10:57.739507 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:10:57.739507 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:10:57.739507 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:10:57.739507 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:10:57.739507 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:10:57.739507 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:10:57.739507 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:10:57.739507 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:10:57.739507 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:10:57.739507 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:10:57.739507 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:10:57.739507 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 10:10:57.739507 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 10:10:57.739507 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 10:10:57.739507 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 10:10:57.740387 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 10:10:57.740387 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 10:10:57.740387 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 10:10:57.740387 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 10:10:57.740387 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:10:57.740387 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:10:57.740387 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:10:57.740387 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:10:57.740387 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:10:57.740387 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:10:57.740387 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:10:57.740387 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:10:57.740387 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:10:57.740387 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:10:57.740387 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:10:57.740387 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:10:57.741591 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:10:57.741591 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:10:57.741591 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:10:57.741591 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:10:57.741591 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 10:10:57.741591 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 10:10:57.741591 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 10:10:57.741591 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 10:10:57.741591 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 10:10:57.741591 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 10:10:57.741591 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 10:10:57.741591 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:10:57.741591 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 208/409] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Aug 9 10:10:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:10:57.743322 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed06b2d5-a4a9-4b7d-b61a-6387f3838b4f None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:57.743816 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed06b2d5-a4a9-4b7d-b61a-6387f3838b4f None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:57.744357 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed06b2d5-a4a9-4b7d-b61a-6387f3838b4f None admin] PATH_INFO: `/v3/projects/a0b7ec3eb0324b10934f50e12805a4e4` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:57.745829 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed06b2d5-a4a9-4b7d-b61a-6387f3838b4f None admin] RBAC: Authorizing `identity:get_project(project_id=a0b7ec3eb0324b10934f50e12805a4e4)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:57.747107 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcef6e0-9a9c-409b-839e-5ca82d88d246 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:57.748390 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed06b2d5-a4a9-4b7d-b61a-6387f3838b4f None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:57.755152 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 202/410] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Aug 9 10:10:57 2022] GET /identity/v3/projects/a0b7ec3eb0324b10934f50e12805a4e4 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:57.758946 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed06b2d5-a4a9-4b7d-b61a-6387f3838b4f None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:57.771679 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:57.871686 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcef6e0-9a9c-409b-839e-5ca82d88d246 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:57.903017 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:57.913271 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cd6308-f199-4104-8302-15875299c0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:57.914408 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cd6308-f199-4104-8302-15875299c0ce None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:57.914953 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cd6308-f199-4104-8302-15875299c0ce None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:57.915803 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cd6308-f199-4104-8302-15875299c0ce None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:57.916827 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cd6308-f199-4104-8302-15875299c0ce None admin] RBAC: Adding query filter params (name=admin) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:10:57.917348 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cd6308-f199-4104-8302-15875299c0ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:57.919809 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cd6308-f199-4104-8302-15875299c0ce None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:57.929684 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 209/411] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Aug 9 10:10:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:57.939152 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cd6308-f199-4104-8302-15875299c0ce None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:57.997787 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed06b2d5-a4a9-4b7d-b61a-6387f3838b4f None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:58.034100 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6882a5-49b0-4442-9c50-f63a9296653e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:58.035827 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6882a5-49b0-4442-9c50-f63a9296653e None admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:58.036127 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6882a5-49b0-4442-9c50-f63a9296653e None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:58.036435 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6882a5-49b0-4442-9c50-f63a9296653e None admin] PATH_INFO: `/v3/projects/a0b7ec3eb0324b10934f50e12805a4e4/groups/c347f72d01b04bbf8e150c1e32efeb16/roles/af19908af5d6489696eb27791925a5aa` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:58.039702 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6882a5-49b0-4442-9c50-f63a9296653e None admin] RBAC: Authorizing `identity:create_grant(project_id=a0b7ec3eb0324b10934f50e12805a4e4, group_id=c347f72d01b04bbf8e150c1e32efeb16, role_id=af19908af5d6489696eb27791925a5aa)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:58.041429 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6882a5-49b0-4442-9c50-f63a9296653e None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:58.061181 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 203/412] 10.222.0.36 () {58 vars in 1442 bytes} [Tue Aug 9 10:10:57 2022] PUT /identity/v3/projects/a0b7ec3eb0324b10934f50e12805a4e4/groups/c347f72d01b04bbf8e150c1e32efeb16/roles/af19908af5d6489696eb27791925a5aa => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:10:58.063321 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a30bbe9-ab2a-43b9-a29c-fa4f3abe25f4 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:58.063610 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a30bbe9-ab2a-43b9-a29c-fa4f3abe25f4 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:58.064158 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a30bbe9-ab2a-43b9-a29c-fa4f3abe25f4 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:58.065862 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 204/413] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:10:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:10:58.072589 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9db7d7-a1bb-42d9-9818-4403c9e2f164 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:58.072953 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9db7d7-a1bb-42d9-9818-4403c9e2f164 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:58.073307 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9db7d7-a1bb-42d9-9818-4403c9e2f164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:58.078077 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cd6308-f199-4104-8302-15875299c0ce None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:58.099893 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-0b9db7d7-a1bb-42d9-9818-4403c9e2f164 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:10:58.101234 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-0b9db7d7-a1bb-42d9-9818-4403c9e2f164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:10:58.120359 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64f4447-b8cb-4c96-9fd5-e994a9f4303e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:58.121153 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f4447-b8cb-4c96-9fd5-e994a9f4303e None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:58.122399 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f4447-b8cb-4c96-9fd5-e994a9f4303e None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:58.122921 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f4447-b8cb-4c96-9fd5-e994a9f4303e None admin] PATH_INFO: `/v3/groups/28503669151c41b589c080d2375f205f` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:58.124241 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64f4447-b8cb-4c96-9fd5-e994a9f4303e None admin] RBAC: Authorizing `identity:get_group(group_id=28503669151c41b589c080d2375f205f)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:58.125932 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64f4447-b8cb-4c96-9fd5-e994a9f4303e None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:58.128069 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 210/414] 10.222.0.36 () {56 vars in 1180 bytes} [Tue Aug 9 10:10:57 2022] GET /identity/v3/groups/28503669151c41b589c080d2375f205f => generated 229 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:58.133475 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64f4447-b8cb-4c96-9fd5-e994a9f4303e None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:58.224521 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:58.246583 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 205/415] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:10:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 10:10:58.248379 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:58.271554 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9db7d7-a1bb-42d9-9818-4403c9e2f164 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:58.314701 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64f4447-b8cb-4c96-9fd5-e994a9f4303e None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:58.365199 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a508ff7-670c-4ef6-87a2-4b91ec2ad4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:58.365833 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a508ff7-670c-4ef6-87a2-4b91ec2ad4a0 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:58.366137 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a508ff7-670c-4ef6-87a2-4b91ec2ad4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:58.366411 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a508ff7-670c-4ef6-87a2-4b91ec2ad4a0 None admin] PATH_INFO: `/v3/projects/182565a8c7ef44d4a6cfcadb2f45a71f` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:58.367540 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a508ff7-670c-4ef6-87a2-4b91ec2ad4a0 None admin] RBAC: Authorizing `identity:get_project(project_id=182565a8c7ef44d4a6cfcadb2f45a71f)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:58.368963 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a508ff7-670c-4ef6-87a2-4b91ec2ad4a0 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:58.370763 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 211/416] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Aug 9 10:10:58 2022] GET /identity/v3/projects/182565a8c7ef44d4a6cfcadb2f45a71f => generated 344 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:58.377891 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a508ff7-670c-4ef6-87a2-4b91ec2ad4a0 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:58.401480 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9db7d7-a1bb-42d9-9818-4403c9e2f164 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:58.446898 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ca85b5-0861-4caf-afb5-abf830bbc0d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:58.448360 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ca85b5-0861-4caf-afb5-abf830bbc0d8 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:58.448633 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ca85b5-0861-4caf-afb5-abf830bbc0d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:58.448900 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ca85b5-0861-4caf-afb5-abf830bbc0d8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:58.470320 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ca85b5-0861-4caf-afb5-abf830bbc0d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 10:10:58.477757 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-c7ca85b5-0861-4caf-afb5-abf830bbc0d8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 10:10:58.477757 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:10:58.477757 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:10:58.477757 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:10:58.477757 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:10:58.477757 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:10:58.477757 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:10:58.477757 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:10:58.477757 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:10:58.477757 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:10:58.477757 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:10:58.477757 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:10:58.477757 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 10:10:58.477757 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 10:10:58.477757 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 10:10:58.477757 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 10:10:58.478667 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 10:10:58.478667 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 10:10:58.478667 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 10:10:58.478667 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 10:10:58.478667 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:10:58.478667 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:10:58.478667 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:10:58.478667 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:10:58.478667 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:10:58.478667 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:10:58.478667 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:10:58.478667 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:10:58.478667 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:10:58.478667 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:10:58.478667 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:10:58.478667 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:10:58.479447 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:10:58.479447 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:10:58.479447 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:10:58.479447 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:10:58.479447 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 10:10:58.479447 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 10:10:58.479447 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 10:10:58.479447 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 10:10:58.479447 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 10:10:58.479447 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 10:10:58.479447 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 10:10:58.479447 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:10:58.479447 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 206/417] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Aug 9 10:10:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 10:10:58.485102 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ca85b5-0861-4caf-afb5-abf830bbc0d8 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:58.543968 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a508ff7-670c-4ef6-87a2-4b91ec2ad4a0 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:58.584801 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:58.595609 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41add207-835b-4816-b02c-90bc8ebd5e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:58.596269 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41add207-835b-4816-b02c-90bc8ebd5e01 None admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:58.596582 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41add207-835b-4816-b02c-90bc8ebd5e01 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:58.596934 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41add207-835b-4816-b02c-90bc8ebd5e01 None admin] PATH_INFO: `/v3/projects/182565a8c7ef44d4a6cfcadb2f45a71f/groups/28503669151c41b589c080d2375f205f/roles/89ca30cbbb634be8a96e9921aa56626b` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:58.599484 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41add207-835b-4816-b02c-90bc8ebd5e01 None admin] RBAC: Authorizing `identity:create_grant(project_id=182565a8c7ef44d4a6cfcadb2f45a71f, group_id=28503669151c41b589c080d2375f205f, role_id=89ca30cbbb634be8a96e9921aa56626b)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:58.600920 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41add207-835b-4816-b02c-90bc8ebd5e01 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:58.604834 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:58.619475 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 212/418] 10.222.0.36 () {58 vars in 1442 bytes} [Tue Aug 9 10:10:58 2022] PUT /identity/v3/projects/182565a8c7ef44d4a6cfcadb2f45a71f/groups/28503669151c41b589c080d2375f205f/roles/89ca30cbbb634be8a96e9921aa56626b => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 10:10:58.677693 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ca85b5-0861-4caf-afb5-abf830bbc0d8 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:58.716240 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18238a2-78bf-4a73-80d3-8958410b3f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:58.716898 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18238a2-78bf-4a73-80d3-8958410b3f08 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:58.717158 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18238a2-78bf-4a73-80d3-8958410b3f08 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:58.717483 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18238a2-78bf-4a73-80d3-8958410b3f08 None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:58.718184 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18238a2-78bf-4a73-80d3-8958410b3f08 None admin] RBAC: Adding query filter params (name=member) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:10:58.718484 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18238a2-78bf-4a73-80d3-8958410b3f08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:58.719854 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18238a2-78bf-4a73-80d3-8958410b3f08 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:58.729523 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 207/419] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Aug 9 10:10:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:58.735646 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41add207-835b-4816-b02c-90bc8ebd5e01 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:58.857582 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41add207-835b-4816-b02c-90bc8ebd5e01 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:58.896184 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1d13b4-8520-45e0-b0cf-a5f1b8a4d593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:58.896954 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1d13b4-8520-45e0-b0cf-a5f1b8a4d593 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:58.897143 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1d13b4-8520-45e0-b0cf-a5f1b8a4d593 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:58.897385 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1d13b4-8520-45e0-b0cf-a5f1b8a4d593 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:58.982275 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:59.000861 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1d13b4-8520-45e0-b0cf-a5f1b8a4d593 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:59.002369 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1d13b4-8520-45e0-b0cf-a5f1b8a4d593 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:59.130883 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 213/420] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Aug 9 10:10:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 10:10:59.136302 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18238a2-78bf-4a73-80d3-8958410b3f08 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:59.143838 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d04e259-e759-405f-8871-30a61f339c2f None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:59.144128 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d04e259-e759-405f-8871-30a61f339c2f None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:59.144407 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d04e259-e759-405f-8871-30a61f339c2f None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:59.145868 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 214/421] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:10:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 10:10:59.150939 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aea394-7d56-4b29-a86c-ae50496ed6ea None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:59.151221 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aea394-7d56-4b29-a86c-ae50496ed6ea None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:59.151492 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aea394-7d56-4b29-a86c-ae50496ed6ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:59.182835 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-07aea394-7d56-4b29-a86c-ae50496ed6ea None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:10:59.184541 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-07aea394-7d56-4b29-a86c-ae50496ed6ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:10:59.298059 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 215/422] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:10:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 10:10:59.303960 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18238a2-78bf-4a73-80d3-8958410b3f08 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:59.321296 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:59.331879 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aea394-7d56-4b29-a86c-ae50496ed6ea None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:59.366199 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:59.368237 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06569e5-548e-4af8-9392-70b0cd0dfe3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:59.368878 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06569e5-548e-4af8-9392-70b0cd0dfe3a None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:59.369157 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06569e5-548e-4af8-9392-70b0cd0dfe3a None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:59.369433 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06569e5-548e-4af8-9392-70b0cd0dfe3a None admin] PATH_INFO: `/v3/projects/5a0951c053754bea9df8fb8448e1b42f` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:59.373060 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06569e5-548e-4af8-9392-70b0cd0dfe3a None admin] RBAC: Authorizing `identity:get_project(project_id=5a0951c053754bea9df8fb8448e1b42f)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:59.374545 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06569e5-548e-4af8-9392-70b0cd0dfe3a None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:59.380547 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 208/423] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Aug 9 10:10:59 2022] GET /identity/v3/projects/5a0951c053754bea9df8fb8448e1b42f => generated 298 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:59.382609 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06569e5-548e-4af8-9392-70b0cd0dfe3a None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:59.472965 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aea394-7d56-4b29-a86c-ae50496ed6ea None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:59.513413 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e80348-809b-4e28-a56c-0a295ddcd884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:59.514314 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e80348-809b-4e28-a56c-0a295ddcd884 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:59.514761 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e80348-809b-4e28-a56c-0a295ddcd884 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:59.515329 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e80348-809b-4e28-a56c-0a295ddcd884 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:59.537423 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e80348-809b-4e28-a56c-0a295ddcd884 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 10:10:59.542867 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-b1e80348-809b-4e28-a56c-0a295ddcd884 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 10:10:59.542867 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:10:59.542867 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:10:59.542867 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:10:59.542867 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:10:59.542867 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:10:59.542867 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:10:59.542867 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:10:59.542867 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:10:59.542867 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:10:59.542867 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:10:59.542867 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:10:59.542867 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 10:10:59.542867 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 10:10:59.542867 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 10:10:59.542867 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 10:10:59.545072 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 10:10:59.545072 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 10:10:59.545072 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 10:10:59.545072 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 10:10:59.545072 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:10:59.545072 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:10:59.545072 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:10:59.545072 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:10:59.545072 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:10:59.545072 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:10:59.545072 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:10:59.545072 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:10:59.545072 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:10:59.545072 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:10:59.545072 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:10:59.545072 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:10:59.546100 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:10:59.546100 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:10:59.546100 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:10:59.546100 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:10:59.546100 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 10:10:59.546100 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 10:10:59.546100 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 10:10:59.546100 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 10:10:59.546100 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 10:10:59.546100 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 10:10:59.546100 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 10:10:59.546100 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:10:59.549143 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 216/424] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Aug 9 10:10:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:10:59.555392 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e80348-809b-4e28-a56c-0a295ddcd884 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:59.592834 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06569e5-548e-4af8-9392-70b0cd0dfe3a None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:59.644062 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:59.666944 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e80348-809b-4e28-a56c-0a295ddcd884 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:59.704300 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e86205e-6a46-4dad-8afa-cffcced52648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:59.705179 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e86205e-6a46-4dad-8afa-cffcced52648 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:59.705602 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e86205e-6a46-4dad-8afa-cffcced52648 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:59.706046 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e86205e-6a46-4dad-8afa-cffcced52648 None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:59.707145 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e86205e-6a46-4dad-8afa-cffcced52648 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:10:59.707589 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e86205e-6a46-4dad-8afa-cffcced52648 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:59.709095 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e86205e-6a46-4dad-8afa-cffcced52648 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:59.717943 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 217/425] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Aug 9 10:10:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:10:59.721904 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f2ad1a-9a17-4d4d-8867-917636e39e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:59.721904 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f2ad1a-9a17-4d4d-8867-917636e39e1f None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:59.721904 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f2ad1a-9a17-4d4d-8867-917636e39e1f None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:59.721904 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f2ad1a-9a17-4d4d-8867-917636e39e1f None admin] PATH_INFO: `/v3/groups/c347f72d01b04bbf8e150c1e32efeb16` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:59.722586 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f2ad1a-9a17-4d4d-8867-917636e39e1f None admin] RBAC: Authorizing `identity:get_group(group_id=c347f72d01b04bbf8e150c1e32efeb16)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:59.723240 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f2ad1a-9a17-4d4d-8867-917636e39e1f None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:59.724305 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e86205e-6a46-4dad-8afa-cffcced52648 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:59.725999 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 209/426] 10.222.0.36 () {56 vars in 1180 bytes} [Tue Aug 9 10:10:59 2022] GET /identity/v3/groups/c347f72d01b04bbf8e150c1e32efeb16 => generated 226 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:10:59.737464 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f2ad1a-9a17-4d4d-8867-917636e39e1f None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:10:59.828143 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:59.881090 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f2ad1a-9a17-4d4d-8867-917636e39e1f None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:59.897561 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e86205e-6a46-4dad-8afa-cffcced52648 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:10:59.917113 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c53f1d8-46e0-455a-9d18-1edd7a8a185b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:59.917966 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c53f1d8-46e0-455a-9d18-1edd7a8a185b None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:59.919051 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c53f1d8-46e0-455a-9d18-1edd7a8a185b None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:59.919466 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c53f1d8-46e0-455a-9d18-1edd7a8a185b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:59.920430 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c53f1d8-46e0-455a-9d18-1edd7a8a185b None admin] RBAC: Adding query filter params (group.id=c347f72d01b04bbf8e150c1e32efeb16, role.id=a9895331e9694fa8b2b50908bb057bcb, scope.project.id=5a0951c053754bea9df8fb8448e1b42f) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:10:59.920887 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c53f1d8-46e0-455a-9d18-1edd7a8a185b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:10:59.922745 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c53f1d8-46e0-455a-9d18-1edd7a8a185b None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:10:59.929431 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 210/427] 10.222.0.36 () {56 vars in 1376 bytes} [Tue Aug 9 10:10:59 2022] GET /identity/v3/role_assignments?group.id=c347f72d01b04bbf8e150c1e32efeb16&scope.project.id=5a0951c053754bea9df8fb8448e1b42f&role.id=a9895331e9694fa8b2b50908bb057bcb => generated 611 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:10:59.930953 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7a7c10-46f2-4b16-a9d4-16e6aa583d3c None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:59.931413 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7a7c10-46f2-4b16-a9d4-16e6aa583d3c None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:59.931975 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7a7c10-46f2-4b16-a9d4-16e6aa583d3c None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:59.933582 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 211/428] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:10:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:10:59.941881 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa93c370-2123-4fc8-90b9-03a72db708fd None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:59.941881 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa93c370-2123-4fc8-90b9-03a72db708fd None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:59.941881 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa93c370-2123-4fc8-90b9-03a72db708fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:59.960298 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32494999-d6ce-4394-af36-49d99b6a9489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:10:59.961033 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32494999-d6ce-4394-af36-49d99b6a9489 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:10:59.961385 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32494999-d6ce-4394-af36-49d99b6a9489 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:10:59.961727 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32494999-d6ce-4394-af36-49d99b6a9489 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:10:59.978214 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-aa93c370-2123-4fc8-90b9-03a72db708fd None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:10:59.978881 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:10:59.979784 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-aa93c370-2123-4fc8-90b9-03a72db708fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:11:00.058133 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32494999-d6ce-4394-af36-49d99b6a9489 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:00.059662 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32494999-d6ce-4394-af36-49d99b6a9489 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:00.147560 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 212/429] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:10:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 10:11:00.187722 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 218/430] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Aug 9 10:10:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 09 10:11:00.193659 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa93c370-2123-4fc8-90b9-03a72db708fd None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:00.196964 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32494999-d6ce-4394-af36-49d99b6a9489 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:00.250223 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:00.259698 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:00.328592 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32494999-d6ce-4394-af36-49d99b6a9489 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:00.339117 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa93c370-2123-4fc8-90b9-03a72db708fd None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:00.370191 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546a9a0b-3fe3-4d26-8d25-510ddda5012c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:00.370835 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546a9a0b-3fe3-4d26-8d25-510ddda5012c None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:00.371269 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546a9a0b-3fe3-4d26-8d25-510ddda5012c None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:00.371712 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546a9a0b-3fe3-4d26-8d25-510ddda5012c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:00.385072 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546a9a0b-3fe3-4d26-8d25-510ddda5012c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 10:11:00.390421 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-546a9a0b-3fe3-4d26-8d25-510ddda5012c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 09 10:11:00.390421 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:00.390421 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:00.390421 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:00.390421 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:00.390421 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:00.390421 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:00.390421 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:00.390421 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:00.390421 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:00.390421 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:00.390421 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:00.390421 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 10:11:00.390421 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 10:11:00.390421 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 10:11:00.390421 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 10:11:00.391276 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 10:11:00.391276 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 10:11:00.391276 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 10:11:00.391276 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 10:11:00.391276 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:00.391276 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:00.391276 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:00.391276 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:00.391276 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:00.391276 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:00.391276 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:00.391276 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:00.391276 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:00.391276 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:00.391276 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:00.391276 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:00.392095 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:00.392095 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:00.392095 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:00.392095 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:00.392095 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 10:11:00.392095 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 10:11:00.392095 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 10:11:00.392095 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 10:11:00.392095 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 10:11:00.392095 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 10:11:00.392095 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 09 10:11:00.392095 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:11:00.392095 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 219/431] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Aug 9 10:11:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 10:11:00.397657 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546a9a0b-3fe3-4d26-8d25-510ddda5012c None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:00.403642 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e3eeb1-45ec-4b76-8b22-e2b6eff4de49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:00.404560 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e3eeb1-45ec-4b76-8b22-e2b6eff4de49 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:00.405097 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e3eeb1-45ec-4b76-8b22-e2b6eff4de49 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:00.405562 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e3eeb1-45ec-4b76-8b22-e2b6eff4de49 None admin] PATH_INFO: `/v3/projects/5a0951c053754bea9df8fb8448e1b42f` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:00.407216 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e3eeb1-45ec-4b76-8b22-e2b6eff4de49 None admin] RBAC: Authorizing `identity:get_project(project_id=5a0951c053754bea9df8fb8448e1b42f)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:00.408870 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e3eeb1-45ec-4b76-8b22-e2b6eff4de49 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:00.411035 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 213/432] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Aug 9 10:11:00 2022] GET /identity/v3/projects/5a0951c053754bea9df8fb8448e1b42f => generated 298 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:00.416878 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e3eeb1-45ec-4b76-8b22-e2b6eff4de49 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:00.514286 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:00.519266 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546a9a0b-3fe3-4d26-8d25-510ddda5012c None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:00.529538 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e3eeb1-45ec-4b76-8b22-e2b6eff4de49 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:00.550267 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:00.560080 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e282c4cd-9be5-4a54-9ee6-80e4b67cc00f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:00.560700 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e282c4cd-9be5-4a54-9ee6-80e4b67cc00f None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:00.560986 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e282c4cd-9be5-4a54-9ee6-80e4b67cc00f None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:00.561260 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e282c4cd-9be5-4a54-9ee6-80e4b67cc00f None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:00.561962 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e282c4cd-9be5-4a54-9ee6-80e4b67cc00f None admin] RBAC: Adding query filter params (name=member) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:00.562265 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e282c4cd-9be5-4a54-9ee6-80e4b67cc00f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:00.564194 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e282c4cd-9be5-4a54-9ee6-80e4b67cc00f None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:00.576280 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 220/433] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Aug 9 10:11:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:00.582104 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e282c4cd-9be5-4a54-9ee6-80e4b67cc00f None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:00.588637 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ac07cc-66d4-4023-a50c-8e6adcc469ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:00.588637 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac07cc-66d4-4023-a50c-8e6adcc469ee None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:00.588637 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac07cc-66d4-4023-a50c-8e6adcc469ee None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:00.588961 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac07cc-66d4-4023-a50c-8e6adcc469ee None admin] PATH_INFO: `/v3/groups/c347f72d01b04bbf8e150c1e32efeb16` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:00.590404 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ac07cc-66d4-4023-a50c-8e6adcc469ee None admin] RBAC: Authorizing `identity:get_group(group_id=c347f72d01b04bbf8e150c1e32efeb16)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:00.592443 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ac07cc-66d4-4023-a50c-8e6adcc469ee None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:00.596322 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 214/434] 10.222.0.36 () {56 vars in 1180 bytes} [Tue Aug 9 10:11:00 2022] GET /identity/v3/groups/c347f72d01b04bbf8e150c1e32efeb16 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:11:00.596322 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5039d838-c71a-4df8-8205-ec5977b3c7d8 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:00.596322 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5039d838-c71a-4df8-8205-ec5977b3c7d8 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:00.596322 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5039d838-c71a-4df8-8205-ec5977b3c7d8 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:00.597535 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 215/435] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:11:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:11:00.605387 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70fb9ac-6611-41f4-b846-dd5b7403897e None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:00.605670 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70fb9ac-6611-41f4-b846-dd5b7403897e None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:00.606084 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70fb9ac-6611-41f4-b846-dd5b7403897e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:00.631945 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-f70fb9ac-6611-41f4-b846-dd5b7403897e None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:11:00.633140 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-f70fb9ac-6611-41f4-b846-dd5b7403897e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:11:00.711779 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e282c4cd-9be5-4a54-9ee6-80e4b67cc00f None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:00.731104 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 216/436] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:11:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 10:11:00.731969 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70fb9ac-6611-41f4-b846-dd5b7403897e None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:00.751071 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183b2c2f-c185-40ba-b0e6-59b7d7483e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:00.752036 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183b2c2f-c185-40ba-b0e6-59b7d7483e8b None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:00.752497 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183b2c2f-c185-40ba-b0e6-59b7d7483e8b None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:00.752946 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183b2c2f-c185-40ba-b0e6-59b7d7483e8b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:00.784336 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:00.831089 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183b2c2f-c185-40ba-b0e6-59b7d7483e8b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:00.832561 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183b2c2f-c185-40ba-b0e6-59b7d7483e8b None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:00.838736 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70fb9ac-6611-41f4-b846-dd5b7403897e None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:00.852836 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:00.877967 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e39ceaa-8054-4f7c-bbe2-f1441d3f5cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:00.878686 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e39ceaa-8054-4f7c-bbe2-f1441d3f5cd0 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:00.878964 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e39ceaa-8054-4f7c-bbe2-f1441d3f5cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:00.879355 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e39ceaa-8054-4f7c-bbe2-f1441d3f5cd0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:00.880084 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e39ceaa-8054-4f7c-bbe2-f1441d3f5cd0 None admin] RBAC: Adding query filter params (group.id=c347f72d01b04bbf8e150c1e32efeb16, role.id=af19908af5d6489696eb27791925a5aa, scope.project.id=5a0951c053754bea9df8fb8448e1b42f) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:00.880439 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e39ceaa-8054-4f7c-bbe2-f1441d3f5cd0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:00.890511 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e39ceaa-8054-4f7c-bbe2-f1441d3f5cd0 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:00.896855 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 217/437] 10.222.0.36 () {56 vars in 1376 bytes} [Tue Aug 9 10:11:00 2022] GET /identity/v3/role_assignments?group.id=c347f72d01b04bbf8e150c1e32efeb16&scope.project.id=5a0951c053754bea9df8fb8448e1b42f&role.id=af19908af5d6489696eb27791925a5aa => generated 611 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:00.897685 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e39ceaa-8054-4f7c-bbe2-f1441d3f5cd0 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:00.951978 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 221/438] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Aug 9 10:11:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 10:11:00.957692 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183b2c2f-c185-40ba-b0e6-59b7d7483e8b None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:01.039877 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:01.063480 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e39ceaa-8054-4f7c-bbe2-f1441d3f5cd0 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:01.098362 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183b2c2f-c185-40ba-b0e6-59b7d7483e8b None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:01.113341 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7cf760-6b0f-4469-a6e8-03ab1c12f61b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:01.114388 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7cf760-6b0f-4469-a6e8-03ab1c12f61b None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:01.114913 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7cf760-6b0f-4469-a6e8-03ab1c12f61b None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:01.115406 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7cf760-6b0f-4469-a6e8-03ab1c12f61b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:01.130248 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7cf760-6b0f-4469-a6e8-03ab1c12f61b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 10:11:01.138856 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-fe7cf760-6b0f-4469-a6e8-03ab1c12f61b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 10:11:01.138856 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:01.138856 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:01.138856 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:01.138856 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:01.138856 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:01.138856 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:01.138856 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:01.138856 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:01.138856 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:01.138856 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:01.138856 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:01.138856 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 10:11:01.138856 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 10:11:01.138856 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 10:11:01.138856 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 10:11:01.139848 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 10:11:01.139848 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 10:11:01.139848 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 10:11:01.139848 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 10:11:01.139848 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:01.139848 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:01.139848 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:01.139848 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:01.139848 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:01.139848 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:01.139848 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:01.139848 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:01.139848 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:01.139848 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:01.139848 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:01.139848 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:01.140636 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:01.140636 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:01.140636 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:01.140636 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:01.140636 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 10:11:01.140636 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 10:11:01.140636 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 10:11:01.140636 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 10:11:01.140636 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 10:11:01.140636 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 10:11:01.140636 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 10:11:01.140636 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:01.141706 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 218/439] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Aug 9 10:11:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:01.143852 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dbb69c-7049-4e89-aebd-52b0b893eef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:01.144489 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dbb69c-7049-4e89-aebd-52b0b893eef7 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:01.144769 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dbb69c-7049-4e89-aebd-52b0b893eef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:01.145042 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dbb69c-7049-4e89-aebd-52b0b893eef7 None admin] PATH_INFO: `/v3/projects/a0b7ec3eb0324b10934f50e12805a4e4` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:01.146312 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dbb69c-7049-4e89-aebd-52b0b893eef7 None admin] RBAC: Authorizing `identity:get_project(project_id=a0b7ec3eb0324b10934f50e12805a4e4)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:01.147476 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7cf760-6b0f-4469-a6e8-03ab1c12f61b None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:01.147841 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dbb69c-7049-4e89-aebd-52b0b893eef7 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:01.149542 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 222/440] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Aug 9 10:11:00 2022] GET /identity/v3/projects/a0b7ec3eb0324b10934f50e12805a4e4 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:11:01.155938 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dbb69c-7049-4e89-aebd-52b0b893eef7 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:01.202850 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:01.275768 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dbb69c-7049-4e89-aebd-52b0b893eef7 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:01.289667 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7cf760-6b0f-4469-a6e8-03ab1c12f61b None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:01.308324 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:01.318960 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3987b82-025f-4dfc-9b27-a80e4b0de08b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:01.319588 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3987b82-025f-4dfc-9b27-a80e4b0de08b None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:01.319865 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3987b82-025f-4dfc-9b27-a80e4b0de08b None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:01.320410 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3987b82-025f-4dfc-9b27-a80e4b0de08b None admin] PATH_INFO: `/v3/groups/c347f72d01b04bbf8e150c1e32efeb16` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:01.321237 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3987b82-025f-4dfc-9b27-a80e4b0de08b None admin] RBAC: Authorizing `identity:get_group(group_id=c347f72d01b04bbf8e150c1e32efeb16)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:01.322679 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3987b82-025f-4dfc-9b27-a80e4b0de08b None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:01.324219 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 223/441] 10.222.0.36 () {56 vars in 1180 bytes} [Tue Aug 9 10:11:01 2022] GET /identity/v3/groups/c347f72d01b04bbf8e150c1e32efeb16 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:01.324219 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a3171-ea19-41b4-8c87-a520174ddb5a None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:01.324219 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a3171-ea19-41b4-8c87-a520174ddb5a None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:01.324219 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a3171-ea19-41b4-8c87-a520174ddb5a None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:01.324219 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 224/442] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:11:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:11:01.331322 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919a3171-ea19-41b4-8c87-a520174ddb5a None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:01.338418 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd729d5-051e-415f-ade1-5995917fa5cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:01.339029 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd729d5-051e-415f-ade1-5995917fa5cf None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:01.339309 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd729d5-051e-415f-ade1-5995917fa5cf None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:01.339997 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd729d5-051e-415f-ade1-5995917fa5cf None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:01.340963 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd729d5-051e-415f-ade1-5995917fa5cf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:01.341270 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd729d5-051e-415f-ade1-5995917fa5cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:01.343030 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd729d5-051e-415f-ade1-5995917fa5cf None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:01.351388 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 219/443] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Aug 9 10:11:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:11:01.352767 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00285c98-85af-4464-9931-a44dd79b27cc None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:01.353101 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00285c98-85af-4464-9931-a44dd79b27cc None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:01.353420 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00285c98-85af-4464-9931-a44dd79b27cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:01.370399 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-00285c98-85af-4464-9931-a44dd79b27cc None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:11:01.372222 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-00285c98-85af-4464-9931-a44dd79b27cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:11:01.429992 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919a3171-ea19-41b4-8c87-a520174ddb5a None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:01.437016 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 220/444] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:11:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 10:11:01.437953 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00285c98-85af-4464-9931-a44dd79b27cc None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:01.465200 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:01.467842 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b406a606-ce9e-4545-9d69-0dd68d1ef99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:01.468473 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b406a606-ce9e-4545-9d69-0dd68d1ef99e None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:01.468772 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b406a606-ce9e-4545-9d69-0dd68d1ef99e None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:01.469021 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b406a606-ce9e-4545-9d69-0dd68d1ef99e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:01.469731 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b406a606-ce9e-4545-9d69-0dd68d1ef99e None admin] RBAC: Adding query filter params (group.id=c347f72d01b04bbf8e150c1e32efeb16, role.id=a9895331e9694fa8b2b50908bb057bcb, scope.project.id=a0b7ec3eb0324b10934f50e12805a4e4) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:01.470079 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b406a606-ce9e-4545-9d69-0dd68d1ef99e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:01.471522 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b406a606-ce9e-4545-9d69-0dd68d1ef99e None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:01.477214 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 225/445] 10.222.0.36 () {56 vars in 1376 bytes} [Tue Aug 9 10:11:01 2022] GET /identity/v3/role_assignments?group.id=c347f72d01b04bbf8e150c1e32efeb16&scope.project.id=a0b7ec3eb0324b10934f50e12805a4e4&role.id=a9895331e9694fa8b2b50908bb057bcb => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:11:01.478009 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b406a606-ce9e-4545-9d69-0dd68d1ef99e None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:01.547465 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:01.547675 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00285c98-85af-4464-9931-a44dd79b27cc None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:01.588344 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9ea6e6-3ee7-4d4f-9c3c-b0f530dfc1bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:01.588867 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ea6e6-3ee7-4d4f-9c3c-b0f530dfc1bd None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:01.589145 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ea6e6-3ee7-4d4f-9c3c-b0f530dfc1bd None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:01.589414 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ea6e6-3ee7-4d4f-9c3c-b0f530dfc1bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:01.597750 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b406a606-ce9e-4545-9d69-0dd68d1ef99e None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:01.639609 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c93e4d-1eab-4268-8183-2a1dc5fe4b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:01.640964 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c93e4d-1eab-4268-8183-2a1dc5fe4b5f None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:01.641411 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c93e4d-1eab-4268-8183-2a1dc5fe4b5f None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:01.641884 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c93e4d-1eab-4268-8183-2a1dc5fe4b5f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:01.658650 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c93e4d-1eab-4268-8183-2a1dc5fe4b5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 10:11:01.663541 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-d7c93e4d-1eab-4268-8183-2a1dc5fe4b5f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 10:11:01.663541 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:01.663541 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:01.663541 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:01.663541 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:01.663541 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:01.663541 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:01.663541 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:01.663541 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:01.663541 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:01.663541 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:01.663541 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:01.663541 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 10:11:01.663541 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 10:11:01.663541 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 10:11:01.663541 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 10:11:01.664426 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 10:11:01.664426 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 10:11:01.664426 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 10:11:01.664426 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 10:11:01.664426 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:01.664426 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:01.664426 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:01.664426 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:01.664426 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:01.664426 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:01.664426 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:01.664426 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:01.664426 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:01.664426 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:01.664426 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:01.664426 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:01.665233 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:01.665233 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:01.665233 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:01.665233 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:01.665233 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 10:11:01.665233 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 10:11:01.665233 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 10:11:01.665233 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 10:11:01.665233 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 10:11:01.665233 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 10:11:01.665233 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 10:11:01.665233 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:11:01.665233 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 226/446] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Aug 9 10:11:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:01.674744 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c93e4d-1eab-4268-8183-2a1dc5fe4b5f None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:01.685294 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9ea6e6-3ee7-4d4f-9c3c-b0f530dfc1bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:01.687796 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9ea6e6-3ee7-4d4f-9c3c-b0f530dfc1bd None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:01.727044 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:01.795332 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c93e4d-1eab-4268-8183-2a1dc5fe4b5f None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:01.816932 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:01.821517 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 221/447] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Aug 9 10:11:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 10:11:01.828324 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9ea6e6-3ee7-4d4f-9c3c-b0f530dfc1bd None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:01.838186 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2576dec-f1d8-49a6-a796-51a77337d0e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:01.838968 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2576dec-f1d8-49a6-a796-51a77337d0e3 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:01.839185 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2576dec-f1d8-49a6-a796-51a77337d0e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:01.839448 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2576dec-f1d8-49a6-a796-51a77337d0e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:01.840190 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2576dec-f1d8-49a6-a796-51a77337d0e3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:01.840496 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2576dec-f1d8-49a6-a796-51a77337d0e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:01.841912 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2576dec-f1d8-49a6-a796-51a77337d0e3 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:01.853823 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 227/448] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Aug 9 10:11:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:01.860006 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2576dec-f1d8-49a6-a796-51a77337d0e3 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:01.937288 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9ea6e6-3ee7-4d4f-9c3c-b0f530dfc1bd None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:01.963080 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:01.972005 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4373d2c-e9b2-4936-b2cf-df93db77dc22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:01.972684 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4373d2c-e9b2-4936-b2cf-df93db77dc22 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:01.972969 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4373d2c-e9b2-4936-b2cf-df93db77dc22 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:01.973248 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4373d2c-e9b2-4936-b2cf-df93db77dc22 None admin] PATH_INFO: `/v3/projects/a0b7ec3eb0324b10934f50e12805a4e4` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:01.974411 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4373d2c-e9b2-4936-b2cf-df93db77dc22 None admin] RBAC: Authorizing `identity:get_project(project_id=a0b7ec3eb0324b10934f50e12805a4e4)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:01.975855 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4373d2c-e9b2-4936-b2cf-df93db77dc22 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:01.977105 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2576dec-f1d8-49a6-a796-51a77337d0e3 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:01.977514 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 222/449] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Aug 9 10:11:01 2022] GET /identity/v3/projects/a0b7ec3eb0324b10934f50e12805a4e4 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:11:01.983723 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4373d2c-e9b2-4936-b2cf-df93db77dc22 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:02.012677 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6b7f45-740a-4471-b9d8-9d0d2c490d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:02.013278 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b7f45-740a-4471-b9d8-9d0d2c490d6a None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:02.013556 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b7f45-740a-4471-b9d8-9d0d2c490d6a None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:02.013832 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b7f45-740a-4471-b9d8-9d0d2c490d6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:02.062800 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:02.081349 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6b7f45-740a-4471-b9d8-9d0d2c490d6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:02.082820 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6b7f45-740a-4471-b9d8-9d0d2c490d6a None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:02.083955 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4373d2c-e9b2-4936-b2cf-df93db77dc22 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:02.120605 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3c2c6b-a624-4ba3-b901-4d508f8174eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:02.121154 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3c2c6b-a624-4ba3-b901-4d508f8174eb None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:02.122066 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3c2c6b-a624-4ba3-b901-4d508f8174eb None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:02.122258 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3c2c6b-a624-4ba3-b901-4d508f8174eb None admin] PATH_INFO: `/v3/groups/c347f72d01b04bbf8e150c1e32efeb16` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:02.123379 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3c2c6b-a624-4ba3-b901-4d508f8174eb None admin] RBAC: Authorizing `identity:get_group(group_id=c347f72d01b04bbf8e150c1e32efeb16)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:02.124821 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3c2c6b-a624-4ba3-b901-4d508f8174eb None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:02.126407 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 223/450] 10.222.0.36 () {56 vars in 1180 bytes} [Tue Aug 9 10:11:01 2022] GET /identity/v3/groups/c347f72d01b04bbf8e150c1e32efeb16 => generated 226 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:11:02.132079 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3c2c6b-a624-4ba3-b901-4d508f8174eb None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:02.184606 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 228/451] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Aug 9 10:11:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 09 10:11:02.190108 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6b7f45-740a-4471-b9d8-9d0d2c490d6a None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:02.198828 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:02.247053 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3c2c6b-a624-4ba3-b901-4d508f8174eb None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:02.273058 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:02.280841 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df487ff-1d5f-4d52-803e-2830f4232494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:02.281438 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df487ff-1d5f-4d52-803e-2830f4232494 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:02.281715 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df487ff-1d5f-4d52-803e-2830f4232494 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:02.282016 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df487ff-1d5f-4d52-803e-2830f4232494 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:02.282740 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df487ff-1d5f-4d52-803e-2830f4232494 None admin] RBAC: Adding query filter params (group.id=c347f72d01b04bbf8e150c1e32efeb16, role.id=af19908af5d6489696eb27791925a5aa, scope.project.id=a0b7ec3eb0324b10934f50e12805a4e4) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:02.283049 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df487ff-1d5f-4d52-803e-2830f4232494 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:02.284470 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df487ff-1d5f-4d52-803e-2830f4232494 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:02.290027 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 224/452] 10.222.0.36 () {56 vars in 1376 bytes} [Tue Aug 9 10:11:02 2022] GET /identity/v3/role_assignments?group.id=c347f72d01b04bbf8e150c1e32efeb16&scope.project.id=a0b7ec3eb0324b10934f50e12805a4e4&role.id=af19908af5d6489696eb27791925a5aa => generated 611 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:11:02.291726 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6b7f45-740a-4471-b9d8-9d0d2c490d6a None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:02.328608 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4212dbaf-10ac-4589-8dd9-0bbead4c78f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:02.329255 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4212dbaf-10ac-4589-8dd9-0bbead4c78f7 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:02.329533 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4212dbaf-10ac-4589-8dd9-0bbead4c78f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:02.329806 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4212dbaf-10ac-4589-8dd9-0bbead4c78f7 None admin] PATH_INFO: `/v3/projects/182565a8c7ef44d4a6cfcadb2f45a71f` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:02.330969 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4212dbaf-10ac-4589-8dd9-0bbead4c78f7 None admin] RBAC: Authorizing `identity:get_project(project_id=182565a8c7ef44d4a6cfcadb2f45a71f)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:02.332411 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4212dbaf-10ac-4589-8dd9-0bbead4c78f7 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:02.334099 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 229/453] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Aug 9 10:11:02 2022] GET /identity/v3/projects/182565a8c7ef44d4a6cfcadb2f45a71f => generated 344 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:11:02.339887 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df487ff-1d5f-4d52-803e-2830f4232494 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:02.444133 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df487ff-1d5f-4d52-803e-2830f4232494 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:02.472139 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:02.480435 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cd9faa-35bb-433f-be5e-f7ce9e0e2f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:02.481207 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cd9faa-35bb-433f-be5e-f7ce9e0e2f13 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:02.481504 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cd9faa-35bb-433f-be5e-f7ce9e0e2f13 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:02.481965 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cd9faa-35bb-433f-be5e-f7ce9e0e2f13 None admin] PATH_INFO: `/v3/groups/28503669151c41b589c080d2375f205f` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:02.482884 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cd9faa-35bb-433f-be5e-f7ce9e0e2f13 None admin] RBAC: Authorizing `identity:get_group(group_id=28503669151c41b589c080d2375f205f)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:02.484319 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cd9faa-35bb-433f-be5e-f7ce9e0e2f13 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:02.485898 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 225/454] 10.222.0.36 () {56 vars in 1180 bytes} [Tue Aug 9 10:11:02 2022] GET /identity/v3/groups/28503669151c41b589c080d2375f205f => generated 229 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:11:02.491716 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4212dbaf-10ac-4589-8dd9-0bbead4c78f7 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:02.596997 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4212dbaf-10ac-4589-8dd9-0bbead4c78f7 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:02.629681 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe46598e-678c-491c-9b81-6a4088795eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:02.630304 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe46598e-678c-491c-9b81-6a4088795eaf None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:02.630580 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe46598e-678c-491c-9b81-6a4088795eaf None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:02.630849 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe46598e-678c-491c-9b81-6a4088795eaf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:02.631567 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe46598e-678c-491c-9b81-6a4088795eaf None admin] RBAC: Adding query filter params (group.id=28503669151c41b589c080d2375f205f, role.id=89ca30cbbb634be8a96e9921aa56626b, scope.project.id=182565a8c7ef44d4a6cfcadb2f45a71f) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:02.631871 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe46598e-678c-491c-9b81-6a4088795eaf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:02.633291 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe46598e-678c-491c-9b81-6a4088795eaf None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:02.640320 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 230/455] 10.222.0.36 () {56 vars in 1376 bytes} [Tue Aug 9 10:11:02 2022] GET /identity/v3/role_assignments?group.id=28503669151c41b589c080d2375f205f&scope.project.id=182565a8c7ef44d4a6cfcadb2f45a71f&role.id=89ca30cbbb634be8a96e9921aa56626b => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:05.230529 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0052775a-8994-4cfa-92dd-113b44f9d2ca None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:05.231131 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0052775a-8994-4cfa-92dd-113b44f9d2ca None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:05.231131 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0052775a-8994-4cfa-92dd-113b44f9d2ca None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:05.232881 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 226/456] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:11:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:11:05.237679 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86baa47-856b-48d0-a352-520a46ed8730 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:05.238101 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86baa47-856b-48d0-a352-520a46ed8730 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:05.238303 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86baa47-856b-48d0-a352-520a46ed8730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:05.262867 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-f86baa47-856b-48d0-a352-520a46ed8730 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:11:05.264061 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-f86baa47-856b-48d0-a352-520a46ed8730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:11:05.273914 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:05.354799 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b93c1c-53c8-4d6a-bc35-b5d4031ba8d5 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:05.355345 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b93c1c-53c8-4d6a-bc35-b5d4031ba8d5 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:05.356099 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 231/457] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:11:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 10:11:05.356526 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b93c1c-53c8-4d6a-bc35-b5d4031ba8d5 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:05.361930 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 227/458] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:11:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:11:05.379357 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b9a11-61d9-4fc6-a12a-ea9495428cb6 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:05.379648 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b9a11-61d9-4fc6-a12a-ea9495428cb6 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:05.379927 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b9a11-61d9-4fc6-a12a-ea9495428cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:05.399756 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b93c1c-53c8-4d6a-bc35-b5d4031ba8d5 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:05.404085 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-955b9a11-61d9-4fc6-a12a-ea9495428cb6 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:11:05.405290 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-955b9a11-61d9-4fc6-a12a-ea9495428cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:11:05.497557 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 232/459] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:11:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 10:11:05.506889 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6bf40a-0152-402e-a438-4bb52e3b087d None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:05.507178 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6bf40a-0152-402e-a438-4bb52e3b087d None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:05.507452 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6bf40a-0152-402e-a438-4bb52e3b087d None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:05.509597 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 233/460] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:11:05 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:11:05.518878 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be50c6fa-2f42-4436-a43b-e59d5fd7fa91 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:05.519396 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be50c6fa-2f42-4436-a43b-e59d5fd7fa91 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:05.519675 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be50c6fa-2f42-4436-a43b-e59d5fd7fa91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:05.543883 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-be50c6fa-2f42-4436-a43b-e59d5fd7fa91 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:11:05.545466 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-be50c6fa-2f42-4436-a43b-e59d5fd7fa91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:11:05.555784 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b93c1c-53c8-4d6a-bc35-b5d4031ba8d5 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:05.599416 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440a1cc7-b9b6-4b29-a300-789fa7d31e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:05.600383 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a1cc7-b9b6-4b29-a300-789fa7d31e62 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:05.600875 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a1cc7-b9b6-4b29-a300-789fa7d31e62 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:05.601342 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a1cc7-b9b6-4b29-a300-789fa7d31e62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:05.613564 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440a1cc7-b9b6-4b29-a300-789fa7d31e62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:05.615427 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440a1cc7-b9b6-4b29-a300-789fa7d31e62 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:05.631416 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-440a1cc7-b9b6-4b29-a300-789fa7d31e62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:05.631416 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:05.631416 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:05.631416 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:05.631416 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:05.631416 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:05.631416 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:05.631416 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:05.631416 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:05.631416 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:05.631416 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:05.631416 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:05.631416 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 10:11:05.631416 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 10:11:05.631416 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 10:11:05.631416 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 10:11:05.632339 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:05.632339 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:05.632339 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:05.632339 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:05.632339 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:05.632339 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:05.632339 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:05.632339 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:05.632339 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:05.632339 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:05.632339 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:05.632339 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:05.632339 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:05.632339 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:05.632339 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:05.632339 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:05.632339 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 10:11:05.639028 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 10:11:05.639028 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:05.639028 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:05.639207 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 234/461] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:11:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 10:11:05.639207 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be50c6fa-2f42-4436-a43b-e59d5fd7fa91 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:05.639207 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:05.641180 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 228/462] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:11:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:05.653737 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440a1cc7-b9b6-4b29-a300-789fa7d31e62 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:05.711048 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:05.760941 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be50c6fa-2f42-4436-a43b-e59d5fd7fa91 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:05.785610 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440a1cc7-b9b6-4b29-a300-789fa7d31e62 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:05.798733 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6c9469-bfe5-4f53-8139-9eb69fb9a114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:05.799624 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c9469-bfe5-4f53-8139-9eb69fb9a114 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:05.800114 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c9469-bfe5-4f53-8139-9eb69fb9a114 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:05.800554 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c9469-bfe5-4f53-8139-9eb69fb9a114 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:05.812529 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6c9469-bfe5-4f53-8139-9eb69fb9a114 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:05.814630 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6c9469-bfe5-4f53-8139-9eb69fb9a114 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:05.829808 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00d2987-05f9-4afc-a61c-3a43619b7b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:05.830453 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d2987-05f9-4afc-a61c-3a43619b7b7d None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:05.830726 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d2987-05f9-4afc-a61c-3a43619b7b7d None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:05.831003 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d2987-05f9-4afc-a61c-3a43619b7b7d None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:05.831655 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00d2987-05f9-4afc-a61c-3a43619b7b7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:05.831961 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00d2987-05f9-4afc-a61c-3a43619b7b7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:05.832940 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-3a6c9469-bfe5-4f53-8139-9eb69fb9a114 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:05.832940 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:05.832940 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:05.832940 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:05.832940 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:05.832940 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:05.832940 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:05.832940 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:05.832940 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:05.832940 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:05.832940 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:05.832940 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:05.832940 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 10:11:05.832940 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 10:11:05.832940 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 10:11:05.832940 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 10:11:05.833796 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:05.833796 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:05.833796 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:05.833796 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:05.833796 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:05.833796 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:05.833796 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:05.833796 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:05.833796 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:05.833796 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:05.833796 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:05.833796 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:05.833796 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:05.833796 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:05.833796 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:05.833796 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:05.833796 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 10:11:05.834675 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 10:11:05.834675 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:05.834675 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:11:05.834836 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00d2987-05f9-4afc-a61c-3a43619b7b7d None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:05.836400 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 235/463] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:11:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:05.836400 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6c9469-bfe5-4f53-8139-9eb69fb9a114 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:05.847909 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 229/464] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Aug 9 10:11:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:11:05.849191 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a64cb-f032-4fb6-ad41-66d6dd38ed09 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:05.849471 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a64cb-f032-4fb6-ad41-66d6dd38ed09 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:05.849738 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a64cb-f032-4fb6-ad41-66d6dd38ed09 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:05.851098 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 230/465] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:11:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:11:05.855101 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4a64cb-f032-4fb6-ad41-66d6dd38ed09 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:05.901749 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:05.954304 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6c9469-bfe5-4f53-8139-9eb69fb9a114 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:05.965430 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4a64cb-f032-4fb6-ad41-66d6dd38ed09 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:05.975587 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:05.994192 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b39486d-f4ee-4882-959a-4cc0e98c4e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:05.994806 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b39486d-f4ee-4882-959a-4cc0e98c4e6e None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:05.995075 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b39486d-f4ee-4882-959a-4cc0e98c4e6e None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:05.995340 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b39486d-f4ee-4882-959a-4cc0e98c4e6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:06.002018 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a6c661-40d0-41af-9567-290647b480b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:06.002631 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a6c661-40d0-41af-9567-290647b480b7 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:06.002895 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a6c661-40d0-41af-9567-290647b480b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:06.003167 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a6c661-40d0-41af-9567-290647b480b7 None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:06.003813 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a6c661-40d0-41af-9567-290647b480b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:06.004117 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a6c661-40d0-41af-9567-290647b480b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:06.005494 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a6c661-40d0-41af-9567-290647b480b7 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:06.007588 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b39486d-f4ee-4882-959a-4cc0e98c4e6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:06.009201 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b39486d-f4ee-4882-959a-4cc0e98c4e6e None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:06.017266 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 231/466] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Aug 9 10:11:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:06.018032 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a6c661-40d0-41af-9567-290647b480b7 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:06.029034 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-8b39486d-f4ee-4882-959a-4cc0e98c4e6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:06.029034 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:06.029034 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:06.029034 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:06.029034 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:06.029034 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:06.029034 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:06.029034 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:06.029034 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:06.029034 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:06.029034 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:06.029034 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:06.029034 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 10:11:06.029034 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 10:11:06.029034 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 10:11:06.029034 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 10:11:06.030243 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:06.030243 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:06.030243 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:06.030243 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:06.030243 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:06.030243 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:06.030243 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:06.030243 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:06.030243 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:06.030243 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:06.030243 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:06.030243 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:06.030243 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:06.030243 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:06.030243 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:06.030243 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:06.030243 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 10:11:06.031216 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 10:11:06.031216 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:06.031216 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:11:06.037159 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 236/467] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:11:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:06.038767 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19db7d3b-4ac5-4c72-9038-f297edd092b0 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:06.039189 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19db7d3b-4ac5-4c72-9038-f297edd092b0 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:06.039625 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19db7d3b-4ac5-4c72-9038-f297edd092b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:06.058553 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-19db7d3b-4ac5-4c72-9038-f297edd092b0 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:11:06.060282 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-19db7d3b-4ac5-4c72-9038-f297edd092b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:11:06.124360 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a6c661-40d0-41af-9567-290647b480b7 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:06.134184 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 237/468] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:11:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 10:11:06.135010 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19db7d3b-4ac5-4c72-9038-f297edd092b0 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:06.171494 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83edb3b2-434d-4b7b-9735-2b776f05c2c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:06.172144 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83edb3b2-434d-4b7b-9735-2b776f05c2c5 None admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:06.172425 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83edb3b2-434d-4b7b-9735-2b776f05c2c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:06.172725 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83edb3b2-434d-4b7b-9735-2b776f05c2c5 None admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:06.173362 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83edb3b2-434d-4b7b-9735-2b776f05c2c5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:06.174835 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83edb3b2-434d-4b7b-9735-2b776f05c2c5 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:06.178141 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:06.197769 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 232/469] 10.222.0.36 () {60 vars in 1132 bytes} [Tue Aug 9 10:11:06 2022] POST /identity/v3/users => generated 246 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:11:06.198836 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83edb3b2-434d-4b7b-9735-2b776f05c2c5 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:06.232338 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:06.282135 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19db7d3b-4ac5-4c72-9038-f297edd092b0 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:06.322747 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83edb3b2-434d-4b7b-9735-2b776f05c2c5 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:06.337228 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033fcd86-5201-4733-aa44-d973805f7946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:06.338484 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033fcd86-5201-4733-aa44-d973805f7946 None admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:06.338909 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033fcd86-5201-4733-aa44-d973805f7946 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:06.339321 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033fcd86-5201-4733-aa44-d973805f7946 None admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:06.340436 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033fcd86-5201-4733-aa44-d973805f7946 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:06.342820 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033fcd86-5201-4733-aa44-d973805f7946 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:06.365639 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d70b26-b09c-4a01-958a-93501272e5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:06.366481 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d70b26-b09c-4a01-958a-93501272e5ca None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:06.366797 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d70b26-b09c-4a01-958a-93501272e5ca None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:06.367088 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d70b26-b09c-4a01-958a-93501272e5ca None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:06.367783 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d70b26-b09c-4a01-958a-93501272e5ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:06.368087 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d70b26-b09c-4a01-958a-93501272e5ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:06.369465 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d70b26-b09c-4a01-958a-93501272e5ca None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:06.372587 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 238/470] 10.222.0.36 () {60 vars in 1132 bytes} [Tue Aug 9 10:11:06 2022] POST /identity/v3/users => generated 248 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:11:06.373884 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033fcd86-5201-4733-aa44-d973805f7946 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:06.388408 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 233/471] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Aug 9 10:11:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:06.394824 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d70b26-b09c-4a01-958a-93501272e5ca None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:06.510219 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:06.514108 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:06.522261 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033fcd86-5201-4733-aa44-d973805f7946 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:06.537126 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d70b26-b09c-4a01-958a-93501272e5ca None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:06.562784 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227502c4-56a2-442b-8b10-d2ac6dd93322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:06.563537 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227502c4-56a2-442b-8b10-d2ac6dd93322 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:06.563717 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227502c4-56a2-442b-8b10-d2ac6dd93322 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:06.563938 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227502c4-56a2-442b-8b10-d2ac6dd93322 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:06.577840 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227502c4-56a2-442b-8b10-d2ac6dd93322 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:06.579465 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227502c4-56a2-442b-8b10-d2ac6dd93322 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:06.579645 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9efa55-e22b-42c6-bb61-c040c946a6d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:06.580212 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9efa55-e22b-42c6-bb61-c040c946a6d5 None admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:06.580490 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9efa55-e22b-42c6-bb61-c040c946a6d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:06.580768 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9efa55-e22b-42c6-bb61-c040c946a6d5 None admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:06.581407 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9efa55-e22b-42c6-bb61-c040c946a6d5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:06.583438 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9efa55-e22b-42c6-bb61-c040c946a6d5 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:06.595287 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-227502c4-56a2-442b-8b10-d2ac6dd93322 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:06.595287 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:06.595287 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:06.595287 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:06.595287 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:06.595287 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:06.595287 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:06.595287 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:06.595287 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:06.595287 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:06.595287 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:06.595287 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:06.595287 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 10:11:06.595287 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 10:11:06.595287 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 10:11:06.595287 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 10:11:06.596312 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:06.596312 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:06.596312 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:06.596312 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:06.596312 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:06.596312 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:06.596312 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:06.596312 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:06.596312 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:06.596312 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:06.596312 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:06.596312 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:06.596312 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:06.596312 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:06.596312 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:06.596312 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:06.596312 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 10:11:06.597197 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 10:11:06.597197 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:06.597197 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:11:06.597197 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 239/472] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:11:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:06.597802 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535781c3-0259-4208-bbcf-22b29930084f None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:06.598132 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535781c3-0259-4208-bbcf-22b29930084f None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:06.598479 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535781c3-0259-4208-bbcf-22b29930084f None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:06.599856 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 240/473] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:11:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:11:06.602435 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535781c3-0259-4208-bbcf-22b29930084f None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:06.611572 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 234/474] 10.222.0.36 () {60 vars in 1132 bytes} [Tue Aug 9 10:11:06 2022] POST /identity/v3/users => generated 248 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 10:11:06.612715 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b9ed2e-b1d8-4422-8b4a-97b0f074255c None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:06.613001 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b9ed2e-b1d8-4422-8b4a-97b0f074255c None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:06.613279 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b9ed2e-b1d8-4422-8b4a-97b0f074255c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:06.642390 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-65b9ed2e-b1d8-4422-8b4a-97b0f074255c None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:11:06.643602 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-65b9ed2e-b1d8-4422-8b4a-97b0f074255c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:11:06.743574 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535781c3-0259-4208-bbcf-22b29930084f None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:06.749618 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 235/475] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:11:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 10:11:06.781364 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b9ed2e-b1d8-4422-8b4a-97b0f074255c None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:06.805267 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7112d4-6f46-4d65-b747-0b38d5ea132f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:06.805808 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7112d4-6f46-4d65-b747-0b38d5ea132f None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:06.806110 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7112d4-6f46-4d65-b747-0b38d5ea132f None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:06.806378 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7112d4-6f46-4d65-b747-0b38d5ea132f None admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:06.807044 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7112d4-6f46-4d65-b747-0b38d5ea132f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:06.807344 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7112d4-6f46-4d65-b747-0b38d5ea132f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:06.809272 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7112d4-6f46-4d65-b747-0b38d5ea132f None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:06.837518 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 241/476] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Aug 9 10:11:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:11:06.845888 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7112d4-6f46-4d65-b747-0b38d5ea132f None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:06.855264 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:06.885177 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:06.926993 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b9ed2e-b1d8-4422-8b4a-97b0f074255c None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:06.960149 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7112d4-6f46-4d65-b747-0b38d5ea132f None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:06.975405 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd63e14-6eb3-4dc3-8861-c93d09ddc642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:06.976006 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd63e14-6eb3-4dc3-8861-c93d09ddc642 None admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:06.976289 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd63e14-6eb3-4dc3-8861-c93d09ddc642 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:06.976729 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd63e14-6eb3-4dc3-8861-c93d09ddc642 None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:06.977195 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd63e14-6eb3-4dc3-8861-c93d09ddc642 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:06.978691 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd63e14-6eb3-4dc3-8861-c93d09ddc642 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:06.987025 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.sql.core [None req-8dd63e14-6eb3-4dc3-8861-c93d09ddc642 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 09 10:11:06.987025 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 09 10:11:06.987025 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [parameters: {'id': '834b472e9bc048ec9a981c931143a16b', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 09 10:11:06.987025 dv-cinder-852364-2-smb devstack@keystone.service[80106]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80106) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 09 10:11:07.001116 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960ca09e-bf0b-4783-b172-6d91117211b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:07.002052 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ca09e-bf0b-4783-b172-6d91117211b6 None admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:07.002529 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ca09e-bf0b-4783-b172-6d91117211b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:07.003024 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ca09e-bf0b-4783-b172-6d91117211b6 None admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:07.003863 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960ca09e-bf0b-4783-b172-6d91117211b6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:07.005472 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960ca09e-bf0b-4783-b172-6d91117211b6 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:07.006988 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-8dd63e14-6eb3-4dc3-8861-c93d09ddc642 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 09 10:11:07.006988 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:07.006988 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 09 10:11:07.006988 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 09 10:11:07.006988 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 09 10:11:07.006988 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 09 10:11:07.006988 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 09 10:11:07.006988 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application result = self._query(query) Aug 09 10:11:07.006988 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 09 10:11:07.006988 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application conn.query(q) Aug 09 10:11:07.006988 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 09 10:11:07.006988 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 09 10:11:07.006988 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 09 10:11:07.006988 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application result.read() Aug 09 10:11:07.006988 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 09 10:11:07.007837 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 09 10:11:07.007837 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 09 10:11:07.007837 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 09 10:11:07.007837 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 09 10:11:07.007837 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 09 10:11:07.007837 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 09 10:11:07.007837 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 09 10:11:07.007837 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 09 10:11:07.007837 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:07.007837 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 09 10:11:07.007837 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:07.007837 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:07.007837 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 09 10:11:07.007837 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 09 10:11:07.007837 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 09 10:11:07.007837 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return ref.to_dict() Aug 09 10:11:07.007837 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 09 10:11:07.007837 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application next(self.gen) Aug 09 10:11:07.008759 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 09 10:11:07.008759 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application yield resource Aug 09 10:11:07.008759 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 09 10:11:07.008759 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application next(self.gen) Aug 09 10:11:07.008759 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 09 10:11:07.008759 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self.session.rollback() Aug 09 10:11:07.008759 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 10:11:07.008759 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self.force_reraise() Aug 09 10:11:07.008759 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 10:11:07.008759 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise self.value Aug 09 10:11:07.008759 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 09 10:11:07.008759 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 09 10:11:07.008759 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 09 10:11:07.008759 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application session.commit() Aug 09 10:11:07.008759 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 09 10:11:07.008759 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 09 10:11:07.008759 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 09 10:11:07.009670 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._prepare_impl() Aug 09 10:11:07.009670 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 09 10:11:07.009670 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self.session.flush() Aug 09 10:11:07.009670 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 09 10:11:07.009670 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._flush(objects) Aug 09 10:11:07.009670 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 09 10:11:07.009670 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 09 10:11:07.009670 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 09 10:11:07.009670 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application compat.raise_( Aug 09 10:11:07.009670 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 09 10:11:07.009670 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception Aug 09 10:11:07.009670 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 09 10:11:07.009670 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application flush_context.execute() Aug 09 10:11:07.009670 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 09 10:11:07.009670 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rec.execute(self) Aug 09 10:11:07.009670 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 09 10:11:07.009670 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 09 10:11:07.014342 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 09 10:11:07.014342 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 09 10:11:07.014342 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 09 10:11:07.014342 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 09 10:11:07.014342 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 09 10:11:07.014342 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 09 10:11:07.014342 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 09 10:11:07.014342 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 09 10:11:07.014342 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 09 10:11:07.014342 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 09 10:11:07.014342 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 09 10:11:07.014342 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 09 10:11:07.014342 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 09 10:11:07.014342 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 09 10:11:07.014342 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 09 10:11:07.014342 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception Aug 09 10:11:07.015548 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 09 10:11:07.015548 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 09 10:11:07.015548 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 09 10:11:07.015548 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 09 10:11:07.015548 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 09 10:11:07.015548 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application result = self._query(query) Aug 09 10:11:07.015548 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 09 10:11:07.015548 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application conn.query(q) Aug 09 10:11:07.015548 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 09 10:11:07.015548 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 09 10:11:07.015548 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 09 10:11:07.015548 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application result.read() Aug 09 10:11:07.015548 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 09 10:11:07.015548 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 09 10:11:07.015548 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 09 10:11:07.015548 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 09 10:11:07.018535 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 09 10:11:07.018535 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 09 10:11:07.018535 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 09 10:11:07.018535 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 09 10:11:07.018535 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 09 10:11:07.018535 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 09 10:11:07.018535 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [parameters: {'id': '834b472e9bc048ec9a981c931143a16b', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 09 10:11:07.018535 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 09 10:11:07.018535 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:07.018535 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 10:11:07.018535 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:07.018535 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:07.018535 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:07.018535 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:07.018535 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:07.018535 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:07.020559 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:07.020559 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:07.020559 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:07.020559 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:07.020559 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:07.020559 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:07.020559 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 09 10:11:07.020559 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 09 10:11:07.020559 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:07.020559 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:07.020559 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 09 10:11:07.020559 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 09 10:11:07.020559 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 09 10:11:07.020559 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 09 10:11:07.020559 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 09 10:11:07.020559 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:07.022674 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 236/477] 10.222.0.36 () {60 vars in 1131 bytes} [Tue Aug 9 10:11:06 2022] POST /identity/v3/roles => generated 144 bytes in 228 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 09 10:11:07.022674 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd63e14-6eb3-4dc3-8861-c93d09ddc642 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:07.047884 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 242/478] 10.222.0.36 () {60 vars in 1132 bytes} [Tue Aug 9 10:11:06 2022] POST /identity/v3/users => generated 249 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:11:07.150440 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd63e14-6eb3-4dc3-8861-c93d09ddc642 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:07.195737 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4325680-bc03-4568-83bf-10e4987a891f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:07.196796 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4325680-bc03-4568-83bf-10e4987a891f None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:07.197252 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4325680-bc03-4568-83bf-10e4987a891f None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:07.197693 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4325680-bc03-4568-83bf-10e4987a891f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:07.200048 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:07.215492 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4325680-bc03-4568-83bf-10e4987a891f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 10:11:07.221566 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-c4325680-bc03-4568-83bf-10e4987a891f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 10:11:07.221566 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:07.221566 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:07.221566 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:07.221566 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:07.221566 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:07.221566 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:07.221566 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:07.221566 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:07.221566 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:07.221566 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:07.221566 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:07.221566 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 10:11:07.221566 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 10:11:07.221566 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 10:11:07.221566 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 10:11:07.222514 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 10:11:07.222514 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 10:11:07.222514 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 10:11:07.222514 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 10:11:07.222514 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:07.222514 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:07.222514 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:07.222514 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:07.222514 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:07.222514 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:07.222514 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:07.222514 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:07.222514 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:07.222514 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:07.222514 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:07.222514 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:07.223300 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:07.223300 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:07.223300 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:07.223300 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:07.223300 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 10:11:07.223300 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 10:11:07.223300 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 10:11:07.223300 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 10:11:07.223300 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 10:11:07.223300 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 10:11:07.223300 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 09 10:11:07.223300 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:07.225354 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 237/479] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Aug 9 10:11:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 10:11:07.231759 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960ca09e-bf0b-4783-b172-6d91117211b6 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:07.302210 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:07.347484 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960ca09e-bf0b-4783-b172-6d91117211b6 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:07.382862 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0461819-cb05-43d1-8879-a811a9f0294e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:07.383708 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0461819-cb05-43d1-8879-a811a9f0294e None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:07.384128 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0461819-cb05-43d1-8879-a811a9f0294e None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:07.384538 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0461819-cb05-43d1-8879-a811a9f0294e None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:07.385340 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0461819-cb05-43d1-8879-a811a9f0294e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:07.385807 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0461819-cb05-43d1-8879-a811a9f0294e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:07.387727 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0461819-cb05-43d1-8879-a811a9f0294e None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:07.396681 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 243/480] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Aug 9 10:11:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:08.533564 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b5545-145d-4b84-920f-d1809d7a1a6b None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:08.534133 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b5545-145d-4b84-920f-d1809d7a1a6b None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:08.534133 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b5545-145d-4b84-920f-d1809d7a1a6b None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:08.535603 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 238/481] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:11:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:11:08.541376 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1874f308-b85e-4a80-9671-8abe10e27ce5 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:08.542208 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1874f308-b85e-4a80-9671-8abe10e27ce5 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:08.542701 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1874f308-b85e-4a80-9671-8abe10e27ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:08.562098 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-1874f308-b85e-4a80-9671-8abe10e27ce5 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:11:08.563608 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-1874f308-b85e-4a80-9671-8abe10e27ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:11:08.642351 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 244/482] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:11:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 10:11:08.688579 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4b5545-145d-4b84-920f-d1809d7a1a6b None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:08.817379 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4b5545-145d-4b84-920f-d1809d7a1a6b None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:08.861460 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d874b43a-b98b-4fa2-9ddd-0ad1a9abbfa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:08.862427 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d874b43a-b98b-4fa2-9ddd-0ad1a9abbfa5 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:08.862897 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d874b43a-b98b-4fa2-9ddd-0ad1a9abbfa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:08.863358 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d874b43a-b98b-4fa2-9ddd-0ad1a9abbfa5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:08.879255 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d874b43a-b98b-4fa2-9ddd-0ad1a9abbfa5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 10:11:08.884221 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-d874b43a-b98b-4fa2-9ddd-0ad1a9abbfa5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 10:11:08.884221 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:08.884221 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:08.884221 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:08.884221 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:08.884221 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:08.884221 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:08.884221 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:08.884221 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:08.884221 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:08.884221 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:08.884221 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:08.884221 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 10:11:08.884221 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 10:11:08.884221 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 10:11:08.884221 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 10:11:08.885096 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 10:11:08.885096 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 10:11:08.885096 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 10:11:08.885096 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 10:11:08.885096 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:08.885096 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:08.885096 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:08.885096 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:08.885096 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:08.885096 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:08.885096 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:08.885096 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:08.885096 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:08.885096 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:08.885096 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:08.885096 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:08.885913 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:08.885913 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:08.885913 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:08.885913 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:08.885913 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 10:11:08.885913 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 10:11:08.885913 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 10:11:08.885913 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 10:11:08.885913 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 10:11:08.885913 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 10:11:08.885913 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 10:11:08.885913 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:08.888507 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 239/483] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Aug 9 10:11:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:08.894085 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1874f308-b85e-4a80-9671-8abe10e27ce5 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:08.901038 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f01c2e3-1f00-47a2-82c9-14b552ba69ca None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:08.901319 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f01c2e3-1f00-47a2-82c9-14b552ba69ca None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:08.901596 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f01c2e3-1f00-47a2-82c9-14b552ba69ca None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:08.904372 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 240/484] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:11:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:11:08.909243 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29877596-149d-433b-95f0-e6988aba2d71 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:08.909519 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29877596-149d-433b-95f0-e6988aba2d71 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:08.909795 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29877596-149d-433b-95f0-e6988aba2d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:08.946838 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-29877596-149d-433b-95f0-e6988aba2d71 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:11:08.948031 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-29877596-149d-433b-95f0-e6988aba2d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:11:08.969085 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:09.023107 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1874f308-b85e-4a80-9671-8abe10e27ce5 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:09.070575 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:09.092412 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b29aee6-5119-451b-aa47-7e36e75d24fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:09.093428 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b29aee6-5119-451b-aa47-7e36e75d24fd None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:09.093428 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b29aee6-5119-451b-aa47-7e36e75d24fd None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:09.093595 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b29aee6-5119-451b-aa47-7e36e75d24fd None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:09.094320 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b29aee6-5119-451b-aa47-7e36e75d24fd None admin] RBAC: Adding query filter params (name=service) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:09.094627 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b29aee6-5119-451b-aa47-7e36e75d24fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:09.096033 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b29aee6-5119-451b-aa47-7e36e75d24fd None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:09.102628 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 241/485] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:11:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 10:11:09.110257 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 245/486] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Aug 9 10:11:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:09.119114 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29877596-149d-433b-95f0-e6988aba2d71 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:09.149046 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b29aee6-5119-451b-aa47-7e36e75d24fd None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:09.262427 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29877596-149d-433b-95f0-e6988aba2d71 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:09.304103 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36f3d2b-8f35-4319-a5fb-d7fedc7b5cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:09.305094 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36f3d2b-8f35-4319-a5fb-d7fedc7b5cbd None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:09.305562 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36f3d2b-8f35-4319-a5fb-d7fedc7b5cbd None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:09.306044 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36f3d2b-8f35-4319-a5fb-d7fedc7b5cbd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:09.323654 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36f3d2b-8f35-4319-a5fb-d7fedc7b5cbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:09.326654 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36f3d2b-8f35-4319-a5fb-d7fedc7b5cbd None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:09.358171 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-c36f3d2b-8f35-4319-a5fb-d7fedc7b5cbd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:09.358171 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:09.358171 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:09.358171 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:09.358171 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:09.358171 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:09.358171 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:09.358171 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:09.358171 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:09.358171 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:09.358171 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:09.358171 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:09.358171 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 10:11:09.358171 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 10:11:09.358171 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 10:11:09.358171 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 10:11:09.359120 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:09.359120 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:09.359120 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:09.359120 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:09.359120 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:09.359120 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:09.359120 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:09.359120 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:09.359120 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:09.359120 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:09.359120 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:09.359120 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:09.359120 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:09.359120 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:09.359120 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:09.359120 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:09.359120 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 10:11:09.359940 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 10:11:09.359940 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:09.359940 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:09.363380 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b29aee6-5119-451b-aa47-7e36e75d24fd None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:09.367348 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 242/487] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:11:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:09.373568 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36f3d2b-8f35-4319-a5fb-d7fedc7b5cbd None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:09.395552 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:09.435462 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8820e91d-98e5-46c5-8cbc-9304268739ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:09.436458 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8820e91d-98e5-46c5-8cbc-9304268739ed None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:09.437990 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8820e91d-98e5-46c5-8cbc-9304268739ed None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:09.438477 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8820e91d-98e5-46c5-8cbc-9304268739ed None admin] PATH_INFO: `/v3/roles/service` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:09.452335 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:09.467833 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8820e91d-98e5-46c5-8cbc-9304268739ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 10:11:09.476418 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-8820e91d-98e5-46c5-8cbc-9304268739ed None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 10:11:09.476418 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:09.476418 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:09.476418 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:09.476418 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:09.476418 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:09.476418 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:09.476418 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:09.476418 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:09.476418 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:09.476418 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:09.476418 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:09.476418 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 10:11:09.476418 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 10:11:09.476418 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 10:11:09.476418 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 10:11:09.477296 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 10:11:09.477296 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 10:11:09.477296 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 10:11:09.477296 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 10:11:09.477296 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:09.477296 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:09.477296 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:09.477296 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:09.477296 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:09.477296 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:09.477296 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:09.477296 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:09.477296 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:09.477296 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:09.477296 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:09.477296 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:09.478117 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:09.478117 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:09.478117 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:09.478117 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:09.478117 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 10:11:09.478117 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 10:11:09.478117 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 10:11:09.478117 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 10:11:09.478117 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 10:11:09.478117 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 10:11:09.478117 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 10:11:09.478117 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:11:09.481118 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 246/488] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Aug 9 10:11:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:09.487134 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8820e91d-98e5-46c5-8cbc-9304268739ed None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:09.589213 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36f3d2b-8f35-4319-a5fb-d7fedc7b5cbd None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:09.632704 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c499223-ef8c-4d10-ba94-3c27457f4577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:09.633438 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c499223-ef8c-4d10-ba94-3c27457f4577 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:09.633886 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c499223-ef8c-4d10-ba94-3c27457f4577 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:09.634189 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c499223-ef8c-4d10-ba94-3c27457f4577 None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:09.635101 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c499223-ef8c-4d10-ba94-3c27457f4577 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:09.635412 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c499223-ef8c-4d10-ba94-3c27457f4577 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:09.638477 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c499223-ef8c-4d10-ba94-3c27457f4577 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:09.654282 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 243/489] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Aug 9 10:11:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:11:09.655637 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c7b8c-2f2c-49eb-aafc-853a8266b8b0 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:09.655933 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c7b8c-2f2c-49eb-aafc-853a8266b8b0 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:09.656213 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c7b8c-2f2c-49eb-aafc-853a8266b8b0 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:09.661947 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 244/490] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:11:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:11:09.662995 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41c7b8c-2f2c-49eb-aafc-853a8266b8b0 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:09.682016 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8820e91d-98e5-46c5-8cbc-9304268739ed None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:09.729632 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7fd236-94c5-4e7a-856d-815b95a245f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:09.731028 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7fd236-94c5-4e7a-856d-815b95a245f6 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:09.731542 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7fd236-94c5-4e7a-856d-815b95a245f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:09.732176 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7fd236-94c5-4e7a-856d-815b95a245f6 None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:09.733567 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7fd236-94c5-4e7a-856d-815b95a245f6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:09.734124 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7fd236-94c5-4e7a-856d-815b95a245f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:09.736135 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7fd236-94c5-4e7a-856d-815b95a245f6 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:09.748088 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 247/491] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Aug 9 10:11:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:11:09.750401 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f27d71-8a6d-489d-8ef9-abf6df96af82 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:09.750974 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f27d71-8a6d-489d-8ef9-abf6df96af82 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:09.751429 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f27d71-8a6d-489d-8ef9-abf6df96af82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:09.762473 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:09.769569 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41c7b8c-2f2c-49eb-aafc-853a8266b8b0 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:09.774297 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-e6f27d71-8a6d-489d-8ef9-abf6df96af82 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:11:09.775489 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-e6f27d71-8a6d-489d-8ef9-abf6df96af82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:11:09.805461 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e078cf-d2cb-4f36-ba46-20fffdb03c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:09.806119 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e078cf-d2cb-4f36-ba46-20fffdb03c12 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:09.806398 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e078cf-d2cb-4f36-ba46-20fffdb03c12 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:09.806679 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e078cf-d2cb-4f36-ba46-20fffdb03c12 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:09.814725 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e078cf-d2cb-4f36-ba46-20fffdb03c12 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:09.814998 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:09.816321 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e078cf-d2cb-4f36-ba46-20fffdb03c12 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:09.829941 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-43e078cf-d2cb-4f36-ba46-20fffdb03c12 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 09 10:11:09.829941 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:09.829941 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:09.829941 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:09.829941 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:09.829941 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:09.829941 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:09.829941 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:09.829941 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:09.829941 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:09.829941 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:09.829941 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:09.829941 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 10:11:09.829941 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 10:11:09.829941 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 10:11:09.829941 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 10:11:09.830930 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:09.830930 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:09.830930 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 10:11:09.830930 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 10:11:09.830930 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 10:11:09.830930 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 10:11:09.830930 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:09.830930 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:09.830930 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:09.830930 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:09.830930 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:09.830930 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:09.830930 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:09.830930 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:09.830930 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:09.830930 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:09.830930 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:09.830930 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:09.831843 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:09.831843 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:09.831843 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 10:11:09.831843 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 10:11:09.831843 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 10:11:09.831843 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 10:11:09.831843 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 10:11:09.831843 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 10:11:09.831843 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 09 10:11:09.831843 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:09.831843 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 245/492] 10.222.0.36 () {56 vars in 1093 bytes} [Tue Aug 9 10:11:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:09.834373 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e078cf-d2cb-4f36-ba46-20fffdb03c12 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:09.857610 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 248/493] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:11:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 10:11:09.858826 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b248d04-0994-42c7-8d5b-5a4048899cdb None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:09.859112 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b248d04-0994-42c7-8d5b-5a4048899cdb None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:09.859386 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b248d04-0994-42c7-8d5b-5a4048899cdb None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:09.861958 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 249/494] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:11:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:11:09.861958 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b248d04-0994-42c7-8d5b-5a4048899cdb None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:09.962973 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e078cf-d2cb-4f36-ba46-20fffdb03c12 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:09.973008 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b248d04-0994-42c7-8d5b-5a4048899cdb None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:09.999222 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfec0ed6-c023-4254-bc37-be6206c6efce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:09.999871 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfec0ed6-c023-4254-bc37-be6206c6efce None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:10.000149 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfec0ed6-c023-4254-bc37-be6206c6efce None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:10.000420 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfec0ed6-c023-4254-bc37-be6206c6efce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:10.011127 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfec0ed6-c023-4254-bc37-be6206c6efce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:10.011274 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17f22db-7fa2-4987-ad92-5b503923767a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:10.012065 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f22db-7fa2-4987-ad92-5b503923767a None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:10.012514 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f22db-7fa2-4987-ad92-5b503923767a None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:10.012715 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfec0ed6-c023-4254-bc37-be6206c6efce None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:10.013138 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f22db-7fa2-4987-ad92-5b503923767a None admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:10.014068 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17f22db-7fa2-4987-ad92-5b503923767a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:10.014697 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17f22db-7fa2-4987-ad92-5b503923767a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:10.016587 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17f22db-7fa2-4987-ad92-5b503923767a None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:10.026657 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-dfec0ed6-c023-4254-bc37-be6206c6efce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:10.026657 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:10.026657 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:10.026657 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:10.026657 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:10.026657 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:10.026657 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:10.026657 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:10.026657 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:10.026657 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:10.026657 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:10.026657 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:10.026657 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 10:11:10.026657 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 10:11:10.026657 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 10:11:10.026657 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 10:11:10.027566 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:10.027566 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:10.027566 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:10.027566 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:10.027566 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:10.027566 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:10.027566 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:10.027566 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:10.027566 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:10.027566 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:10.027566 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:10.027566 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:10.027566 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:10.027566 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:10.027566 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:10.027566 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:10.027566 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 10:11:10.028474 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 10:11:10.028474 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:10.028474 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:10.032534 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 246/495] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:11:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:10.033601 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22f8526-87ce-46d1-b74e-aad131496230 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:10.033902 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22f8526-87ce-46d1-b74e-aad131496230 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:10.034180 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22f8526-87ce-46d1-b74e-aad131496230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:10.052866 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-b22f8526-87ce-46d1-b74e-aad131496230 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:11:10.054065 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-b22f8526-87ce-46d1-b74e-aad131496230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:11:10.056063 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:10.058128 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 250/496] 10.222.0.36 () {56 vars in 1133 bytes} [Tue Aug 9 10:11:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:10.059056 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17f22db-7fa2-4987-ad92-5b503923767a None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:10.086674 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:10.129945 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 247/497] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:11:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 10:11:10.129945 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22f8526-87ce-46d1-b74e-aad131496230 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:10.158798 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17f22db-7fa2-4987-ad92-5b503923767a None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:10.192243 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1909b8b7-0808-461b-a9cd-98c7aa3cbe37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:10.192856 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1909b8b7-0808-461b-a9cd-98c7aa3cbe37 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:10.193132 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1909b8b7-0808-461b-a9cd-98c7aa3cbe37 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:10.193396 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1909b8b7-0808-461b-a9cd-98c7aa3cbe37 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:10.204044 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1909b8b7-0808-461b-a9cd-98c7aa3cbe37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 10:11:10.208681 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-1909b8b7-0808-461b-a9cd-98c7aa3cbe37 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 10:11:10.208681 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:10.208681 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:10.208681 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:10.208681 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:10.208681 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:10.208681 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:10.208681 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:10.208681 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:10.208681 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:10.208681 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:10.208681 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:10.208681 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 10:11:10.208681 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 10:11:10.208681 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 10:11:10.208681 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 10:11:10.209745 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 10:11:10.209745 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 10:11:10.209745 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 10:11:10.209745 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 10:11:10.209745 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:10.209745 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:10.209745 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:10.209745 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:10.209745 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:10.209745 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:10.209745 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:10.209745 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:10.209745 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:10.209745 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:10.209745 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:10.209745 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:10.210783 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:10.210783 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:10.210783 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:10.210783 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:10.210783 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 10:11:10.210783 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 10:11:10.210783 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 10:11:10.210783 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 10:11:10.210783 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 10:11:10.210783 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 10:11:10.210783 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 10:11:10.210783 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:11:10.210783 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 251/498] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Aug 9 10:11:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:10.211601 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b4f5ec-f61d-466e-af8d-e2f1b1edef41 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:10.211601 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b4f5ec-f61d-466e-af8d-e2f1b1edef41 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:10.211798 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b4f5ec-f61d-466e-af8d-e2f1b1edef41 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:10.215855 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 252/499] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:11:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:11:10.215855 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b4f5ec-f61d-466e-af8d-e2f1b1edef41 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:10.223626 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22f8526-87ce-46d1-b74e-aad131496230 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:10.257959 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c22dbe0-c7af-46a6-80a8-045ef2797bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:10.258551 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c22dbe0-c7af-46a6-80a8-045ef2797bd6 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:10.258827 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c22dbe0-c7af-46a6-80a8-045ef2797bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:10.259096 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c22dbe0-c7af-46a6-80a8-045ef2797bd6 None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:10.259779 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c22dbe0-c7af-46a6-80a8-045ef2797bd6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:10.260054 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c22dbe0-c7af-46a6-80a8-045ef2797bd6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:10.261423 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c22dbe0-c7af-46a6-80a8-045ef2797bd6 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:10.267773 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:10.273164 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 248/500] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Aug 9 10:11:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:10.273981 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c22dbe0-c7af-46a6-80a8-045ef2797bd6 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:10.299514 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:10.316269 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b4f5ec-f61d-466e-af8d-e2f1b1edef41 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:10.350650 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2401a626-cc7e-41f6-8d1a-98c0570a830b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:10.351250 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2401a626-cc7e-41f6-8d1a-98c0570a830b None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:10.351528 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2401a626-cc7e-41f6-8d1a-98c0570a830b None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:10.351805 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2401a626-cc7e-41f6-8d1a-98c0570a830b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:10.372968 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c22dbe0-c7af-46a6-80a8-045ef2797bd6 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:10.405522 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3b4c8c-56b2-439e-9118-42eb6ba27a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:10.406101 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3b4c8c-56b2-439e-9118-42eb6ba27a2b None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:10.406390 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3b4c8c-56b2-439e-9118-42eb6ba27a2b None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:10.406643 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3b4c8c-56b2-439e-9118-42eb6ba27a2b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:10.416710 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3b4c8c-56b2-439e-9118-42eb6ba27a2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 10:11:10.418759 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2401a626-cc7e-41f6-8d1a-98c0570a830b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:10.420270 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2401a626-cc7e-41f6-8d1a-98c0570a830b None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:10.422510 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-2a3b4c8c-56b2-439e-9118-42eb6ba27a2b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 10:11:10.422510 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:10.422510 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:10.422510 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:10.422510 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:10.422510 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:10.422510 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:10.422510 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:10.422510 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:10.422510 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:10.422510 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:10.422510 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:10.422510 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 10:11:10.422510 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 10:11:10.422510 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 10:11:10.422510 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 10:11:10.423559 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 10:11:10.423559 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 10:11:10.423559 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 10:11:10.423559 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 10:11:10.423559 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:10.423559 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:10.423559 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:10.423559 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:10.423559 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:10.423559 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:10.423559 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:10.423559 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:10.423559 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:10.423559 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:10.423559 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:10.423559 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:10.424539 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:10.424539 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:10.424539 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:10.424539 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:10.424539 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 10:11:10.424539 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 10:11:10.424539 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 10:11:10.424539 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 10:11:10.424539 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 10:11:10.424539 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 10:11:10.424539 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 10:11:10.424539 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:10.424539 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 249/501] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Aug 9 10:11:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:10.424539 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3b4c8c-56b2-439e-9118-42eb6ba27a2b None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:10.479779 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:10.506903 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:10.521363 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3b4c8c-56b2-439e-9118-42eb6ba27a2b None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:10.523144 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 253/502] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Aug 9 10:11:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 10:11:10.524351 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c88e0a-e150-4056-a78b-4be42ebf2315 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:10.524638 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c88e0a-e150-4056-a78b-4be42ebf2315 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:10.524909 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c88e0a-e150-4056-a78b-4be42ebf2315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:10.544836 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-08c88e0a-e150-4056-a78b-4be42ebf2315 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:11:10.546040 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-08c88e0a-e150-4056-a78b-4be42ebf2315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:11:10.559964 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e43587-d888-4c45-8d72-c6bc8983e384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:10.560567 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e43587-d888-4c45-8d72-c6bc8983e384 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:10.560845 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e43587-d888-4c45-8d72-c6bc8983e384 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:10.561114 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e43587-d888-4c45-8d72-c6bc8983e384 None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:10.561777 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e43587-d888-4c45-8d72-c6bc8983e384 None admin] RBAC: Adding query filter params (name=service) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:10.562114 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e43587-d888-4c45-8d72-c6bc8983e384 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:10.563469 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e43587-d888-4c45-8d72-c6bc8983e384 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:10.571873 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 250/503] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Aug 9 10:11:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:10.572669 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e43587-d888-4c45-8d72-c6bc8983e384 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:10.613826 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 254/504] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:11:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 10:11:10.614686 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c88e0a-e150-4056-a78b-4be42ebf2315 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:10.685321 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e43587-d888-4c45-8d72-c6bc8983e384 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:10.704452 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:10.713356 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c88e0a-e150-4056-a78b-4be42ebf2315 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:10.718723 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787898c8-a9f1-4177-a752-3f27cec87144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:10.719347 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787898c8-a9f1-4177-a752-3f27cec87144 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:10.719627 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787898c8-a9f1-4177-a752-3f27cec87144 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:10.719910 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787898c8-a9f1-4177-a752-3f27cec87144 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:10.727876 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787898c8-a9f1-4177-a752-3f27cec87144 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:10.729319 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787898c8-a9f1-4177-a752-3f27cec87144 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:10.729453 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:10.741209 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-787898c8-a9f1-4177-a752-3f27cec87144 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 09 10:11:10.741209 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:10.741209 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:10.741209 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:10.741209 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:10.741209 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:10.741209 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:10.741209 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:10.741209 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:10.741209 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:10.741209 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:10.741209 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:10.741209 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 10:11:10.741209 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 10:11:10.741209 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 10:11:10.741209 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 10:11:10.742272 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:10.742272 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:10.742272 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 10:11:10.742272 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 10:11:10.742272 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 10:11:10.742272 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 10:11:10.742272 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:10.742272 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:10.742272 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:10.742272 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:10.742272 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:10.742272 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:10.742272 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:10.742272 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:10.742272 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:10.742272 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:10.742272 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:10.742272 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:10.743452 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:10.743452 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:10.743452 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 10:11:10.743452 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 10:11:10.743452 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 10:11:10.743452 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 10:11:10.743452 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 10:11:10.743452 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 10:11:10.743452 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 09 10:11:10.743452 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:10.743452 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 251/505] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Aug 9 10:11:10 2022] GET /identity/v3/users/cinder => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:10.743452 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787898c8-a9f1-4177-a752-3f27cec87144 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:10.750216 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d531350e-9588-4821-92bd-b1d8be7fb6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:10.750821 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d531350e-9588-4821-92bd-b1d8be7fb6a5 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:10.751100 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d531350e-9588-4821-92bd-b1d8be7fb6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:10.751371 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d531350e-9588-4821-92bd-b1d8be7fb6a5 None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:10.752031 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d531350e-9588-4821-92bd-b1d8be7fb6a5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:10.752330 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d531350e-9588-4821-92bd-b1d8be7fb6a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:10.753690 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d531350e-9588-4821-92bd-b1d8be7fb6a5 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:10.766835 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 255/506] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Aug 9 10:11:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:10.766835 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d531350e-9588-4821-92bd-b1d8be7fb6a5 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:10.841648 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787898c8-a9f1-4177-a752-3f27cec87144 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:10.863789 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d531350e-9588-4821-92bd-b1d8be7fb6a5 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:10.874621 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3220ca61-181d-4e61-aedd-58c5d9dbb250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:10.875231 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3220ca61-181d-4e61-aedd-58c5d9dbb250 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:10.875510 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3220ca61-181d-4e61-aedd-58c5d9dbb250 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:10.875782 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3220ca61-181d-4e61-aedd-58c5d9dbb250 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:10.887348 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3220ca61-181d-4e61-aedd-58c5d9dbb250 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:10.888938 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3220ca61-181d-4e61-aedd-58c5d9dbb250 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:10.896333 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaefd2c-c9b0-442e-bd16-f4325c82014c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:10.896938 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaefd2c-c9b0-442e-bd16-f4325c82014c None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:10.897211 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaefd2c-c9b0-442e-bd16-f4325c82014c None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:10.897478 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaefd2c-c9b0-442e-bd16-f4325c82014c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:10.902965 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-3220ca61-181d-4e61-aedd-58c5d9dbb250 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:10.902965 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:10.902965 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:10.902965 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:10.902965 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:10.902965 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:10.902965 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:10.902965 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:10.902965 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:10.902965 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:10.902965 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:10.902965 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:10.902965 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 10:11:10.902965 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 10:11:10.902965 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 10:11:10.902965 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 10:11:10.903854 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:10.903854 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:10.903854 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:10.903854 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:10.903854 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:10.903854 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:10.903854 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:10.903854 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:10.903854 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:10.903854 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:10.903854 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:10.903854 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:10.903854 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:10.903854 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:10.903854 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:10.903854 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:10.903854 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 10:11:10.904699 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 10:11:10.904699 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:10.904699 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:10.904699 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 252/507] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:11:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:10.904923 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3220ca61-181d-4e61-aedd-58c5d9dbb250 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:10.908345 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaefd2c-c9b0-442e-bd16-f4325c82014c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:10.909786 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaefd2c-c9b0-442e-bd16-f4325c82014c None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:10.924499 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-8aaefd2c-c9b0-442e-bd16-f4325c82014c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:10.924499 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:10.924499 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:10.924499 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:10.924499 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:10.924499 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:10.924499 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:10.924499 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:10.924499 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:10.924499 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:10.924499 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:10.924499 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:10.924499 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 10:11:10.924499 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 10:11:10.924499 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 10:11:10.924499 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 10:11:10.925553 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:10.925553 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:10.925553 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:10.925553 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:10.925553 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:10.925553 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:10.925553 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:10.925553 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:10.925553 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:10.925553 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:10.925553 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:10.925553 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:10.925553 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:10.925553 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:10.925553 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:10.925553 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:10.925553 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 10:11:10.926492 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 10:11:10.926492 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:10.926492 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:11:10.926492 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 256/508] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:11:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:10.926764 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaefd2c-c9b0-442e-bd16-f4325c82014c None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:10.936173 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:10.960390 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:11.007047 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3220ca61-181d-4e61-aedd-58c5d9dbb250 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:11.029658 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaefd2c-c9b0-442e-bd16-f4325c82014c None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:11.041526 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaa2546-3560-41f3-b117-32ed20963618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:11.042242 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaa2546-3560-41f3-b117-32ed20963618 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:11.042521 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaa2546-3560-41f3-b117-32ed20963618 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:11.042794 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaa2546-3560-41f3-b117-32ed20963618 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:11.053237 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaa2546-3560-41f3-b117-32ed20963618 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:11.054722 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaa2546-3560-41f3-b117-32ed20963618 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:11.063187 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cf819f-6f8f-4480-8485-e04316e3860f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:11.063455 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf819f-6f8f-4480-8485-e04316e3860f None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:11.063733 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf819f-6f8f-4480-8485-e04316e3860f None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:11.064006 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf819f-6f8f-4480-8485-e04316e3860f None admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:11.064716 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cf819f-6f8f-4480-8485-e04316e3860f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:11.065017 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cf819f-6f8f-4480-8485-e04316e3860f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:11.066441 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cf819f-6f8f-4480-8485-e04316e3860f None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:11.068898 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-9eaa2546-3560-41f3-b117-32ed20963618 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:11.068898 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:11.068898 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:11.068898 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:11.068898 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:11.068898 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:11.068898 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:11.068898 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:11.068898 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:11.068898 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:11.068898 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:11.068898 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:11.068898 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 10:11:11.068898 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 10:11:11.068898 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 10:11:11.068898 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 10:11:11.069831 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:11.069831 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:11.069831 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:11.069831 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:11.069831 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:11.069831 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:11.069831 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:11.069831 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:11.069831 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:11.069831 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:11.069831 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:11.069831 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:11.069831 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:11.069831 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:11.069831 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:11.069831 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:11.069831 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 10:11:11.070694 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 10:11:11.070694 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:11.070694 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:11.070694 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 253/509] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:11:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:11.071281 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaa2546-3560-41f3-b117-32ed20963618 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:11.086079 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 257/510] 10.222.0.36 () {56 vars in 1137 bytes} [Tue Aug 9 10:11:10 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:11.086897 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cf819f-6f8f-4480-8485-e04316e3860f None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:11.158039 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:11.173243 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:11.174538 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaa2546-3560-41f3-b117-32ed20963618 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:11.186111 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cf819f-6f8f-4480-8485-e04316e3860f None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:11.206659 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e336b52-b325-4c25-8418-df16bf6bd6ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:11.207210 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e336b52-b325-4c25-8418-df16bf6bd6ed None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:11.207485 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e336b52-b325-4c25-8418-df16bf6bd6ed None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:11.207753 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e336b52-b325-4c25-8418-df16bf6bd6ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:11.218405 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e336b52-b325-4c25-8418-df16bf6bd6ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:11.219354 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db4421e-ce4d-4ee4-8272-11c1585adc10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:11.219839 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e336b52-b325-4c25-8418-df16bf6bd6ed None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:11.219931 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db4421e-ce4d-4ee4-8272-11c1585adc10 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:11.220211 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db4421e-ce4d-4ee4-8272-11c1585adc10 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:11.220480 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db4421e-ce4d-4ee4-8272-11c1585adc10 None admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:11.221104 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db4421e-ce4d-4ee4-8272-11c1585adc10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:11.221403 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db4421e-ce4d-4ee4-8272-11c1585adc10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:11.222820 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db4421e-ce4d-4ee4-8272-11c1585adc10 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:11.234090 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-3e336b52-b325-4c25-8418-df16bf6bd6ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:11.234090 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:11.234090 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:11.234090 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:11.234090 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:11.234090 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:11.234090 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:11.234090 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:11.234090 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:11.234090 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:11.234090 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:11.234090 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:11.234090 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 10:11:11.234090 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 10:11:11.234090 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 10:11:11.234090 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 10:11:11.234950 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:11.234950 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:11.234950 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:11.234950 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:11.234950 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:11.234950 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:11.234950 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:11.234950 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:11.234950 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:11.234950 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:11.234950 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:11.234950 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:11.234950 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:11.234950 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:11.234950 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:11.234950 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:11.234950 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 10:11:11.235796 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 10:11:11.235796 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:11.235796 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:11.235964 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 258/511] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Aug 9 10:11:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:11.235964 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db4421e-ce4d-4ee4-8272-11c1585adc10 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:11.236093 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 254/512] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:11:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:11.236635 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e336b52-b325-4c25-8418-df16bf6bd6ed None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:11.336723 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db4421e-ce4d-4ee4-8272-11c1585adc10 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:11.338033 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e336b52-b325-4c25-8418-df16bf6bd6ed None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:11.371619 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2269b0e2-d03c-4318-8641-fbd90c15fc36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:11.371842 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdec7d1-27c1-4a92-bc03-92ace75f2d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:11.372342 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2269b0e2-d03c-4318-8641-fbd90c15fc36 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:11.372434 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdec7d1-27c1-4a92-bc03-92ace75f2d2d None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:11.372618 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2269b0e2-d03c-4318-8641-fbd90c15fc36 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:11.372705 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdec7d1-27c1-4a92-bc03-92ace75f2d2d None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:11.372885 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2269b0e2-d03c-4318-8641-fbd90c15fc36 None admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:11.372973 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdec7d1-27c1-4a92-bc03-92ace75f2d2d None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:11.373513 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2269b0e2-d03c-4318-8641-fbd90c15fc36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:11.373600 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdec7d1-27c1-4a92-bc03-92ace75f2d2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:11.373810 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2269b0e2-d03c-4318-8641-fbd90c15fc36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:11.373937 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdec7d1-27c1-4a92-bc03-92ace75f2d2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:11.375312 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdec7d1-27c1-4a92-bc03-92ace75f2d2d None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:11.375575 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2269b0e2-d03c-4318-8641-fbd90c15fc36 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:11.377596 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:11.387967 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 255/513] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Aug 9 10:11:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:11.388609 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 259/514] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Aug 9 10:11:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:11.388776 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdec7d1-27c1-4a92-bc03-92ace75f2d2d None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:11.389493 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2269b0e2-d03c-4318-8641-fbd90c15fc36 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:11.399929 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:11.488546 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2269b0e2-d03c-4318-8641-fbd90c15fc36 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:11.490778 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdec7d1-27c1-4a92-bc03-92ace75f2d2d None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:11.522652 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b44d29-264f-4906-8c24-cb8b242429d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:11.523265 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b44d29-264f-4906-8c24-cb8b242429d7 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:11.523538 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b44d29-264f-4906-8c24-cb8b242429d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:11.523801 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8648fa9-10be-4fec-84ab-2b9c9cf9bda2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:11.523946 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b44d29-264f-4906-8c24-cb8b242429d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:11.524397 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8648fa9-10be-4fec-84ab-2b9c9cf9bda2 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:11.524677 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8648fa9-10be-4fec-84ab-2b9c9cf9bda2 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:11.524947 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8648fa9-10be-4fec-84ab-2b9c9cf9bda2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:11.530238 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b44d29-264f-4906-8c24-cb8b242429d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:11.531656 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b44d29-264f-4906-8c24-cb8b242429d7 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:11.543716 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-94b44d29-264f-4906-8c24-cb8b242429d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 10:11:11.543716 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:11.543716 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:11.543716 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:11.543716 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:11.543716 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:11.543716 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:11.543716 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:11.543716 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:11.543716 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:11.543716 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:11.543716 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:11.543716 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 10:11:11.543716 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 10:11:11.543716 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 10:11:11.544734 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 10:11:11.544734 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:11.544734 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:11.544734 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:11.544734 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:11.544734 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:11.544734 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:11.544734 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:11.544734 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:11.544734 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:11.544734 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:11.544734 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:11.544734 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:11.544734 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:11.544734 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:11.544734 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:11.544734 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:11.550298 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 10:11:11.550298 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 10:11:11.550298 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 10:11:11.550298 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 10:11:11.550298 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 10:11:11.550298 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 10:11:11.550298 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 10:11:11.550298 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:11:11.550298 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 260/515] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Aug 9 10:11:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:11.550298 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b44d29-264f-4906-8c24-cb8b242429d7 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:11.594791 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:11.601767 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8648fa9-10be-4fec-84ab-2b9c9cf9bda2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:11.603292 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8648fa9-10be-4fec-84ab-2b9c9cf9bda2 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:11.610030 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:11.647196 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b44d29-264f-4906-8c24-cb8b242429d7 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:11.689444 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b89f93-6f97-46d2-b1d7-018cd8c522fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:11.690079 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b89f93-6f97-46d2-b1d7-018cd8c522fb None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:11.690360 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b89f93-6f97-46d2-b1d7-018cd8c522fb None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:11.690632 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b89f93-6f97-46d2-b1d7-018cd8c522fb None admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:11.691269 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b89f93-6f97-46d2-b1d7-018cd8c522fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:11.691571 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b89f93-6f97-46d2-b1d7-018cd8c522fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:11.692934 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b89f93-6f97-46d2-b1d7-018cd8c522fb None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:11.700799 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 256/516] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Aug 9 10:11:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 10:11:11.701629 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8648fa9-10be-4fec-84ab-2b9c9cf9bda2 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:11.704584 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 261/517] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Aug 9 10:11:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:11.705376 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b89f93-6f97-46d2-b1d7-018cd8c522fb None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:11.797072 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:11.803290 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8648fa9-10be-4fec-84ab-2b9c9cf9bda2 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:11.804106 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b89f93-6f97-46d2-b1d7-018cd8c522fb None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:11.830548 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:11.837778 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26f05f4-4cd6-4618-9b71-3084909940b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:11.838396 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26f05f4-4cd6-4618-9b71-3084909940b1 None admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:11.838526 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7147d5f-9013-43ba-91d4-c43ea1ab1e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:11.838724 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26f05f4-4cd6-4618-9b71-3084909940b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:11.838990 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26f05f4-4cd6-4618-9b71-3084909940b1 None admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:11.839093 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7147d5f-9013-43ba-91d4-c43ea1ab1e7f None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:11.839287 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7147d5f-9013-43ba-91d4-c43ea1ab1e7f None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:11.839558 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7147d5f-9013-43ba-91d4-c43ea1ab1e7f None admin] PATH_INFO: `/v3/users/glance` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:11.839647 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26f05f4-4cd6-4618-9b71-3084909940b1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:11.841648 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26f05f4-4cd6-4618-9b71-3084909940b1 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:11.847236 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7147d5f-9013-43ba-91d4-c43ea1ab1e7f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:11.848665 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7147d5f-9013-43ba-91d4-c43ea1ab1e7f None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:11.862244 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-e7147d5f-9013-43ba-91d4-c43ea1ab1e7f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 09 10:11:11.862244 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:11.862244 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:11.862244 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:11.862244 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:11.862244 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:11.862244 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:11.862244 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:11.862244 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:11.862244 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:11.862244 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:11.862244 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:11.862244 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 10:11:11.862244 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 10:11:11.862244 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 10:11:11.862244 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 10:11:11.863148 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:11.863148 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:11.863148 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 10:11:11.863148 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 10:11:11.863148 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 10:11:11.863148 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 10:11:11.863148 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:11.863148 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:11.863148 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:11.863148 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:11.863148 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:11.863148 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:11.863148 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:11.863148 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:11.863148 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:11.863148 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:11.863148 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:11.863148 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:11.864067 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:11.864067 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:11.864067 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 10:11:11.864067 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 10:11:11.864067 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 10:11:11.864067 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 10:11:11.864067 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 10:11:11.864067 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 10:11:11.864067 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 09 10:11:11.864067 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:11:11.864565 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 257/518] 10.222.0.36 () {60 vars in 1132 bytes} [Tue Aug 9 10:11:11 2022] POST /identity/v3/users => generated 247 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:11:11.864635 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 262/519] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Aug 9 10:11:11 2022] GET /identity/v3/users/glance => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:11.864698 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26f05f4-4cd6-4618-9b71-3084909940b1 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:11.864771 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7147d5f-9013-43ba-91d4-c43ea1ab1e7f None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:12.005147 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26f05f4-4cd6-4618-9b71-3084909940b1 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:12.005361 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7147d5f-9013-43ba-91d4-c43ea1ab1e7f None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:12.047680 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f48574-4326-4852-9f39-6933cf7e90cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:12.048200 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f48574-4326-4852-9f39-6933cf7e90cc None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:12.048478 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f48574-4326-4852-9f39-6933cf7e90cc None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:12.048747 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f48574-4326-4852-9f39-6933cf7e90cc None admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:12.049703 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f48574-4326-4852-9f39-6933cf7e90cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:12.049809 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f48574-4326-4852-9f39-6933cf7e90cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:12.052142 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f48574-4326-4852-9f39-6933cf7e90cc None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:12.053153 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f0097f-94ff-4430-b37d-0d7e92ebc1ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:12.054039 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f0097f-94ff-4430-b37d-0d7e92ebc1ad None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:12.054323 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f0097f-94ff-4430-b37d-0d7e92ebc1ad None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:12.054595 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f0097f-94ff-4430-b37d-0d7e92ebc1ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:12.070264 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f0097f-94ff-4430-b37d-0d7e92ebc1ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:12.071722 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f0097f-94ff-4430-b37d-0d7e92ebc1ad None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:12.075769 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 258/520] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Aug 9 10:11:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:12.076636 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f48574-4326-4852-9f39-6933cf7e90cc None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:12.092498 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:12.093166 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-28f0097f-94ff-4430-b37d-0d7e92ebc1ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:12.093166 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:12.093166 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:12.093166 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:12.093166 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:12.093166 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:12.093166 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:12.093166 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:12.093166 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:12.093166 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:12.093166 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:12.093166 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:12.093166 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 10:11:12.093166 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 10:11:12.093166 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 10:11:12.093166 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 10:11:12.094255 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:12.094255 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:12.094255 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:12.094255 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:12.094255 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:12.094255 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:12.094255 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:12.094255 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:12.094255 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:12.094255 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:12.094255 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:12.094255 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:12.094255 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:12.094255 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:12.094255 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:12.094255 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:12.094255 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 10:11:12.095346 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 10:11:12.095346 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:12.095346 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:11:12.099844 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 263/521] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:11:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:12.099844 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f0097f-94ff-4430-b37d-0d7e92ebc1ad None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:12.140557 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:12.203578 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f48574-4326-4852-9f39-6933cf7e90cc None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:12.208397 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f0097f-94ff-4430-b37d-0d7e92ebc1ad None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:12.238514 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54a3cc7-b416-499f-8b65-a12b2e3506fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:12.239131 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a3cc7-b416-499f-8b65-a12b2e3506fc None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:12.239456 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a3cc7-b416-499f-8b65-a12b2e3506fc None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:12.239663 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a3cc7-b416-499f-8b65-a12b2e3506fc None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:12.244920 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c4b56c-f03b-4225-8b94-309b66d9131b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:12.245520 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c4b56c-f03b-4225-8b94-309b66d9131b None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:12.245796 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c4b56c-f03b-4225-8b94-309b66d9131b None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:12.246132 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c4b56c-f03b-4225-8b94-309b66d9131b None admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:12.247059 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54a3cc7-b416-499f-8b65-a12b2e3506fc None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:12.247529 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c4b56c-f03b-4225-8b94-309b66d9131b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:12.247837 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c4b56c-f03b-4225-8b94-309b66d9131b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:12.248542 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54a3cc7-b416-499f-8b65-a12b2e3506fc None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:12.249233 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c4b56c-f03b-4225-8b94-309b66d9131b None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:12.260053 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-c54a3cc7-b416-499f-8b65-a12b2e3506fc None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 09 10:11:12.260053 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:12.260053 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:12.260053 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:12.260053 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:12.260053 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:12.260053 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:12.260053 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:12.260053 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:12.260053 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:12.260053 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:12.260053 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:12.260053 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 10:11:12.260053 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 10:11:12.260053 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 10:11:12.260053 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 10:11:12.260949 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:12.260949 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:12.260949 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 10:11:12.260949 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 10:11:12.260949 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 10:11:12.260949 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 10:11:12.260949 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:12.260949 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:12.260949 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:12.260949 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:12.260949 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:12.260949 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:12.260949 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:12.260949 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:12.260949 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:12.260949 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:12.260949 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:12.260949 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:12.262522 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:12.262522 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:12.262522 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 10:11:12.262522 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 10:11:12.262522 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 10:11:12.262522 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 10:11:12.262522 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 10:11:12.262522 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 10:11:12.262522 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 09 10:11:12.262522 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:12.266317 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 259/522] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Aug 9 10:11:12 2022] GET /identity/v3/users/neutron => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:12.266898 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54a3cc7-b416-499f-8b65-a12b2e3506fc None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:12.271639 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 264/523] 10.222.0.36 () {56 vars in 1137 bytes} [Tue Aug 9 10:11:12 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:12.276782 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c4b56c-f03b-4225-8b94-309b66d9131b None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:12.348475 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:12.378786 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:12.383685 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c4b56c-f03b-4225-8b94-309b66d9131b None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:12.384025 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54a3cc7-b416-499f-8b65-a12b2e3506fc None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:12.419437 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaf5d2d-65fa-42fe-97de-980a3c0cfaba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:12.420027 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf5d2d-65fa-42fe-97de-980a3c0cfaba None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:12.420300 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf5d2d-65fa-42fe-97de-980a3c0cfaba None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:12.420565 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf5d2d-65fa-42fe-97de-980a3c0cfaba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:12.421275 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaf5d2d-65fa-42fe-97de-980a3c0cfaba None admin] RBAC: Adding query filter params (role.id=1252647548644b48900ef09f1df438fd, scope.project.id=28891cf6239a43469326a864fb0d216c, user.id=eb863beaaa9f495c8b64655996c061f2) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:12.421471 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1ab836-3638-4e13-8dd6-eeb4145669f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:12.421600 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaf5d2d-65fa-42fe-97de-980a3c0cfaba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:12.422033 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1ab836-3638-4e13-8dd6-eeb4145669f0 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:12.422310 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1ab836-3638-4e13-8dd6-eeb4145669f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:12.422575 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1ab836-3638-4e13-8dd6-eeb4145669f0 None admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:12.423114 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaf5d2d-65fa-42fe-97de-980a3c0cfaba None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:12.423210 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1ab836-3638-4e13-8dd6-eeb4145669f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:12.423483 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1ab836-3638-4e13-8dd6-eeb4145669f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:12.424824 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1ab836-3638-4e13-8dd6-eeb4145669f0 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:12.434285 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 260/524] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Aug 9 10:11:12 2022] GET /identity/v3/role_assignments?user.id=eb863beaaa9f495c8b64655996c061f2&scope.project.id=28891cf6239a43469326a864fb0d216c&role.id=1252647548644b48900ef09f1df438fd => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:12.434285 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaf5d2d-65fa-42fe-97de-980a3c0cfaba None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:12.441192 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 265/525] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Aug 9 10:11:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:12.442037 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1ab836-3638-4e13-8dd6-eeb4145669f0 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:12.553635 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaf5d2d-65fa-42fe-97de-980a3c0cfaba None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:12.572819 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1ab836-3638-4e13-8dd6-eeb4145669f0 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:12.596680 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841e6a93-b861-4c46-812e-488a41f0f1ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:12.597289 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841e6a93-b861-4c46-812e-488a41f0f1ae None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:12.597560 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841e6a93-b861-4c46-812e-488a41f0f1ae None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:12.597826 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841e6a93-b861-4c46-812e-488a41f0f1ae None admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:12.598642 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841e6a93-b861-4c46-812e-488a41f0f1ae None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:12.598882 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841e6a93-b861-4c46-812e-488a41f0f1ae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:12.600320 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841e6a93-b861-4c46-812e-488a41f0f1ae None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:12.613299 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:12.618191 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a25251-ac1b-4a24-9fcb-4f382c925b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:12.619383 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a25251-ac1b-4a24-9fcb-4f382c925b6f None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:12.619835 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a25251-ac1b-4a24-9fcb-4f382c925b6f None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:12.620263 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a25251-ac1b-4a24-9fcb-4f382c925b6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:12.646153 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 261/526] 10.222.0.36 () {56 vars in 1139 bytes} [Tue Aug 9 10:11:12 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:12.647072 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841e6a93-b861-4c46-812e-488a41f0f1ae None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:12.653131 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:12.695821 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a25251-ac1b-4a24-9fcb-4f382c925b6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:12.697708 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a25251-ac1b-4a24-9fcb-4f382c925b6f None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:12.759244 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841e6a93-b861-4c46-812e-488a41f0f1ae None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:12.796217 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383bb371-affd-485d-a938-d2ef7e3d006e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:12.796843 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383bb371-affd-485d-a938-d2ef7e3d006e None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:12.797197 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383bb371-affd-485d-a938-d2ef7e3d006e None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:12.797382 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383bb371-affd-485d-a938-d2ef7e3d006e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:12.804534 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383bb371-affd-485d-a938-d2ef7e3d006e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:12.806040 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383bb371-affd-485d-a938-d2ef7e3d006e None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:12.806623 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 266/527] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Aug 9 10:11:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 10:11:12.807478 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a25251-ac1b-4a24-9fcb-4f382c925b6f None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:12.819671 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-383bb371-affd-485d-a938-d2ef7e3d006e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 10:11:12.819671 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:12.819671 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:12.819671 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:12.819671 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:12.819671 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:12.819671 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:12.819671 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:12.819671 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:12.819671 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:12.819671 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:12.819671 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:12.819671 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 10:11:12.819671 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 10:11:12.819671 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 10:11:12.820547 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 10:11:12.820547 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:12.820547 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:12.820547 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:12.820547 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:12.820547 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:12.820547 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:12.820547 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:12.820547 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:12.820547 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:12.820547 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:12.820547 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:12.820547 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:12.820547 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:12.820547 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:12.820547 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:12.820547 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:12.821392 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 10:11:12.821392 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 10:11:12.821392 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 10:11:12.821392 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 10:11:12.821392 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 10:11:12.821392 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 10:11:12.821392 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 10:11:12.821392 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:12.828319 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 262/528] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Aug 9 10:11:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:12.829520 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383bb371-affd-485d-a938-d2ef7e3d006e None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:12.868407 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:12.891043 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:12.915074 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a25251-ac1b-4a24-9fcb-4f382c925b6f None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:12.947494 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383bb371-affd-485d-a938-d2ef7e3d006e None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:12.958020 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d5fb74-0395-476c-9e2a-dacf6a6bc2cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:12.958940 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d5fb74-0395-476c-9e2a-dacf6a6bc2cc None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:12.959415 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d5fb74-0395-476c-9e2a-dacf6a6bc2cc None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:12.959983 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d5fb74-0395-476c-9e2a-dacf6a6bc2cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:12.992138 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d123deeb-9beb-42b3-aafc-63afd0d639be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:12.993061 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d123deeb-9beb-42b3-aafc-63afd0d639be None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:12.993346 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d123deeb-9beb-42b3-aafc-63afd0d639be None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:12.993622 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d123deeb-9beb-42b3-aafc-63afd0d639be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:13.008940 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d123deeb-9beb-42b3-aafc-63afd0d639be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:13.011258 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d123deeb-9beb-42b3-aafc-63afd0d639be None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:13.029714 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-d123deeb-9beb-42b3-aafc-63afd0d639be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:13.029714 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:13.029714 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:13.029714 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:13.029714 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:13.029714 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:13.029714 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:13.029714 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:13.029714 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:13.029714 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:13.029714 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:13.029714 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:13.029714 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 10:11:13.029714 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 10:11:13.029714 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 10:11:13.029714 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 10:11:13.030707 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:13.030707 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:13.030707 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:13.030707 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:13.030707 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:13.030707 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:13.030707 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:13.030707 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:13.030707 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:13.030707 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:13.030707 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:13.030707 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:13.030707 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:13.030707 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:13.030707 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:13.030707 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:13.030707 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 10:11:13.031578 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 10:11:13.031578 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:13.031578 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:13.033358 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 263/529] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:11:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:13.034362 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d123deeb-9beb-42b3-aafc-63afd0d639be None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:13.045882 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d5fb74-0395-476c-9e2a-dacf6a6bc2cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:13.047421 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d5fb74-0395-476c-9e2a-dacf6a6bc2cc None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:13.127811 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:13.150827 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d123deeb-9beb-42b3-aafc-63afd0d639be None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:13.161430 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:13.182198 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 267/530] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Aug 9 10:11:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 10:11:13.183358 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d5fb74-0395-476c-9e2a-dacf6a6bc2cc None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:13.197814 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4c1a86-5b30-4ad2-93bf-ffad322af9da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:13.198436 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c1a86-5b30-4ad2-93bf-ffad322af9da None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:13.198721 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c1a86-5b30-4ad2-93bf-ffad322af9da None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:13.199734 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c1a86-5b30-4ad2-93bf-ffad322af9da None admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:13.201234 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4c1a86-5b30-4ad2-93bf-ffad322af9da None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:13.201544 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4c1a86-5b30-4ad2-93bf-ffad322af9da None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:13.203819 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4c1a86-5b30-4ad2-93bf-ffad322af9da None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:13.221946 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 264/531] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Aug 9 10:11:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:13.221946 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4c1a86-5b30-4ad2-93bf-ffad322af9da None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:13.319898 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d5fb74-0395-476c-9e2a-dacf6a6bc2cc None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:13.323077 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4c1a86-5b30-4ad2-93bf-ffad322af9da None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:13.360226 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421c6f26-553d-4288-80b2-fa4d70d45634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:13.361003 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c6f26-553d-4288-80b2-fa4d70d45634 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:13.361425 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c6f26-553d-4288-80b2-fa4d70d45634 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:13.361797 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c6f26-553d-4288-80b2-fa4d70d45634 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:13.364816 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06f688d-e1d6-46e5-8a63-088489f03d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:13.365420 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f688d-e1d6-46e5-8a63-088489f03d23 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:13.365695 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f688d-e1d6-46e5-8a63-088489f03d23 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:13.365990 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f688d-e1d6-46e5-8a63-088489f03d23 None admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:13.366623 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06f688d-e1d6-46e5-8a63-088489f03d23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:13.366921 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06f688d-e1d6-46e5-8a63-088489f03d23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:13.368328 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06f688d-e1d6-46e5-8a63-088489f03d23 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:13.373623 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421c6f26-553d-4288-80b2-fa4d70d45634 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:13.375201 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421c6f26-553d-4288-80b2-fa4d70d45634 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:13.383497 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 268/532] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Aug 9 10:11:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:13.384322 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06f688d-e1d6-46e5-8a63-088489f03d23 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:13.395167 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-421c6f26-553d-4288-80b2-fa4d70d45634 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:13.395167 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:13.395167 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:13.395167 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:13.395167 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:13.395167 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:13.395167 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:13.395167 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:13.395167 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:13.395167 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:13.395167 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:13.395167 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:13.395167 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 10:11:13.395167 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 10:11:13.395167 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 10:11:13.395167 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 10:11:13.396094 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:13.396094 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:13.396094 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:13.396094 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:13.396094 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:13.396094 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:13.396094 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:13.396094 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:13.396094 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:13.396094 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:13.396094 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:13.396094 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:13.396094 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:13.396094 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:13.396094 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:13.396094 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:13.396094 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 10:11:13.396923 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 10:11:13.396923 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:13.396923 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:13.401007 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 265/533] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:11:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:13.401822 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421c6f26-553d-4288-80b2-fa4d70d45634 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:13.405590 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:13.427616 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:13.502689 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06f688d-e1d6-46e5-8a63-088489f03d23 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:13.522524 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421c6f26-553d-4288-80b2-fa4d70d45634 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:13.539159 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2d3088-157a-4312-b72b-157fdffaa88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:13.539765 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d3088-157a-4312-b72b-157fdffaa88f None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:13.540040 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d3088-157a-4312-b72b-157fdffaa88f None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:13.540310 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d3088-157a-4312-b72b-157fdffaa88f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:13.541279 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2d3088-157a-4312-b72b-157fdffaa88f None admin] RBAC: Adding query filter params (role.id=1252647548644b48900ef09f1df438fd, scope.project.id=28891cf6239a43469326a864fb0d216c, user.id=1f6c687a38524de0bf23d87ae91d3b0f) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:13.541585 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2d3088-157a-4312-b72b-157fdffaa88f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:13.543725 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2d3088-157a-4312-b72b-157fdffaa88f None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:13.549912 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 269/534] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Aug 9 10:11:13 2022] GET /identity/v3/role_assignments?user.id=1f6c687a38524de0bf23d87ae91d3b0f&scope.project.id=28891cf6239a43469326a864fb0d216c&role.id=1252647548644b48900ef09f1df438fd => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:13.550783 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2d3088-157a-4312-b72b-157fdffaa88f None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:13.568246 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b67b6b-686f-4859-88b0-dab57878c198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:13.569288 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b67b6b-686f-4859-88b0-dab57878c198 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:13.569783 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b67b6b-686f-4859-88b0-dab57878c198 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:13.570374 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b67b6b-686f-4859-88b0-dab57878c198 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:13.578823 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b67b6b-686f-4859-88b0-dab57878c198 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:13.580723 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b67b6b-686f-4859-88b0-dab57878c198 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:13.595202 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-92b67b6b-686f-4859-88b0-dab57878c198 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 10:11:13.595202 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:13.595202 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:13.595202 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:13.595202 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:13.595202 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:13.595202 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:13.595202 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:13.595202 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:13.595202 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:13.595202 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:13.595202 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:13.595202 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 10:11:13.595202 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 10:11:13.595202 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 10:11:13.596112 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 10:11:13.596112 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:13.596112 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:13.596112 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:13.596112 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:13.596112 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:13.596112 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:13.596112 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:13.596112 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:13.596112 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:13.596112 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:13.596112 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:13.596112 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:13.596112 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:13.596112 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:13.596112 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:13.596112 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:13.596958 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 10:11:13.596958 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 10:11:13.596958 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 10:11:13.596958 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 10:11:13.596958 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 10:11:13.596958 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 10:11:13.596958 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 10:11:13.596958 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:13.599475 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 266/535] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Aug 9 10:11:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:13.609909 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b67b6b-686f-4859-88b0-dab57878c198 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:13.682544 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:13.704142 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:13.719592 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2d3088-157a-4312-b72b-157fdffaa88f None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:13.730148 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b67b6b-686f-4859-88b0-dab57878c198 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:13.781117 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad0bc87-2a82-4a76-bb71-6bfd7c5b65ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:13.781743 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0bc87-2a82-4a76-bb71-6bfd7c5b65ef None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:13.782034 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0bc87-2a82-4a76-bb71-6bfd7c5b65ef None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:13.785870 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0bc87-2a82-4a76-bb71-6bfd7c5b65ef None admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:13.785870 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad0bc87-2a82-4a76-bb71-6bfd7c5b65ef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:13.785870 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad0bc87-2a82-4a76-bb71-6bfd7c5b65ef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:13.785870 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad0bc87-2a82-4a76-bb71-6bfd7c5b65ef None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:13.809461 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea7fc88-e960-4a2e-9a36-292084868257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:13.810125 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea7fc88-e960-4a2e-9a36-292084868257 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:13.811687 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea7fc88-e960-4a2e-9a36-292084868257 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:13.811687 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea7fc88-e960-4a2e-9a36-292084868257 None admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:13.811687 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea7fc88-e960-4a2e-9a36-292084868257 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:13.811687 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea7fc88-e960-4a2e-9a36-292084868257 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:13.812079 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 267/536] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Aug 9 10:11:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:13.812945 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea7fc88-e960-4a2e-9a36-292084868257 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:13.818400 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad0bc87-2a82-4a76-bb71-6bfd7c5b65ef None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:13.832336 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 270/537] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Aug 9 10:11:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:13.837665 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea7fc88-e960-4a2e-9a36-292084868257 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:13.938252 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad0bc87-2a82-4a76-bb71-6bfd7c5b65ef None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:13.985385 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a4b53f-2ce5-493d-91b4-e6ccf623fbd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:13.986015 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4b53f-2ce5-493d-91b4-e6ccf623fbd7 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:13.986729 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4b53f-2ce5-493d-91b4-e6ccf623fbd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:13.987004 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4b53f-2ce5-493d-91b4-e6ccf623fbd7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:13.987991 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a4b53f-2ce5-493d-91b4-e6ccf623fbd7 None admin] RBAC: Adding query filter params (role.id=1252647548644b48900ef09f1df438fd, scope.project.id=28891cf6239a43469326a864fb0d216c, user.id=07540b72afd34927855c41db09a7b030) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:13.988301 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a4b53f-2ce5-493d-91b4-e6ccf623fbd7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:13.989919 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a4b53f-2ce5-493d-91b4-e6ccf623fbd7 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:13.998424 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 268/538] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Aug 9 10:11:13 2022] GET /identity/v3/role_assignments?user.id=07540b72afd34927855c41db09a7b030&scope.project.id=28891cf6239a43469326a864fb0d216c&role.id=1252647548644b48900ef09f1df438fd => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:13.999292 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea7fc88-e960-4a2e-9a36-292084868257 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:13.999685 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8938f4b1-5d87-4d54-8bc8-5501f64d3ea2 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:13.999972 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8938f4b1-5d87-4d54-8bc8-5501f64d3ea2 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:14.000241 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8938f4b1-5d87-4d54-8bc8-5501f64d3ea2 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:14.001942 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 269/539] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:11:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:11:14.008276 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea26230-6253-4298-af16-49483c3f03d3 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:14.008549 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea26230-6253-4298-af16-49483c3f03d3 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:14.011830 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea26230-6253-4298-af16-49483c3f03d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:14.023790 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:14.048571 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-cea26230-6253-4298-af16-49483c3f03d3 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:11:14.049810 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-cea26230-6253-4298-af16-49483c3f03d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:11:14.099177 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b598320-9a0e-495d-abdc-4cfcce4189fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:14.099850 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b598320-9a0e-495d-abdc-4cfcce4189fd None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:14.100131 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b598320-9a0e-495d-abdc-4cfcce4189fd None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:14.100402 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b598320-9a0e-495d-abdc-4cfcce4189fd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:14.119156 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b598320-9a0e-495d-abdc-4cfcce4189fd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:14.120638 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b598320-9a0e-495d-abdc-4cfcce4189fd None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:14.135006 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 270/540] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:11:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 10:11:14.147536 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-4b598320-9a0e-495d-abdc-4cfcce4189fd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 10:11:14.147536 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:14.147536 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:14.147536 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:14.147536 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:14.147536 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:14.147536 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:14.147536 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:14.147536 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:14.147536 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:14.147536 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:14.147536 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:14.147536 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 10:11:14.147536 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 10:11:14.147536 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 10:11:14.148438 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 10:11:14.148438 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:14.148438 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:14.148438 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:14.148438 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:14.148438 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:14.148438 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:14.148438 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:14.148438 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:14.148438 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:14.148438 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:14.148438 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:14.148438 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:14.148438 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:14.148438 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:14.148438 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:14.148438 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:14.149895 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 10:11:14.149895 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 10:11:14.149895 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 10:11:14.149895 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 10:11:14.149895 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 10:11:14.149895 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 10:11:14.149895 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 10:11:14.149895 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:11:14.149895 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 271/541] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Aug 9 10:11:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:14.154935 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea26230-6253-4298-af16-49483c3f03d3 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:14.169874 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b598320-9a0e-495d-abdc-4cfcce4189fd None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:14.170397 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:14.282465 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea26230-6253-4298-af16-49483c3f03d3 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:14.317285 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:14.324354 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715dd2bd-fdb7-47b4-804a-e5f5d7c9ed93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:14.325580 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715dd2bd-fdb7-47b4-804a-e5f5d7c9ed93 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:14.326226 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715dd2bd-fdb7-47b4-804a-e5f5d7c9ed93 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:14.326703 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715dd2bd-fdb7-47b4-804a-e5f5d7c9ed93 None admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:14.327586 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715dd2bd-fdb7-47b4-804a-e5f5d7c9ed93 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:14.328100 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715dd2bd-fdb7-47b4-804a-e5f5d7c9ed93 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:14.329720 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715dd2bd-fdb7-47b4-804a-e5f5d7c9ed93 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:14.344132 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 271/542] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Aug 9 10:11:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:14.349416 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715dd2bd-fdb7-47b4-804a-e5f5d7c9ed93 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:14.391800 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b598320-9a0e-495d-abdc-4cfcce4189fd None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:14.464184 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715dd2bd-fdb7-47b4-804a-e5f5d7c9ed93 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:14.487157 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ce25ec-e0ae-4cb6-922c-f7e07359654f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:14.487801 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce25ec-e0ae-4cb6-922c-f7e07359654f None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:14.488077 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce25ec-e0ae-4cb6-922c-f7e07359654f None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:14.488344 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce25ec-e0ae-4cb6-922c-f7e07359654f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:14.501342 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba07da5-b32f-4128-b417-965c597d996b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:14.502332 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba07da5-b32f-4128-b417-965c597d996b None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:14.502915 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba07da5-b32f-4128-b417-965c597d996b None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:14.503376 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba07da5-b32f-4128-b417-965c597d996b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:14.504407 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba07da5-b32f-4128-b417-965c597d996b None admin] RBAC: Adding query filter params (role.id=1252647548644b48900ef09f1df438fd, scope.project.id=28891cf6239a43469326a864fb0d216c, user.id=9169847a16764da3a2a1dbb5f5f56438) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:14.504908 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba07da5-b32f-4128-b417-965c597d996b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:14.506649 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba07da5-b32f-4128-b417-965c597d996b None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:14.513297 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 272/543] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Aug 9 10:11:14 2022] GET /identity/v3/role_assignments?user.id=9169847a16764da3a2a1dbb5f5f56438&scope.project.id=28891cf6239a43469326a864fb0d216c&role.id=1252647548644b48900ef09f1df438fd => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:11:14.519062 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ce25ec-e0ae-4cb6-922c-f7e07359654f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 10:11:14.523693 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-b1ce25ec-e0ae-4cb6-922c-f7e07359654f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 10:11:14.523693 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:14.523693 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:14.523693 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:14.523693 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:14.523693 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:14.523693 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:14.523693 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:14.523693 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:14.523693 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:14.523693 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:14.523693 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:14.523693 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 10:11:14.523693 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 10:11:14.523693 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 10:11:14.523693 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 10:11:14.524584 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 10:11:14.524584 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 10:11:14.524584 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 10:11:14.524584 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 10:11:14.524584 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:14.524584 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:14.524584 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:14.524584 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:14.524584 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:14.524584 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:14.524584 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:14.524584 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:14.524584 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:14.524584 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:14.524584 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:14.524584 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:14.526008 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:14.526008 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:14.526008 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:14.526008 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:14.526008 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 10:11:14.526008 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 10:11:14.526008 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 10:11:14.526008 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 10:11:14.526008 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 10:11:14.526008 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 10:11:14.526008 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 10:11:14.526008 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:11:14.526008 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 272/544] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Aug 9 10:11:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:14.531233 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba07da5-b32f-4128-b417-965c597d996b None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:14.630229 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:14.677739 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9a14ae-2f28-4d13-b47d-d4f5119a284f None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:14.678208 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9a14ae-2f28-4d13-b47d-d4f5119a284f None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:14.678635 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9a14ae-2f28-4d13-b47d-d4f5119a284f None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:14.680059 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 273/545] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:11:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:11:14.686177 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eebf9ab-5410-4682-8b44-b512997580f6 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:14.686455 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eebf9ab-5410-4682-8b44-b512997580f6 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:14.686724 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eebf9ab-5410-4682-8b44-b512997580f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:14.694161 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba07da5-b32f-4128-b417-965c597d996b None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:14.730001 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-5eebf9ab-5410-4682-8b44-b512997580f6 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:11:14.730225 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7132801-777d-4fa0-8dbb-a985b4190b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:14.730860 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7132801-777d-4fa0-8dbb-a985b4190b6e None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:14.731144 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7132801-777d-4fa0-8dbb-a985b4190b6e None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:14.731292 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-5eebf9ab-5410-4682-8b44-b512997580f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:11:14.731417 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7132801-777d-4fa0-8dbb-a985b4190b6e None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:14.732370 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7132801-777d-4fa0-8dbb-a985b4190b6e None admin] RBAC: Adding query filter params (name=service) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:14.732742 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7132801-777d-4fa0-8dbb-a985b4190b6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:14.734401 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7132801-777d-4fa0-8dbb-a985b4190b6e None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:14.743861 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 273/546] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Aug 9 10:11:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:14.750268 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7132801-777d-4fa0-8dbb-a985b4190b6e None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:14.847293 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:14.870235 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 274/547] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:11:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 10:11:14.894121 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7132801-777d-4fa0-8dbb-a985b4190b6e None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:14.914699 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eebf9ab-5410-4682-8b44-b512997580f6 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:14.926203 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:14.957190 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b64102e-96a6-411c-953f-7b5822b6d238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:14.958581 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b64102e-96a6-411c-953f-7b5822b6d238 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:14.958856 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b64102e-96a6-411c-953f-7b5822b6d238 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:14.959119 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b64102e-96a6-411c-953f-7b5822b6d238 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:14.982675 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b64102e-96a6-411c-953f-7b5822b6d238 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:14.984371 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b64102e-96a6-411c-953f-7b5822b6d238 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:15.010443 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-2b64102e-96a6-411c-953f-7b5822b6d238 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:15.010443 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:15.010443 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:15.010443 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:15.010443 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:15.010443 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:15.010443 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:15.010443 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:15.010443 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:15.010443 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:15.010443 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:15.010443 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:15.010443 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 10:11:15.010443 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 10:11:15.010443 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 10:11:15.010443 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 10:11:15.011672 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:15.011672 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:15.011672 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:15.011672 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:15.011672 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:15.011672 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:15.011672 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:15.011672 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:15.011672 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:15.011672 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:15.011672 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:15.011672 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:15.011672 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:15.011672 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:15.011672 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:15.011672 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:15.011672 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 10:11:15.012533 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 10:11:15.012533 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:15.012533 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:15.013063 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 274/548] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:11:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:15.018740 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b64102e-96a6-411c-953f-7b5822b6d238 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:15.086761 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eebf9ab-5410-4682-8b44-b512997580f6 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:15.163759 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b72066-60ce-4168-821b-29a08f508abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:15.164311 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b72066-60ce-4168-821b-29a08f508abe None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:15.164583 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b72066-60ce-4168-821b-29a08f508abe None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:15.164845 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b72066-60ce-4168-821b-29a08f508abe None admin] PATH_INFO: `/v3/roles/service` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:15.187872 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b72066-60ce-4168-821b-29a08f508abe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 10:11:15.192523 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-b0b72066-60ce-4168-821b-29a08f508abe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 10:11:15.192523 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:15.192523 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:15.192523 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:15.192523 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:15.192523 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:15.192523 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:15.192523 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:15.192523 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:15.192523 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:15.192523 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:15.192523 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:15.192523 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 10:11:15.192523 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 10:11:15.192523 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 10:11:15.192523 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 10:11:15.193388 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 10:11:15.193388 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 10:11:15.193388 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 10:11:15.193388 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 10:11:15.193388 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:15.193388 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:15.193388 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:15.193388 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:15.193388 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:15.193388 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:15.193388 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:15.193388 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:15.193388 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:15.193388 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:15.193388 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:15.193388 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:15.194775 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:15.194775 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:15.194775 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:15.194775 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:15.194775 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 10:11:15.194775 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 10:11:15.194775 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 10:11:15.194775 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 10:11:15.194775 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 10:11:15.194775 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 10:11:15.194775 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 10:11:15.194775 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:11:15.201433 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 275/549] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Aug 9 10:11:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 10:11:15.201433 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b72066-60ce-4168-821b-29a08f508abe None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:15.225118 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b64102e-96a6-411c-953f-7b5822b6d238 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:15.288639 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4975e83-fc16-4550-bd9e-47a9e34d01c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:15.289238 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4975e83-fc16-4550-bd9e-47a9e34d01c8 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:15.289509 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4975e83-fc16-4550-bd9e-47a9e34d01c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:15.289773 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4975e83-fc16-4550-bd9e-47a9e34d01c8 None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:15.290779 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4975e83-fc16-4550-bd9e-47a9e34d01c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:15.291074 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4975e83-fc16-4550-bd9e-47a9e34d01c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:15.292542 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4975e83-fc16-4550-bd9e-47a9e34d01c8 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:15.294510 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:15.307539 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 275/550] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Aug 9 10:11:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:15.313371 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4975e83-fc16-4550-bd9e-47a9e34d01c8 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:15.357959 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:15.388368 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b72066-60ce-4168-821b-29a08f508abe None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:15.462869 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c63c997-bad0-4b8e-a590-962102ac2207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:15.463398 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c63c997-bad0-4b8e-a590-962102ac2207 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:15.463672 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c63c997-bad0-4b8e-a590-962102ac2207 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:15.463941 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c63c997-bad0-4b8e-a590-962102ac2207 None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:15.464605 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c63c997-bad0-4b8e-a590-962102ac2207 None admin] RBAC: Adding query filter params (name=service) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:15.465485 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c63c997-bad0-4b8e-a590-962102ac2207 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:15.466936 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c63c997-bad0-4b8e-a590-962102ac2207 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:15.484477 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 276/551] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Aug 9 10:11:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:15.488683 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c63c997-bad0-4b8e-a590-962102ac2207 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:15.503709 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4975e83-fc16-4550-bd9e-47a9e34d01c8 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:15.570985 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1564ac84-d885-41ac-9e95-25e6988308e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:15.573074 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1564ac84-d885-41ac-9e95-25e6988308e5 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:15.573481 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1564ac84-d885-41ac-9e95-25e6988308e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:15.573827 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1564ac84-d885-41ac-9e95-25e6988308e5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:15.591086 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1564ac84-d885-41ac-9e95-25e6988308e5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:15.592781 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1564ac84-d885-41ac-9e95-25e6988308e5 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:15.615932 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-1564ac84-d885-41ac-9e95-25e6988308e5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 09 10:11:15.615932 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:15.615932 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:15.615932 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:15.615932 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:15.615932 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:15.615932 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:15.615932 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:15.615932 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:15.615932 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:15.615932 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:15.615932 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:15.615932 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 10:11:15.615932 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 10:11:15.615932 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 10:11:15.615932 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 10:11:15.616977 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:15.616977 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:15.616977 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 10:11:15.616977 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 10:11:15.616977 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 10:11:15.616977 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 10:11:15.616977 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:15.616977 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:15.616977 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:15.616977 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:15.616977 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:15.616977 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:15.616977 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:15.616977 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:15.616977 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:15.616977 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:15.616977 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:15.616977 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:15.618031 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:15.618031 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:15.618031 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 10:11:15.618031 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 10:11:15.618031 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 10:11:15.618031 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 10:11:15.618031 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 10:11:15.618031 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 10:11:15.618031 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 09 10:11:15.618031 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:15.622446 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 276/552] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Aug 9 10:11:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:15.627505 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1564ac84-d885-41ac-9e95-25e6988308e5 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:15.686900 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c63c997-bad0-4b8e-a590-962102ac2207 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:15.713937 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:15.756309 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe63e874-fb0e-41f3-89a5-521dccd16c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:15.756935 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe63e874-fb0e-41f3-89a5-521dccd16c5f None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:15.757206 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe63e874-fb0e-41f3-89a5-521dccd16c5f None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:15.757470 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe63e874-fb0e-41f3-89a5-521dccd16c5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:15.782132 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe63e874-fb0e-41f3-89a5-521dccd16c5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:15.783580 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe63e874-fb0e-41f3-89a5-521dccd16c5f None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:15.802462 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:15.813921 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-fe63e874-fb0e-41f3-89a5-521dccd16c5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:15.813921 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:15.813921 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:15.813921 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:15.813921 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:15.813921 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:15.813921 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:15.813921 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:15.813921 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:15.813921 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:15.813921 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:15.813921 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:15.813921 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 10:11:15.813921 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 10:11:15.813921 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 10:11:15.813921 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 10:11:15.816193 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:15.816193 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:15.816193 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:15.816193 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:15.816193 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:15.816193 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:15.816193 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:15.816193 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:15.816193 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:15.816193 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:15.816193 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:15.816193 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:15.816193 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:15.816193 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:15.816193 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:15.816193 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:15.816193 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 10:11:15.818382 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 10:11:15.818382 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:15.818382 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:11:15.818382 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 277/553] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:11:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:15.822031 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe63e874-fb0e-41f3-89a5-521dccd16c5f None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:15.834617 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1564ac84-d885-41ac-9e95-25e6988308e5 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:15.882255 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5755a2da-01d9-42c6-aa66-843f7155b05e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:15.883771 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5755a2da-01d9-42c6-aa66-843f7155b05e None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:15.884050 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5755a2da-01d9-42c6-aa66-843f7155b05e None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:15.884326 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5755a2da-01d9-42c6-aa66-843f7155b05e None admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:15.885062 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5755a2da-01d9-42c6-aa66-843f7155b05e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:15.885367 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5755a2da-01d9-42c6-aa66-843f7155b05e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:15.887332 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5755a2da-01d9-42c6-aa66-843f7155b05e None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:15.910078 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 277/554] 10.222.0.36 () {56 vars in 1135 bytes} [Tue Aug 9 10:11:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:15.911646 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1bd5ee-76ee-47ad-878b-1d1794f8d238 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:15.911928 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1bd5ee-76ee-47ad-878b-1d1794f8d238 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:15.912227 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1bd5ee-76ee-47ad-878b-1d1794f8d238 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:15.918670 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 278/555] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:11:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:11:15.918670 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1bd5ee-76ee-47ad-878b-1d1794f8d238 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:15.975882 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe63e874-fb0e-41f3-89a5-521dccd16c5f None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:16.020918 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ff4db3-5aa2-4820-a9d1-fc9ca91676cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:16.022506 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ff4db3-5aa2-4820-a9d1-fc9ca91676cd None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:16.023432 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ff4db3-5aa2-4820-a9d1-fc9ca91676cd None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:16.024064 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ff4db3-5aa2-4820-a9d1-fc9ca91676cd None admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:16.025069 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ff4db3-5aa2-4820-a9d1-fc9ca91676cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:16.025832 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ff4db3-5aa2-4820-a9d1-fc9ca91676cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:16.028819 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ff4db3-5aa2-4820-a9d1-fc9ca91676cd None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:16.046466 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 278/556] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Aug 9 10:11:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:16.048055 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6703be-bea0-4f64-bef7-477b153ff679 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:16.048661 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6703be-bea0-4f64-bef7-477b153ff679 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:16.048987 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1bd5ee-76ee-47ad-878b-1d1794f8d238 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:16.049433 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6703be-bea0-4f64-bef7-477b153ff679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:16.072939 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-cf6703be-bea0-4f64-bef7-477b153ff679 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:11:16.075543 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-cf6703be-bea0-4f64-bef7-477b153ff679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:11:16.088114 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e52fbc3-dad3-4a3f-a2f5-d5e6c3cbeee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:16.088709 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e52fbc3-dad3-4a3f-a2f5-d5e6c3cbeee7 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:16.088983 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e52fbc3-dad3-4a3f-a2f5-d5e6c3cbeee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:16.089242 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e52fbc3-dad3-4a3f-a2f5-d5e6c3cbeee7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:16.102448 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:16.120928 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:16.178313 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e52fbc3-dad3-4a3f-a2f5-d5e6c3cbeee7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:16.178640 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 279/557] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:11:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 10:11:16.179453 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6703be-bea0-4f64-bef7-477b153ff679 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:16.180304 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e52fbc3-dad3-4a3f-a2f5-d5e6c3cbeee7 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:16.295232 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 279/558] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Aug 9 10:11:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 10:11:16.296521 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e52fbc3-dad3-4a3f-a2f5-d5e6c3cbeee7 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:16.318184 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6703be-bea0-4f64-bef7-477b153ff679 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:16.349304 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:16.366973 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f8bd64-c6cd-40d2-9290-4c135c23d027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:16.367599 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f8bd64-c6cd-40d2-9290-4c135c23d027 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:16.367874 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f8bd64-c6cd-40d2-9290-4c135c23d027 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:16.368142 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f8bd64-c6cd-40d2-9290-4c135c23d027 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:16.378547 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f8bd64-c6cd-40d2-9290-4c135c23d027 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:16.380551 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f8bd64-c6cd-40d2-9290-4c135c23d027 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:16.396434 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-25f8bd64-c6cd-40d2-9290-4c135c23d027 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 09 10:11:16.396434 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:16.396434 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:16.396434 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:16.396434 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:16.396434 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:16.396434 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:16.396434 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:16.396434 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:16.396434 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:16.396434 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:16.396434 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:16.396434 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 10:11:16.396434 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 10:11:16.396434 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 10:11:16.396434 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 10:11:16.398177 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:16.398177 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:16.398177 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 10:11:16.398177 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 10:11:16.398177 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 10:11:16.398177 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 10:11:16.398177 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:16.398177 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:16.398177 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:16.398177 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:16.398177 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:16.398177 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:16.398177 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:16.398177 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:16.398177 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:16.398177 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:16.398177 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:16.398177 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:16.399119 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:16.399119 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:16.399119 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 10:11:16.399119 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 10:11:16.399119 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 10:11:16.399119 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 10:11:16.399119 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 10:11:16.399119 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 10:11:16.399119 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 09 10:11:16.399119 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:11:16.399119 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 280/559] 10.222.0.36 () {56 vars in 1093 bytes} [Tue Aug 9 10:11:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:16.399119 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f8bd64-c6cd-40d2-9290-4c135c23d027 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:16.411359 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e52fbc3-dad3-4a3f-a2f5-d5e6c3cbeee7 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:16.424106 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:16.450417 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e599388-4ffe-4683-8e77-c07cdc040b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:16.451447 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e599388-4ffe-4683-8e77-c07cdc040b48 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:16.452002 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e599388-4ffe-4683-8e77-c07cdc040b48 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:16.452507 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e599388-4ffe-4683-8e77-c07cdc040b48 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:16.463798 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e599388-4ffe-4683-8e77-c07cdc040b48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 10:11:16.471360 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-1e599388-4ffe-4683-8e77-c07cdc040b48 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 10:11:16.471360 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:16.471360 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:16.471360 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:16.471360 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:16.471360 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:16.471360 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:16.471360 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:16.471360 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:16.471360 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:16.471360 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:16.471360 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:16.471360 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 10:11:16.471360 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 10:11:16.471360 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 10:11:16.471360 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 10:11:16.472444 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 10:11:16.472444 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 10:11:16.472444 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 10:11:16.472444 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 10:11:16.472444 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:16.472444 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:16.472444 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:16.472444 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:16.472444 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:16.472444 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:16.472444 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:16.472444 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:16.472444 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:16.472444 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:16.472444 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:16.472444 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:16.473263 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:16.473263 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:16.473263 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:16.473263 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:16.473263 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 10:11:16.473263 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 10:11:16.473263 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 10:11:16.473263 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 10:11:16.473263 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 10:11:16.473263 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 10:11:16.473263 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 10:11:16.473263 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:16.481498 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 280/560] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Aug 9 10:11:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:16.482746 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e599388-4ffe-4683-8e77-c07cdc040b48 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:16.519341 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f8bd64-c6cd-40d2-9290-4c135c23d027 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:16.556435 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299f9e1b-096a-4ab8-bcf6-e22aac55f886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:16.556966 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299f9e1b-096a-4ab8-bcf6-e22aac55f886 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:16.557242 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299f9e1b-096a-4ab8-bcf6-e22aac55f886 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:16.557507 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299f9e1b-096a-4ab8-bcf6-e22aac55f886 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:16.568632 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299f9e1b-096a-4ab8-bcf6-e22aac55f886 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:16.570197 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299f9e1b-096a-4ab8-bcf6-e22aac55f886 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:16.584714 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-299f9e1b-096a-4ab8-bcf6-e22aac55f886 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:16.584714 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:16.584714 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:16.584714 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:16.584714 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:16.584714 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:16.584714 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:16.584714 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:16.584714 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:16.584714 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:16.584714 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:16.584714 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:16.584714 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 10:11:16.584714 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 10:11:16.584714 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 10:11:16.584714 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 10:11:16.586132 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:16.586132 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:16.586132 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:16.586132 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:16.586132 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:16.586132 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:16.586132 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:16.586132 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:16.586132 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:16.586132 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:16.586132 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:16.586132 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:16.586132 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:16.586132 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:16.586132 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:16.586132 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:16.586132 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 10:11:16.587314 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 10:11:16.587314 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:16.587314 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:11:16.592160 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 281/561] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:11:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:16.592992 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299f9e1b-096a-4ab8-bcf6-e22aac55f886 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:16.595161 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e599388-4ffe-4683-8e77-c07cdc040b48 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:16.608275 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:16.639039 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826e54c7-7bf7-46a7-838a-85192a4a5338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:16.639717 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e54c7-7bf7-46a7-838a-85192a4a5338 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:16.639994 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e54c7-7bf7-46a7-838a-85192a4a5338 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:16.640261 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e54c7-7bf7-46a7-838a-85192a4a5338 None admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:16.641051 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826e54c7-7bf7-46a7-838a-85192a4a5338 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:16.641355 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826e54c7-7bf7-46a7-838a-85192a4a5338 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:16.642818 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826e54c7-7bf7-46a7-838a-85192a4a5338 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:16.663233 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 281/562] 10.222.0.36 () {56 vars in 1133 bytes} [Tue Aug 9 10:11:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:16.664520 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec614f3f-3d55-4d08-9f65-4f006d321c20 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:16.664859 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec614f3f-3d55-4d08-9f65-4f006d321c20 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:16.665134 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec614f3f-3d55-4d08-9f65-4f006d321c20 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:16.669887 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 282/563] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:11:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:11:16.669887 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec614f3f-3d55-4d08-9f65-4f006d321c20 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:16.681713 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:16.720238 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299f9e1b-096a-4ab8-bcf6-e22aac55f886 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:16.758507 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4352db2e-f8bc-4762-aafd-b79b874a34f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:16.759145 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4352db2e-f8bc-4762-aafd-b79b874a34f8 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:16.759425 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4352db2e-f8bc-4762-aafd-b79b874a34f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:16.759698 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4352db2e-f8bc-4762-aafd-b79b874a34f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:16.760368 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4352db2e-f8bc-4762-aafd-b79b874a34f8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:16.760669 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4352db2e-f8bc-4762-aafd-b79b874a34f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:16.762132 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4352db2e-f8bc-4762-aafd-b79b874a34f8 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:16.770500 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 282/564] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Aug 9 10:11:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:16.771311 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4352db2e-f8bc-4762-aafd-b79b874a34f8 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:16.775938 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec614f3f-3d55-4d08-9f65-4f006d321c20 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:16.810553 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feae727-b94e-4bc0-ac67-5b298774754e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:16.811073 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feae727-b94e-4bc0-ac67-5b298774754e None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:16.811348 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feae727-b94e-4bc0-ac67-5b298774754e None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:16.811613 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feae727-b94e-4bc0-ac67-5b298774754e None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:16.812268 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feae727-b94e-4bc0-ac67-5b298774754e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:16.812570 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feae727-b94e-4bc0-ac67-5b298774754e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:16.813948 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feae727-b94e-4bc0-ac67-5b298774754e None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:16.825301 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 283/565] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Aug 9 10:11:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:16.826564 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a23884c-56df-4f6b-bbe1-edd3ffa15852 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:16.826929 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a23884c-56df-4f6b-bbe1-edd3ffa15852 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:16.827196 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a23884c-56df-4f6b-bbe1-edd3ffa15852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:16.844722 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-2a23884c-56df-4f6b-bbe1-edd3ffa15852 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:11:16.845926 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-2a23884c-56df-4f6b-bbe1-edd3ffa15852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:11:16.866660 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:16.872336 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4352db2e-f8bc-4762-aafd-b79b874a34f8 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:16.899148 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:16.905167 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bced60f-8696-4b56-bbed-6db540f3bcf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:16.905783 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bced60f-8696-4b56-bbed-6db540f3bcf6 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:16.906092 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bced60f-8696-4b56-bbed-6db540f3bcf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:16.906357 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bced60f-8696-4b56-bbed-6db540f3bcf6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:16.913868 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 284/566] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:11:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 10:11:16.915173 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36702884-2cca-4d6f-b19b-90f340b548c0 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:16.915775 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36702884-2cca-4d6f-b19b-90f340b548c0 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:16.916056 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36702884-2cca-4d6f-b19b-90f340b548c0 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:16.917037 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bced60f-8696-4b56-bbed-6db540f3bcf6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:16.917281 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 285/567] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:11:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:11:16.919061 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36702884-2cca-4d6f-b19b-90f340b548c0 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:16.919474 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bced60f-8696-4b56-bbed-6db540f3bcf6 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:16.936437 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-4bced60f-8696-4b56-bbed-6db540f3bcf6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:16.936437 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:16.936437 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:16.936437 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:16.936437 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:16.936437 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:16.936437 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:16.936437 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:16.936437 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:16.936437 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:16.936437 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:16.936437 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:16.936437 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 10:11:16.936437 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 10:11:16.936437 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 10:11:16.936437 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 10:11:16.937438 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:16.937438 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:16.937438 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:16.937438 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:16.937438 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:16.937438 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:16.937438 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:16.937438 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:16.937438 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:16.937438 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:16.937438 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:16.937438 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:16.937438 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:16.937438 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:16.937438 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:16.937438 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:16.937438 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 10:11:16.938351 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 10:11:16.938351 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:16.938351 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:11:16.938351 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 283/568] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:11:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:16.938715 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bced60f-8696-4b56-bbed-6db540f3bcf6 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:17.032701 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36702884-2cca-4d6f-b19b-90f340b548c0 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:17.041095 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bced60f-8696-4b56-bbed-6db540f3bcf6 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:17.067729 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e81312b-9e5d-46f1-a3c7-1c63e61bdeee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:17.068288 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e81312b-9e5d-46f1-a3c7-1c63e61bdeee None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:17.068562 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e81312b-9e5d-46f1-a3c7-1c63e61bdeee None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:17.068830 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e81312b-9e5d-46f1-a3c7-1c63e61bdeee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:17.074964 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd36529-0c2a-4849-baca-6b7a6b280bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:17.075708 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd36529-0c2a-4849-baca-6b7a6b280bcd None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:17.075874 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd36529-0c2a-4849-baca-6b7a6b280bcd None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:17.076148 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd36529-0c2a-4849-baca-6b7a6b280bcd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:17.081250 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e81312b-9e5d-46f1-a3c7-1c63e61bdeee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:17.082769 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e81312b-9e5d-46f1-a3c7-1c63e61bdeee None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:17.083070 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd36529-0c2a-4849-baca-6b7a6b280bcd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:17.084498 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd36529-0c2a-4849-baca-6b7a6b280bcd None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:17.095905 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-ddd36529-0c2a-4849-baca-6b7a6b280bcd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 10:11:17.095905 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:17.095905 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:17.095905 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:17.095905 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:17.095905 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:17.095905 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:17.095905 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:17.095905 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:17.095905 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:17.095905 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:17.095905 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:17.095905 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 10:11:17.095905 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 10:11:17.095905 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 10:11:17.096841 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 10:11:17.096841 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:17.096841 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:17.096841 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:17.096841 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:17.096841 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:17.096841 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:17.096841 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:17.096841 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:17.096841 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:17.096841 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:17.096841 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:17.096841 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:17.096841 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:17.096841 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:17.096841 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:17.096841 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:17.097723 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 10:11:17.097723 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 10:11:17.097723 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 10:11:17.097723 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 10:11:17.097723 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 10:11:17.097723 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 10:11:17.097723 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 10:11:17.097723 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:11:17.097723 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 284/569] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Aug 9 10:11:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:17.098246 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-7e81312b-9e5d-46f1-a3c7-1c63e61bdeee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:17.098246 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:17.098246 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:17.098246 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:17.098246 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:17.098246 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:17.098246 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:17.098246 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:17.098246 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:17.098246 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:17.098246 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:17.098246 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:17.098246 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 10:11:17.098246 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 10:11:17.098246 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 10:11:17.098246 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 10:11:17.104078 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:17.104078 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:17.104078 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:17.104078 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:17.104078 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:17.104078 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:17.104078 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:17.104078 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:17.104078 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:17.104078 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:17.104078 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:17.104078 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:17.104078 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:17.104078 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:17.104078 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:17.104078 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:17.104078 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 10:11:17.105157 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 10:11:17.105157 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:17.105157 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:17.105438 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a633b10-64eb-4960-bb02-ae53914f32af None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:17.105438 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a633b10-64eb-4960-bb02-ae53914f32af None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:17.105438 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a633b10-64eb-4960-bb02-ae53914f32af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:17.105715 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 286/570] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:11:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:17.105715 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e81312b-9e5d-46f1-a3c7-1c63e61bdeee None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:17.116561 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:17.118826 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-5a633b10-64eb-4960-bb02-ae53914f32af None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:11:17.120041 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-5a633b10-64eb-4960-bb02-ae53914f32af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:11:17.156359 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:17.188230 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 285/571] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:11:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 10:11:17.189049 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a633b10-64eb-4960-bb02-ae53914f32af None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:17.211560 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e81312b-9e5d-46f1-a3c7-1c63e61bdeee None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:17.244895 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a92e4f-3564-479c-a7dd-4407985e2c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:17.245514 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a92e4f-3564-479c-a7dd-4407985e2c85 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:17.245791 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a92e4f-3564-479c-a7dd-4407985e2c85 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:17.246253 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a92e4f-3564-479c-a7dd-4407985e2c85 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:17.256089 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a92e4f-3564-479c-a7dd-4407985e2c85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 10:11:17.261157 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-34a92e4f-3564-479c-a7dd-4407985e2c85 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 10:11:17.261157 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:17.261157 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:17.261157 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:17.261157 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:17.261157 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:17.261157 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:17.261157 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:17.261157 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:17.261157 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:17.261157 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:17.261157 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:17.261157 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 10:11:17.261157 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 10:11:17.261157 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 10:11:17.261157 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 10:11:17.262794 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 10:11:17.262794 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 10:11:17.262794 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 10:11:17.262794 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 10:11:17.262794 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:17.262794 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:17.262794 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:17.262794 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:17.262794 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:17.262794 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:17.262794 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:17.262794 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:17.262794 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:17.262794 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:17.262794 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:17.262794 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:17.263721 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:17.263721 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:17.263721 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:17.263721 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:17.263721 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 10:11:17.263721 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 10:11:17.263721 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 10:11:17.263721 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 10:11:17.263721 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 10:11:17.263721 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 10:11:17.263721 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 10:11:17.263721 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:17.263721 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 287/572] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Aug 9 10:11:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:17.263721 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a92e4f-3564-479c-a7dd-4407985e2c85 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:17.288183 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a633b10-64eb-4960-bb02-ae53914f32af None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:17.321959 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f57392a-4f49-41b5-b43a-c4d81587cedb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:17.322492 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f57392a-4f49-41b5-b43a-c4d81587cedb None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:17.322770 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f57392a-4f49-41b5-b43a-c4d81587cedb None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:17.323042 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f57392a-4f49-41b5-b43a-c4d81587cedb None admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:17.323677 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f57392a-4f49-41b5-b43a-c4d81587cedb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:17.323979 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f57392a-4f49-41b5-b43a-c4d81587cedb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:17.325916 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f57392a-4f49-41b5-b43a-c4d81587cedb None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:17.329469 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:17.337230 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 286/573] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Aug 9 10:11:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:17.338117 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f57392a-4f49-41b5-b43a-c4d81587cedb None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:17.366922 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a92e4f-3564-479c-a7dd-4407985e2c85 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:17.368182 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:17.401372 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5bedef-64e0-49e1-b297-acc3249f937d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:17.402047 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5bedef-64e0-49e1-b297-acc3249f937d None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:17.402330 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5bedef-64e0-49e1-b297-acc3249f937d None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:17.402610 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5bedef-64e0-49e1-b297-acc3249f937d None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:17.403355 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5bedef-64e0-49e1-b297-acc3249f937d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:17.403658 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5bedef-64e0-49e1-b297-acc3249f937d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:17.405039 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5bedef-64e0-49e1-b297-acc3249f937d None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:17.417033 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 288/574] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Aug 9 10:11:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:17.418353 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5bedef-64e0-49e1-b297-acc3249f937d None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:17.439964 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f57392a-4f49-41b5-b43a-c4d81587cedb None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:17.473427 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e04f7c6-902f-4dc4-af27-511e7f460d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:17.474157 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e04f7c6-902f-4dc4-af27-511e7f460d39 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:17.474511 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e04f7c6-902f-4dc4-af27-511e7f460d39 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:17.474789 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e04f7c6-902f-4dc4-af27-511e7f460d39 None admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:17.475479 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e04f7c6-902f-4dc4-af27-511e7f460d39 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:17.475785 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e04f7c6-902f-4dc4-af27-511e7f460d39 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:17.477210 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e04f7c6-902f-4dc4-af27-511e7f460d39 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:17.495202 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 287/575] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Aug 9 10:11:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:17.496042 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e04f7c6-902f-4dc4-af27-511e7f460d39 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:17.518492 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5bedef-64e0-49e1-b297-acc3249f937d None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:17.545645 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:17.554021 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85ae0c6-6155-4993-b419-07ea3e0421ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:17.554646 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ae0c6-6155-4993-b419-07ea3e0421ff None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:17.554927 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ae0c6-6155-4993-b419-07ea3e0421ff None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:17.555200 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ae0c6-6155-4993-b419-07ea3e0421ff None admin] PATH_INFO: `/v3/roles/service` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:17.565578 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85ae0c6-6155-4993-b419-07ea3e0421ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 10:11:17.570350 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-b85ae0c6-6155-4993-b419-07ea3e0421ff None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 10:11:17.570350 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:17.570350 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:17.570350 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:17.570350 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:17.570350 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:17.570350 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:17.570350 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:17.570350 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:17.570350 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:17.570350 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:17.570350 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:17.570350 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 10:11:17.570350 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 10:11:17.570350 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 10:11:17.570350 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 10:11:17.571455 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 10:11:17.571455 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 10:11:17.571455 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 10:11:17.571455 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 10:11:17.571455 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:17.571455 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:17.571455 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:17.571455 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:17.571455 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:17.571455 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:17.571455 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:17.571455 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:17.571455 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:17.571455 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:17.571455 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:17.571455 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:17.572516 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:17.572516 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:17.572516 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:17.572516 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:17.572516 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 10:11:17.572516 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 10:11:17.572516 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 10:11:17.572516 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 10:11:17.572516 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 10:11:17.572516 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 10:11:17.572516 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 10:11:17.572516 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:17.572516 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 289/576] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Aug 9 10:11:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:17.573371 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85ae0c6-6155-4993-b419-07ea3e0421ff None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:17.594427 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:17.603879 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e04f7c6-902f-4dc4-af27-511e7f460d39 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:17.638043 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b487377-46af-4d90-9868-7c874422765c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:17.638641 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b487377-46af-4d90-9868-7c874422765c None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:17.638921 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b487377-46af-4d90-9868-7c874422765c None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:17.639198 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b487377-46af-4d90-9868-7c874422765c None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:17.639853 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b487377-46af-4d90-9868-7c874422765c None admin] RBAC: Adding query filter params (name=service) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:17.640153 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b487377-46af-4d90-9868-7c874422765c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:17.641520 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b487377-46af-4d90-9868-7c874422765c None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:17.649210 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 288/577] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Aug 9 10:11:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:17.650003 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b487377-46af-4d90-9868-7c874422765c None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:17.673704 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85ae0c6-6155-4993-b419-07ea3e0421ff None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:17.710618 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf00157-c116-4ae8-baba-c30fdd6bcfd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:17.711647 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf00157-c116-4ae8-baba-c30fdd6bcfd1 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:17.712132 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf00157-c116-4ae8-baba-c30fdd6bcfd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:17.712524 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf00157-c116-4ae8-baba-c30fdd6bcfd1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:17.720998 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf00157-c116-4ae8-baba-c30fdd6bcfd1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:17.722514 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf00157-c116-4ae8-baba-c30fdd6bcfd1 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:17.734299 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-fdf00157-c116-4ae8-baba-c30fdd6bcfd1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 10:11:17.734299 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:17.734299 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:17.734299 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:17.734299 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:17.734299 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:17.734299 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:17.734299 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:17.734299 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:17.734299 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:17.734299 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:17.734299 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:17.734299 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 10:11:17.734299 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 10:11:17.734299 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 10:11:17.735222 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 10:11:17.735222 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:17.735222 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:17.735222 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:17.735222 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:17.735222 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:17.735222 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:17.735222 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:17.735222 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:17.735222 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:17.735222 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:17.735222 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:17.735222 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:17.735222 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:17.735222 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:17.735222 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:17.735222 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:17.736098 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 10:11:17.736098 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 10:11:17.736098 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 10:11:17.736098 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 10:11:17.736098 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 10:11:17.736098 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 10:11:17.736098 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 10:11:17.736098 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:17.736098 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 290/578] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Aug 9 10:11:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:17.736574 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf00157-c116-4ae8-baba-c30fdd6bcfd1 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:17.751469 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b487377-46af-4d90-9868-7c874422765c None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:17.788971 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:17.789654 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb7040-bd7a-4394-9913-141b74696151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:17.790631 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb7040-bd7a-4394-9913-141b74696151 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:17.790970 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb7040-bd7a-4394-9913-141b74696151 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:17.791127 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb7040-bd7a-4394-9913-141b74696151 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:17.798788 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efb7040-bd7a-4394-9913-141b74696151 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:17.800235 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efb7040-bd7a-4394-9913-141b74696151 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:17.812592 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-6efb7040-bd7a-4394-9913-141b74696151 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 09 10:11:17.812592 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:17.812592 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:17.812592 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:17.812592 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:17.812592 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:17.812592 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:17.812592 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:17.812592 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:17.812592 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:17.812592 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:17.812592 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:17.812592 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 10:11:17.812592 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 10:11:17.812592 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 10:11:17.812592 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 10:11:17.813557 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:17.813557 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:17.813557 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 10:11:17.813557 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 10:11:17.813557 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 10:11:17.813557 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 10:11:17.813557 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:17.813557 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:17.813557 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:17.813557 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:17.813557 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:17.813557 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:17.813557 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:17.813557 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:17.813557 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:17.813557 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:17.813557 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:17.813557 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:17.814738 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:17.814738 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:17.814738 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 10:11:17.814738 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 10:11:17.814738 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 10:11:17.814738 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 10:11:17.814738 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 10:11:17.814738 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 10:11:17.814738 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 09 10:11:17.814738 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:11:17.814738 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 289/579] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Aug 9 10:11:17 2022] GET /identity/v3/users/cinder => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:17.814738 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb7040-bd7a-4394-9913-141b74696151 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:17.832662 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:17.846112 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf00157-c116-4ae8-baba-c30fdd6bcfd1 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:17.879462 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdd3c37-d403-492e-a6e7-f648389ea105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:17.880055 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd3c37-d403-492e-a6e7-f648389ea105 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:17.880335 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd3c37-d403-492e-a6e7-f648389ea105 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:17.880607 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd3c37-d403-492e-a6e7-f648389ea105 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:17.881321 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdd3c37-d403-492e-a6e7-f648389ea105 None admin] RBAC: Adding query filter params (role.id=1252647548644b48900ef09f1df438fd, scope.project.id=28891cf6239a43469326a864fb0d216c, user.id=841c5dbaae774944b637c533ebd75b29) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:17.881628 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdd3c37-d403-492e-a6e7-f648389ea105 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:17.883079 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdd3c37-d403-492e-a6e7-f648389ea105 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:17.888763 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 291/580] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Aug 9 10:11:17 2022] GET /identity/v3/role_assignments?user.id=841c5dbaae774944b637c533ebd75b29&scope.project.id=28891cf6239a43469326a864fb0d216c&role.id=1252647548644b48900ef09f1df438fd => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:17.889530 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdd3c37-d403-492e-a6e7-f648389ea105 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:17.927091 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb7040-bd7a-4394-9913-141b74696151 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:17.970965 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1289e2a-8fdb-48fa-b4cd-5aff7e1a1a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:17.971585 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1289e2a-8fdb-48fa-b4cd-5aff7e1a1a74 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:17.971959 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1289e2a-8fdb-48fa-b4cd-5aff7e1a1a74 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:17.972241 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1289e2a-8fdb-48fa-b4cd-5aff7e1a1a74 None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:17.972927 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1289e2a-8fdb-48fa-b4cd-5aff7e1a1a74 None admin] RBAC: Adding query filter params (name=service) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:17.973236 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1289e2a-8fdb-48fa-b4cd-5aff7e1a1a74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:17.974690 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1289e2a-8fdb-48fa-b4cd-5aff7e1a1a74 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:17.984967 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 290/581] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Aug 9 10:11:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:17.985936 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1289e2a-8fdb-48fa-b4cd-5aff7e1a1a74 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:18.017378 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdd3c37-d403-492e-a6e7-f648389ea105 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:18.032498 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:18.059960 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920a66a3-36d3-494f-8d88-3d3a15ad82a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:18.060696 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920a66a3-36d3-494f-8d88-3d3a15ad82a2 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:18.060984 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920a66a3-36d3-494f-8d88-3d3a15ad82a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:18.061252 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920a66a3-36d3-494f-8d88-3d3a15ad82a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:18.072059 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920a66a3-36d3-494f-8d88-3d3a15ad82a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:18.073508 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920a66a3-36d3-494f-8d88-3d3a15ad82a2 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:18.078873 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:18.088625 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-920a66a3-36d3-494f-8d88-3d3a15ad82a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:18.088625 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:18.088625 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:18.088625 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:18.088625 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:18.088625 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:18.088625 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:18.088625 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:18.088625 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:18.088625 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:18.088625 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:18.088625 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:18.088625 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 10:11:18.088625 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 10:11:18.088625 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 10:11:18.088625 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 10:11:18.090298 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:18.090298 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:18.090298 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:18.090298 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:18.090298 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:18.090298 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:18.090298 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:18.090298 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:18.090298 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:18.090298 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:18.090298 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:18.090298 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:18.090298 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:18.090298 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:18.090298 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:18.090298 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:18.090298 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 10:11:18.092204 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 10:11:18.092204 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:18.092204 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:18.095228 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 292/582] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:11:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:18.095862 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920a66a3-36d3-494f-8d88-3d3a15ad82a2 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:18.106973 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1289e2a-8fdb-48fa-b4cd-5aff7e1a1a74 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:18.148780 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5acedd-bbd0-4692-b707-2e287b75960c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:18.149391 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5acedd-bbd0-4692-b707-2e287b75960c None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:18.149953 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5acedd-bbd0-4692-b707-2e287b75960c None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:18.150235 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5acedd-bbd0-4692-b707-2e287b75960c None admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:18.151315 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5acedd-bbd0-4692-b707-2e287b75960c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:18.151627 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5acedd-bbd0-4692-b707-2e287b75960c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:18.153612 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5acedd-bbd0-4692-b707-2e287b75960c None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:18.175319 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 291/583] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Aug 9 10:11:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:18.175319 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5acedd-bbd0-4692-b707-2e287b75960c None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:18.206300 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920a66a3-36d3-494f-8d88-3d3a15ad82a2 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:18.243955 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353c510c-f374-44b5-973a-ce3795719a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:18.244552 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353c510c-f374-44b5-973a-ce3795719a0c None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:18.244830 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353c510c-f374-44b5-973a-ce3795719a0c None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:18.245096 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353c510c-f374-44b5-973a-ce3795719a0c None admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:18.245818 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353c510c-f374-44b5-973a-ce3795719a0c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:18.246794 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353c510c-f374-44b5-973a-ce3795719a0c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:18.248124 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353c510c-f374-44b5-973a-ce3795719a0c None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:18.266851 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 293/584] 10.222.0.36 () {56 vars in 1137 bytes} [Tue Aug 9 10:11:18 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:18.267618 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353c510c-f374-44b5-973a-ce3795719a0c None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:18.291165 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5acedd-bbd0-4692-b707-2e287b75960c None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:18.294635 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:18.329153 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a147b2-f648-436b-aef7-7d153e0afa98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:18.329756 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a147b2-f648-436b-aef7-7d153e0afa98 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:18.330057 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a147b2-f648-436b-aef7-7d153e0afa98 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:18.330322 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a147b2-f648-436b-aef7-7d153e0afa98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:18.333504 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:18.342510 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a147b2-f648-436b-aef7-7d153e0afa98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:18.345195 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a147b2-f648-436b-aef7-7d153e0afa98 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:18.364114 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-87a147b2-f648-436b-aef7-7d153e0afa98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:18.364114 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:18.364114 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:18.364114 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:18.364114 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:18.364114 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:18.364114 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:18.364114 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:18.364114 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:18.364114 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:18.364114 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:18.364114 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:18.364114 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 10:11:18.364114 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 10:11:18.364114 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 10:11:18.364114 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 10:11:18.365266 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:18.365266 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:18.365266 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:18.365266 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:18.365266 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:18.365266 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:18.365266 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:18.365266 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:18.365266 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:18.365266 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:18.365266 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:18.365266 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:18.365266 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:18.365266 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:18.365266 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:18.365266 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:18.365266 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 10:11:18.366393 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 10:11:18.366393 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:18.366393 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:11:18.368988 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 292/585] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:11:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:18.369797 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a147b2-f648-436b-aef7-7d153e0afa98 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:18.382071 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353c510c-f374-44b5-973a-ce3795719a0c None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:18.417312 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95358e0e-c3a5-4a88-8c9e-9ec70761f238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:18.418609 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95358e0e-c3a5-4a88-8c9e-9ec70761f238 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:18.419008 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95358e0e-c3a5-4a88-8c9e-9ec70761f238 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:18.419365 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95358e0e-c3a5-4a88-8c9e-9ec70761f238 None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:18.420103 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95358e0e-c3a5-4a88-8c9e-9ec70761f238 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:18.420497 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95358e0e-c3a5-4a88-8c9e-9ec70761f238 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:18.421990 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95358e0e-c3a5-4a88-8c9e-9ec70761f238 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:18.434037 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 294/586] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Aug 9 10:11:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:18.435329 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95358e0e-c3a5-4a88-8c9e-9ec70761f238 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:18.489917 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a147b2-f648-436b-aef7-7d153e0afa98 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:18.522236 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:18.526256 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cac658-c32f-45cc-adbf-d5854faa293e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:18.527214 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cac658-c32f-45cc-adbf-d5854faa293e None admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:18.527495 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cac658-c32f-45cc-adbf-d5854faa293e None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:18.527765 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cac658-c32f-45cc-adbf-d5854faa293e None admin] PATH_INFO: `/v3/projects/28891cf6239a43469326a864fb0d216c/users/eb863beaaa9f495c8b64655996c061f2/roles/1252647548644b48900ef09f1df438fd` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:18.542185 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95358e0e-c3a5-4a88-8c9e-9ec70761f238 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:18.543329 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cac658-c32f-45cc-adbf-d5854faa293e None admin] RBAC: Authorizing `identity:create_grant(project_id=28891cf6239a43469326a864fb0d216c, user_id=eb863beaaa9f495c8b64655996c061f2, role_id=1252647548644b48900ef09f1df438fd)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:18.544890 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cac658-c32f-45cc-adbf-d5854faa293e None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:18.557274 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 293/587] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Aug 9 10:11:18 2022] PUT /identity/v3/projects/28891cf6239a43469326a864fb0d216c/users/eb863beaaa9f495c8b64655996c061f2/roles/1252647548644b48900ef09f1df438fd => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:11:18.558133 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cac658-c32f-45cc-adbf-d5854faa293e None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:18.592166 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58388df3-fa94-4a91-9dbe-7e509f699164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:18.593158 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58388df3-fa94-4a91-9dbe-7e509f699164 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:18.593702 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58388df3-fa94-4a91-9dbe-7e509f699164 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:18.594138 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58388df3-fa94-4a91-9dbe-7e509f699164 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:18.607183 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58388df3-fa94-4a91-9dbe-7e509f699164 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:18.608912 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58388df3-fa94-4a91-9dbe-7e509f699164 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:18.612993 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:18.634204 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-58388df3-fa94-4a91-9dbe-7e509f699164 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:18.634204 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:18.634204 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:18.634204 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:18.634204 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:18.634204 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:18.634204 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:18.634204 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:18.634204 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:18.634204 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:18.634204 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:18.634204 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:18.634204 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 10:11:18.634204 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 10:11:18.634204 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 10:11:18.634204 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 10:11:18.635419 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:18.635419 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:18.635419 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:18.635419 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:18.635419 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:18.635419 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:18.635419 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:18.635419 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:18.635419 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:18.635419 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:18.635419 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:18.635419 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:18.635419 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:18.635419 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:18.635419 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:18.635419 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:18.635419 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 10:11:18.636692 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 10:11:18.636692 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:18.636692 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:18.644561 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 295/588] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:11:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:18.644561 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58388df3-fa94-4a91-9dbe-7e509f699164 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:18.697972 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cac658-c32f-45cc-adbf-d5854faa293e None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:18.748979 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e17850-4cec-47a8-8fcd-054cb7f38f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:18.749907 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e17850-4cec-47a8-8fcd-054cb7f38f42 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:18.749907 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e17850-4cec-47a8-8fcd-054cb7f38f42 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:18.750184 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e17850-4cec-47a8-8fcd-054cb7f38f42 None admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:18.751114 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e17850-4cec-47a8-8fcd-054cb7f38f42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:18.751114 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e17850-4cec-47a8-8fcd-054cb7f38f42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:18.752397 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e17850-4cec-47a8-8fcd-054cb7f38f42 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:18.764929 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 294/589] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Aug 9 10:11:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:18.765771 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e17850-4cec-47a8-8fcd-054cb7f38f42 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:18.789237 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58388df3-fa94-4a91-9dbe-7e509f699164 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:18.836286 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8f3a10-e2f0-4291-a94b-6469cb6325c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:18.837446 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f3a10-e2f0-4291-a94b-6469cb6325c6 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:18.837743 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f3a10-e2f0-4291-a94b-6469cb6325c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:18.838034 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f3a10-e2f0-4291-a94b-6469cb6325c6 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:18.841024 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:18.850120 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8f3a10-e2f0-4291-a94b-6469cb6325c6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:18.851491 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8f3a10-e2f0-4291-a94b-6469cb6325c6 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:18.866117 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-7a8f3a10-e2f0-4291-a94b-6469cb6325c6 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 09 10:11:18.866117 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:18.866117 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:18.866117 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:18.866117 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:18.866117 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:18.866117 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:18.866117 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:18.866117 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:18.866117 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:18.866117 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:18.866117 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:18.866117 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 10:11:18.866117 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 10:11:18.866117 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 10:11:18.866117 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 10:11:18.867291 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:18.867291 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:18.867291 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 10:11:18.867291 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 10:11:18.867291 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 10:11:18.867291 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 10:11:18.867291 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:18.867291 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:18.867291 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:18.867291 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:18.867291 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:18.867291 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:18.867291 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:18.867291 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:18.867291 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:18.867291 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:18.867291 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:18.867291 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:18.868438 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:18.868438 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:18.868438 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 10:11:18.868438 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 10:11:18.868438 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 10:11:18.868438 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 10:11:18.868438 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 10:11:18.868438 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 10:11:18.868438 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 09 10:11:18.868438 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:18.868438 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 296/590] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Aug 9 10:11:18 2022] GET /identity/v3/users/glance => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:18.868438 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8f3a10-e2f0-4291-a94b-6469cb6325c6 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:18.883650 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:18.889962 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e17850-4cec-47a8-8fcd-054cb7f38f42 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:18.929597 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82333fe7-b01f-45b9-af15-32f3bd601413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:18.930228 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82333fe7-b01f-45b9-af15-32f3bd601413 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:18.930502 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82333fe7-b01f-45b9-af15-32f3bd601413 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:18.930775 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82333fe7-b01f-45b9-af15-32f3bd601413 None admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:18.931928 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82333fe7-b01f-45b9-af15-32f3bd601413 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:18.932373 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82333fe7-b01f-45b9-af15-32f3bd601413 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:18.934191 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82333fe7-b01f-45b9-af15-32f3bd601413 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:18.954053 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 295/591] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Aug 9 10:11:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:18.957565 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82333fe7-b01f-45b9-af15-32f3bd601413 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:19.008488 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8f3a10-e2f0-4291-a94b-6469cb6325c6 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:19.058572 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43444e85-bdec-44b2-8652-f4970ec38226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:19.059838 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43444e85-bdec-44b2-8652-f4970ec38226 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:19.060365 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43444e85-bdec-44b2-8652-f4970ec38226 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:19.060642 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43444e85-bdec-44b2-8652-f4970ec38226 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:19.068426 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82333fe7-b01f-45b9-af15-32f3bd601413 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:19.070603 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43444e85-bdec-44b2-8652-f4970ec38226 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:19.072987 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43444e85-bdec-44b2-8652-f4970ec38226 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:19.088774 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-43444e85-bdec-44b2-8652-f4970ec38226 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 09 10:11:19.088774 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:19.088774 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:19.088774 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:19.088774 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:19.088774 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:19.088774 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:19.088774 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:19.088774 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:19.088774 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:19.088774 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:19.088774 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:19.088774 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 10:11:19.088774 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 10:11:19.088774 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 10:11:19.088774 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 10:11:19.089870 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:19.089870 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:19.089870 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 10:11:19.089870 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 10:11:19.089870 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 10:11:19.089870 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 10:11:19.089870 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:19.089870 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:19.089870 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:19.089870 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:19.089870 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:19.089870 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:19.089870 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:19.089870 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:19.089870 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:19.089870 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:19.089870 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:19.089870 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:19.090813 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:19.090813 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:19.090813 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 10:11:19.090813 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 10:11:19.090813 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 10:11:19.090813 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 10:11:19.090813 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 10:11:19.090813 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 10:11:19.090813 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 09 10:11:19.090813 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:19.090813 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 297/592] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Aug 9 10:11:18 2022] GET /identity/v3/users/neutron => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:19.091411 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43444e85-bdec-44b2-8652-f4970ec38226 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:19.108727 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a02d3f2-eec7-40bb-9362-a870c50ee224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:19.109350 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a02d3f2-eec7-40bb-9362-a870c50ee224 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:19.109586 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a02d3f2-eec7-40bb-9362-a870c50ee224 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:19.109872 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a02d3f2-eec7-40bb-9362-a870c50ee224 None admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:19.110623 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a02d3f2-eec7-40bb-9362-a870c50ee224 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:19.110931 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a02d3f2-eec7-40bb-9362-a870c50ee224 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:19.112399 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a02d3f2-eec7-40bb-9362-a870c50ee224 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:19.131114 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 296/593] 10.222.0.36 () {56 vars in 1137 bytes} [Tue Aug 9 10:11:18 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:19.132075 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a02d3f2-eec7-40bb-9362-a870c50ee224 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:19.151469 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:19.167363 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:19.216087 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43444e85-bdec-44b2-8652-f4970ec38226 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:19.251018 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d886e6cf-4f75-40e9-a9e5-f6c5feb552e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:19.251641 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d886e6cf-4f75-40e9-a9e5-f6c5feb552e3 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:19.251920 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d886e6cf-4f75-40e9-a9e5-f6c5feb552e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:19.252194 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d886e6cf-4f75-40e9-a9e5-f6c5feb552e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:19.259161 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d886e6cf-4f75-40e9-a9e5-f6c5feb552e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:19.260700 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d886e6cf-4f75-40e9-a9e5-f6c5feb552e3 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:19.263661 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a02d3f2-eec7-40bb-9362-a870c50ee224 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:19.272873 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-d886e6cf-4f75-40e9-a9e5-f6c5feb552e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 10:11:19.272873 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:19.272873 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:19.272873 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:19.272873 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:19.272873 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:19.272873 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:19.272873 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:19.272873 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:19.272873 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:19.272873 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:19.272873 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:19.272873 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 10:11:19.272873 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 10:11:19.272873 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 10:11:19.273989 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 10:11:19.273989 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:19.273989 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:19.273989 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:19.273989 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:19.273989 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:19.273989 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:19.273989 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:19.273989 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:19.273989 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:19.273989 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:19.273989 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:19.273989 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:19.273989 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:19.273989 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:19.273989 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:19.273989 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:19.274958 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 10:11:19.274958 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 10:11:19.274958 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 10:11:19.274958 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 10:11:19.274958 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 10:11:19.274958 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 10:11:19.274958 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 10:11:19.274958 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:19.279062 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 298/594] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Aug 9 10:11:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:19.279855 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d886e6cf-4f75-40e9-a9e5-f6c5feb552e3 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:19.309226 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090a7e3b-55d9-4b1f-9c1c-4dc22d44321c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:19.310724 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a7e3b-55d9-4b1f-9c1c-4dc22d44321c None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:19.311153 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a7e3b-55d9-4b1f-9c1c-4dc22d44321c None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:19.311831 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a7e3b-55d9-4b1f-9c1c-4dc22d44321c None admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:19.312735 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090a7e3b-55d9-4b1f-9c1c-4dc22d44321c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:19.313410 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090a7e3b-55d9-4b1f-9c1c-4dc22d44321c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:19.315229 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090a7e3b-55d9-4b1f-9c1c-4dc22d44321c None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:19.334467 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 297/595] 10.222.0.36 () {56 vars in 1139 bytes} [Tue Aug 9 10:11:19 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:19.335335 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090a7e3b-55d9-4b1f-9c1c-4dc22d44321c None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:19.399560 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d886e6cf-4f75-40e9-a9e5-f6c5feb552e3 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:19.414835 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:19.429210 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:19.443892 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf91615b-ce91-44b3-970a-11aa41291cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:19.444511 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf91615b-ce91-44b3-970a-11aa41291cf1 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:19.444783 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf91615b-ce91-44b3-970a-11aa41291cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:19.445047 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf91615b-ce91-44b3-970a-11aa41291cf1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:19.460189 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf91615b-ce91-44b3-970a-11aa41291cf1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:19.461640 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf91615b-ce91-44b3-970a-11aa41291cf1 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:19.470715 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090a7e3b-55d9-4b1f-9c1c-4dc22d44321c None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:19.476099 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-cf91615b-ce91-44b3-970a-11aa41291cf1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:19.476099 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:19.476099 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:19.476099 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:19.476099 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:19.476099 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:19.476099 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:19.476099 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:19.476099 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:19.476099 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:19.476099 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:19.476099 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:19.476099 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 10:11:19.476099 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 10:11:19.476099 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 10:11:19.476099 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 10:11:19.477041 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:19.477041 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:19.477041 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:19.477041 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:19.477041 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:19.477041 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:19.477041 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:19.477041 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:19.477041 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:19.477041 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:19.477041 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:19.477041 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:19.477041 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:19.477041 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:19.477041 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:19.477041 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:19.477041 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 10:11:19.477948 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 10:11:19.477948 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:19.477948 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:19.477948 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 299/596] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:11:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:19.478664 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf91615b-ce91-44b3-970a-11aa41291cf1 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:19.512253 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1735e8dc-833b-49e6-9a3c-7eca75c3ef38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:19.513435 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1735e8dc-833b-49e6-9a3c-7eca75c3ef38 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:19.513974 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1735e8dc-833b-49e6-9a3c-7eca75c3ef38 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:19.514452 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1735e8dc-833b-49e6-9a3c-7eca75c3ef38 None admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:19.515401 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1735e8dc-833b-49e6-9a3c-7eca75c3ef38 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:19.515912 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1735e8dc-833b-49e6-9a3c-7eca75c3ef38 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:19.517728 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1735e8dc-833b-49e6-9a3c-7eca75c3ef38 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:19.537286 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 298/597] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Aug 9 10:11:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:19.538471 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1735e8dc-833b-49e6-9a3c-7eca75c3ef38 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:19.579361 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf91615b-ce91-44b3-970a-11aa41291cf1 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:19.613055 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef15578-2abc-4854-9b14-07b471c71032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:19.613677 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef15578-2abc-4854-9b14-07b471c71032 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:19.613981 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef15578-2abc-4854-9b14-07b471c71032 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:19.614247 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef15578-2abc-4854-9b14-07b471c71032 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:19.625009 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef15578-2abc-4854-9b14-07b471c71032 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:19.626525 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef15578-2abc-4854-9b14-07b471c71032 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:19.641559 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-9ef15578-2abc-4854-9b14-07b471c71032 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:19.641559 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:19.641559 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:19.641559 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:19.641559 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:19.641559 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:19.641559 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:19.641559 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:19.641559 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:19.641559 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:19.641559 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:19.641559 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:19.641559 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 10:11:19.641559 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 10:11:19.641559 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 10:11:19.641559 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 10:11:19.642567 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:19.642567 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:19.642567 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:19.642567 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:19.642567 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:19.642567 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:19.642567 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:19.642567 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:19.642567 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:19.642567 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:19.642567 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:19.642567 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:19.642567 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:19.642567 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:19.642567 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:19.642567 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:19.642567 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 10:11:19.643534 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 10:11:19.643534 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:19.643534 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:19.643534 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 300/598] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:11:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:19.643756 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef15578-2abc-4854-9b14-07b471c71032 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:19.658433 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1735e8dc-833b-49e6-9a3c-7eca75c3ef38 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:19.663087 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:19.700591 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f64009-d6be-4bee-a9df-b433a5a56f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:19.701513 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f64009-d6be-4bee-a9df-b433a5a56f7b None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:19.701981 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f64009-d6be-4bee-a9df-b433a5a56f7b None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:19.702374 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f64009-d6be-4bee-a9df-b433a5a56f7b None admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:19.703122 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f64009-d6be-4bee-a9df-b433a5a56f7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:19.703525 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f64009-d6be-4bee-a9df-b433a5a56f7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:19.705191 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f64009-d6be-4bee-a9df-b433a5a56f7b None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:19.706856 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:19.724826 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 299/599] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Aug 9 10:11:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:19.726241 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f64009-d6be-4bee-a9df-b433a5a56f7b None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:19.762930 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef15578-2abc-4854-9b14-07b471c71032 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:19.798572 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9985552-54ab-4244-865a-78d0d61c7843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:19.799386 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9985552-54ab-4244-865a-78d0d61c7843 None admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:19.799681 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9985552-54ab-4244-865a-78d0d61c7843 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:19.800024 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9985552-54ab-4244-865a-78d0d61c7843 None admin] PATH_INFO: `/v3/projects/28891cf6239a43469326a864fb0d216c/users/1f6c687a38524de0bf23d87ae91d3b0f/roles/1252647548644b48900ef09f1df438fd` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:19.815838 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9985552-54ab-4244-865a-78d0d61c7843 None admin] RBAC: Authorizing `identity:create_grant(project_id=28891cf6239a43469326a864fb0d216c, user_id=1f6c687a38524de0bf23d87ae91d3b0f, role_id=1252647548644b48900ef09f1df438fd)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:19.817339 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9985552-54ab-4244-865a-78d0d61c7843 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:19.835164 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 301/600] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Aug 9 10:11:19 2022] PUT /identity/v3/projects/28891cf6239a43469326a864fb0d216c/users/1f6c687a38524de0bf23d87ae91d3b0f/roles/1252647548644b48900ef09f1df438fd => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:11:19.836049 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9985552-54ab-4244-865a-78d0d61c7843 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:19.836269 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f64009-d6be-4bee-a9df-b433a5a56f7b None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:19.877037 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68212dc-a4a1-4cbf-ad00-d5ff357f13c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:19.877734 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68212dc-a4a1-4cbf-ad00-d5ff357f13c7 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:19.878170 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68212dc-a4a1-4cbf-ad00-d5ff357f13c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:19.878445 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68212dc-a4a1-4cbf-ad00-d5ff357f13c7 None admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:19.879188 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68212dc-a4a1-4cbf-ad00-d5ff357f13c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:19.879492 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68212dc-a4a1-4cbf-ad00-d5ff357f13c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:19.880905 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68212dc-a4a1-4cbf-ad00-d5ff357f13c7 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:19.896019 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 300/601] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Aug 9 10:11:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:19.901819 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68212dc-a4a1-4cbf-ad00-d5ff357f13c7 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:19.925570 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:19.971989 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9985552-54ab-4244-865a-78d0d61c7843 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:19.974916 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:20.014762 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff4c7ed-4732-4cf7-aa5d-c2af8870c215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:20.015436 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff4c7ed-4732-4cf7-aa5d-c2af8870c215 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:20.015707 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff4c7ed-4732-4cf7-aa5d-c2af8870c215 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:20.015970 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff4c7ed-4732-4cf7-aa5d-c2af8870c215 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:20.023566 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff4c7ed-4732-4cf7-aa5d-c2af8870c215 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:20.025030 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff4c7ed-4732-4cf7-aa5d-c2af8870c215 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:20.039130 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-cff4c7ed-4732-4cf7-aa5d-c2af8870c215 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 10:11:20.039130 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:20.039130 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:20.039130 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:20.039130 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:20.039130 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:20.039130 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:20.039130 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:20.039130 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:20.039130 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:20.039130 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:20.039130 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:20.039130 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 10:11:20.039130 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 10:11:20.039130 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 10:11:20.040097 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 10:11:20.040097 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:20.040097 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:20.040097 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:20.040097 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:20.040097 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:20.040097 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:20.040097 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:20.040097 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:20.040097 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:20.040097 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:20.040097 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:20.040097 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:20.040097 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:20.040097 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:20.040097 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:20.040097 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:20.041238 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 10:11:20.041238 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 10:11:20.041238 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 10:11:20.041238 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 10:11:20.041238 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 10:11:20.041238 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 10:11:20.041238 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 10:11:20.041238 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:20.041663 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68212dc-a4a1-4cbf-ad00-d5ff357f13c7 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:20.045450 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 302/602] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Aug 9 10:11:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:20.046890 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d0db0c-d7a0-4769-8690-2649915f994a None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:20.047169 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d0db0c-d7a0-4769-8690-2649915f994a None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:20.047440 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d0db0c-d7a0-4769-8690-2649915f994a None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:20.049131 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 303/603] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:11:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:11:20.049886 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d0db0c-d7a0-4769-8690-2649915f994a None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:20.083336 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024a0561-fb54-46b2-bc23-e458f6b1273e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:20.084448 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a0561-fb54-46b2-bc23-e458f6b1273e None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:20.084932 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a0561-fb54-46b2-bc23-e458f6b1273e None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:20.085449 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a0561-fb54-46b2-bc23-e458f6b1273e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:20.098575 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024a0561-fb54-46b2-bc23-e458f6b1273e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:20.100048 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024a0561-fb54-46b2-bc23-e458f6b1273e None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:20.113515 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-024a0561-fb54-46b2-bc23-e458f6b1273e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 10:11:20.113515 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:20.113515 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:20.113515 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:20.113515 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:20.113515 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:20.113515 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:20.113515 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:20.113515 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:20.113515 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:20.113515 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:20.113515 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:20.113515 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 10:11:20.113515 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 10:11:20.113515 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 10:11:20.114973 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 10:11:20.114973 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:20.114973 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:20.114973 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:20.114973 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:20.114973 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:20.114973 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:20.114973 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:20.114973 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:20.114973 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:20.114973 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:20.114973 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:20.114973 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:20.114973 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:20.114973 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:20.114973 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:20.114973 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:20.115847 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 10:11:20.115847 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 10:11:20.115847 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 10:11:20.115847 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 10:11:20.115847 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 10:11:20.115847 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 10:11:20.115847 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 10:11:20.115847 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:11:20.115847 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 301/604] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Aug 9 10:11:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:20.116328 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8d6764-ba64-4975-acbe-6d64e1aec3d4 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:20.116403 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8d6764-ba64-4975-acbe-6d64e1aec3d4 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:20.121666 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8d6764-ba64-4975-acbe-6d64e1aec3d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:20.157511 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-6a8d6764-ba64-4975-acbe-6d64e1aec3d4 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:11:20.159542 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-6a8d6764-ba64-4975-acbe-6d64e1aec3d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:11:20.171675 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d0db0c-d7a0-4769-8690-2649915f994a None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:20.202266 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:20.211895 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230f0daf-952b-4a46-949a-8d5bc996b0c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:20.212731 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230f0daf-952b-4a46-949a-8d5bc996b0c9 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:20.213147 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230f0daf-952b-4a46-949a-8d5bc996b0c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:20.213577 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230f0daf-952b-4a46-949a-8d5bc996b0c9 None admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:20.214480 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230f0daf-952b-4a46-949a-8d5bc996b0c9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:20.215610 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230f0daf-952b-4a46-949a-8d5bc996b0c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:20.217224 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230f0daf-952b-4a46-949a-8d5bc996b0c9 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:20.229812 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 304/605] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Aug 9 10:11:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:20.231068 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230f0daf-952b-4a46-949a-8d5bc996b0c9 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:20.245544 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 302/606] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:11:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 10:11:20.247434 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8d6764-ba64-4975-acbe-6d64e1aec3d4 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:20.305371 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:20.351386 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230f0daf-952b-4a46-949a-8d5bc996b0c9 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:20.363109 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8d6764-ba64-4975-acbe-6d64e1aec3d4 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:20.387964 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5931a8-3d19-4ba0-917a-e02e8870ca17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:20.388460 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5931a8-3d19-4ba0-917a-e02e8870ca17 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:20.388740 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5931a8-3d19-4ba0-917a-e02e8870ca17 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:20.389058 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5931a8-3d19-4ba0-917a-e02e8870ca17 None admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:20.389744 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5931a8-3d19-4ba0-917a-e02e8870ca17 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:20.390074 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5931a8-3d19-4ba0-917a-e02e8870ca17 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:20.392470 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5931a8-3d19-4ba0-917a-e02e8870ca17 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:20.400484 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e2f1bf-2e6b-4696-a582-1d61a48ddf5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:20.401441 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e2f1bf-2e6b-4696-a582-1d61a48ddf5f None admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:20.401966 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e2f1bf-2e6b-4696-a582-1d61a48ddf5f None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:20.402994 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e2f1bf-2e6b-4696-a582-1d61a48ddf5f None admin] PATH_INFO: `/v3/projects/28891cf6239a43469326a864fb0d216c/users/07540b72afd34927855c41db09a7b030/roles/1252647548644b48900ef09f1df438fd` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:20.406818 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 305/607] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Aug 9 10:11:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:20.411779 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5931a8-3d19-4ba0-917a-e02e8870ca17 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:20.428219 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e2f1bf-2e6b-4696-a582-1d61a48ddf5f None admin] RBAC: Authorizing `identity:create_grant(project_id=28891cf6239a43469326a864fb0d216c, user_id=07540b72afd34927855c41db09a7b030, role_id=1252647548644b48900ef09f1df438fd)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:20.429954 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e2f1bf-2e6b-4696-a582-1d61a48ddf5f None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:20.457971 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 303/608] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Aug 9 10:11:20 2022] PUT /identity/v3/projects/28891cf6239a43469326a864fb0d216c/users/07540b72afd34927855c41db09a7b030/roles/1252647548644b48900ef09f1df438fd => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:11:20.457971 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e2f1bf-2e6b-4696-a582-1d61a48ddf5f None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:20.503801 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:20.575792 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:20.585363 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e2f1bf-2e6b-4696-a582-1d61a48ddf5f None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:20.633100 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5931a8-3d19-4ba0-917a-e02e8870ca17 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:20.675957 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcf3eef-f177-47f2-a609-e4d9ae4f46f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:20.676871 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcf3eef-f177-47f2-a609-e4d9ae4f46f2 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:20.677337 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcf3eef-f177-47f2-a609-e4d9ae4f46f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:20.677746 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcf3eef-f177-47f2-a609-e4d9ae4f46f2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:20.689642 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcf3eef-f177-47f2-a609-e4d9ae4f46f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 10:11:20.690567 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4538a2-9a9c-4a30-9818-df86fec9b878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:20.691243 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4538a2-9a9c-4a30-9818-df86fec9b878 None admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:20.691524 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4538a2-9a9c-4a30-9818-df86fec9b878 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:20.691802 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4538a2-9a9c-4a30-9818-df86fec9b878 None admin] PATH_INFO: `/v3/projects/28891cf6239a43469326a864fb0d216c/users/9169847a16764da3a2a1dbb5f5f56438/roles/1252647548644b48900ef09f1df438fd` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:20.697881 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-6dcf3eef-f177-47f2-a609-e4d9ae4f46f2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 10:11:20.697881 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:20.697881 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:20.697881 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:20.697881 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:20.697881 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:20.697881 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:20.697881 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:20.697881 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:20.697881 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:20.697881 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:20.697881 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:20.697881 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 10:11:20.697881 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 10:11:20.697881 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 10:11:20.697881 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 10:11:20.699440 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 10:11:20.699440 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 10:11:20.699440 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 10:11:20.699440 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 10:11:20.699440 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:20.699440 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:20.699440 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:20.699440 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:20.699440 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:20.699440 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:20.699440 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:20.699440 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:20.699440 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:20.699440 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:20.699440 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:20.699440 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:20.700603 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:20.700603 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:20.700603 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:20.700603 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:20.700603 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 10:11:20.700603 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 10:11:20.700603 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 10:11:20.700603 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 10:11:20.700603 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 10:11:20.700603 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 10:11:20.700603 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 10:11:20.700603 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:20.702875 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 306/609] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Aug 9 10:11:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:20.704865 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcf3eef-f177-47f2-a609-e4d9ae4f46f2 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:20.720357 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4538a2-9a9c-4a30-9818-df86fec9b878 None admin] RBAC: Authorizing `identity:create_grant(project_id=28891cf6239a43469326a864fb0d216c, user_id=9169847a16764da3a2a1dbb5f5f56438, role_id=1252647548644b48900ef09f1df438fd)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:20.721788 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4538a2-9a9c-4a30-9818-df86fec9b878 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:20.744078 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 304/610] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Aug 9 10:11:20 2022] PUT /identity/v3/projects/28891cf6239a43469326a864fb0d216c/users/9169847a16764da3a2a1dbb5f5f56438/roles/1252647548644b48900ef09f1df438fd => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:11:20.844232 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcf3eef-f177-47f2-a609-e4d9ae4f46f2 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:20.857291 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:20.882110 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87756194-e842-45dc-84fa-454ede53a83f None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:20.882437 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87756194-e842-45dc-84fa-454ede53a83f None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:20.882664 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87756194-e842-45dc-84fa-454ede53a83f None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:20.884255 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 305/611] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:11:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:11:20.893066 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0a8f2e-5b53-453d-8db5-ddc585d41144 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:20.893066 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0a8f2e-5b53-453d-8db5-ddc585d41144 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:20.893066 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0a8f2e-5b53-453d-8db5-ddc585d41144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:20.893361 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df986a8c-33bb-48a3-a6d1-b05b4bc7aa79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:20.893361 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df986a8c-33bb-48a3-a6d1-b05b4bc7aa79 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:20.893361 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df986a8c-33bb-48a3-a6d1-b05b4bc7aa79 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:20.893361 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df986a8c-33bb-48a3-a6d1-b05b4bc7aa79 None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:20.893639 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df986a8c-33bb-48a3-a6d1-b05b4bc7aa79 None admin] RBAC: Adding query filter params (name=service) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:20.893639 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df986a8c-33bb-48a3-a6d1-b05b4bc7aa79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:20.894612 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df986a8c-33bb-48a3-a6d1-b05b4bc7aa79 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:20.908226 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 307/612] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Aug 9 10:11:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:20.911518 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-2a0a8f2e-5b53-453d-8db5-ddc585d41144 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:11:20.913340 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-2a0a8f2e-5b53-453d-8db5-ddc585d41144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:11:20.913766 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df986a8c-33bb-48a3-a6d1-b05b4bc7aa79 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:21.062255 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df986a8c-33bb-48a3-a6d1-b05b4bc7aa79 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:21.064008 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 306/613] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:11:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 10:11:21.093212 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0a8f2e-5b53-453d-8db5-ddc585d41144 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:21.118936 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729c2279-7285-4096-a495-1d993f0cb140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:21.119928 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729c2279-7285-4096-a495-1d993f0cb140 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:21.120406 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729c2279-7285-4096-a495-1d993f0cb140 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:21.120878 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729c2279-7285-4096-a495-1d993f0cb140 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:21.134268 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729c2279-7285-4096-a495-1d993f0cb140 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:21.135988 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729c2279-7285-4096-a495-1d993f0cb140 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:21.150456 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-729c2279-7285-4096-a495-1d993f0cb140 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:21.150456 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:21.150456 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:21.150456 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:21.150456 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:21.150456 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:21.150456 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:21.150456 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:21.150456 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:21.150456 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:21.150456 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:21.150456 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:21.150456 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 10:11:21.150456 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 10:11:21.150456 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 10:11:21.150456 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 10:11:21.151615 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:21.151615 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:21.151615 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:21.151615 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:21.151615 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:21.151615 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:21.151615 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:21.151615 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:21.151615 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:21.151615 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:21.151615 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:21.151615 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:21.151615 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:21.151615 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:21.151615 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:21.151615 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:21.151615 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 10:11:21.152760 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 10:11:21.152760 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:21.152760 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:21.156697 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 308/614] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:11:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 10:11:21.163970 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729c2279-7285-4096-a495-1d993f0cb140 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:21.195896 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:21.214395 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:21.249814 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0a8f2e-5b53-453d-8db5-ddc585d41144 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:21.306240 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768978c8-cd8c-44ca-9b7f-f877865ed6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:21.306878 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768978c8-cd8c-44ca-9b7f-f877865ed6dc None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:21.307154 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768978c8-cd8c-44ca-9b7f-f877865ed6dc None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:21.307430 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768978c8-cd8c-44ca-9b7f-f877865ed6dc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:21.332409 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768978c8-cd8c-44ca-9b7f-f877865ed6dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 10:11:21.337352 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-768978c8-cd8c-44ca-9b7f-f877865ed6dc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 10:11:21.337352 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:21.337352 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:21.337352 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:21.337352 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:21.337352 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:21.337352 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:21.337352 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:21.337352 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:21.337352 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:21.337352 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:21.337352 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:21.337352 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 10:11:21.337352 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 10:11:21.337352 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 10:11:21.337352 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 10:11:21.338305 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 10:11:21.338305 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 10:11:21.338305 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 10:11:21.338305 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 10:11:21.338305 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:21.338305 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:21.338305 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:21.338305 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:21.338305 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:21.338305 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:21.338305 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:21.338305 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:21.338305 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:21.338305 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:21.338305 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:21.338305 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:21.339146 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:21.339146 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:21.339146 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:21.339146 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:21.339146 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 10:11:21.339146 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 10:11:21.339146 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 10:11:21.339146 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 10:11:21.339146 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 10:11:21.339146 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 10:11:21.339146 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 10:11:21.339146 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:11:21.339146 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 307/615] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Aug 9 10:11:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 10:11:21.347583 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768978c8-cd8c-44ca-9b7f-f877865ed6dc None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:21.368642 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729c2279-7285-4096-a495-1d993f0cb140 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:21.403872 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7081b898-e57c-4930-b368-deaccd8668b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:21.404890 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7081b898-e57c-4930-b368-deaccd8668b3 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:21.405373 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7081b898-e57c-4930-b368-deaccd8668b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:21.405876 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7081b898-e57c-4930-b368-deaccd8668b3 None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:21.406726 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7081b898-e57c-4930-b368-deaccd8668b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:21.407227 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7081b898-e57c-4930-b368-deaccd8668b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:21.408899 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7081b898-e57c-4930-b368-deaccd8668b3 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:21.422073 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 309/616] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Aug 9 10:11:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:21.430851 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7081b898-e57c-4930-b368-deaccd8668b3 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:21.534880 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768978c8-cd8c-44ca-9b7f-f877865ed6dc None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:21.567648 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:21.581135 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7081b898-e57c-4930-b368-deaccd8668b3 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:21.603681 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a23f96-a9ff-4600-8650-39b686c0928c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:21.604208 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a23f96-a9ff-4600-8650-39b686c0928c None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:21.604477 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a23f96-a9ff-4600-8650-39b686c0928c None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:21.604828 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a23f96-a9ff-4600-8650-39b686c0928c None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:21.605610 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a23f96-a9ff-4600-8650-39b686c0928c None admin] RBAC: Adding query filter params (name=service) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:21.605999 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a23f96-a9ff-4600-8650-39b686c0928c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:21.607677 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a23f96-a9ff-4600-8650-39b686c0928c None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:21.610154 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:21.619312 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18369ec5-8e16-4b02-9aa1-800d3f0cf386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:21.620256 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18369ec5-8e16-4b02-9aa1-800d3f0cf386 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:21.620736 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18369ec5-8e16-4b02-9aa1-800d3f0cf386 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:21.621977 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18369ec5-8e16-4b02-9aa1-800d3f0cf386 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:21.629720 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18369ec5-8e16-4b02-9aa1-800d3f0cf386 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:21.630778 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 308/617] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Aug 9 10:11:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:11:21.631885 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18369ec5-8e16-4b02-9aa1-800d3f0cf386 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:21.638821 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a23f96-a9ff-4600-8650-39b686c0928c None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:21.649211 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-18369ec5-8e16-4b02-9aa1-800d3f0cf386 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 09 10:11:21.649211 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:21.649211 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:21.649211 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:21.649211 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:21.649211 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:21.649211 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:21.649211 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:21.649211 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:21.649211 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:21.649211 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:21.649211 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:21.649211 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 10:11:21.649211 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 10:11:21.649211 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 10:11:21.649211 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 10:11:21.650167 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:21.650167 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:21.650167 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 10:11:21.650167 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 10:11:21.650167 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 10:11:21.650167 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 10:11:21.650167 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:21.650167 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:21.650167 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:21.650167 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:21.650167 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:21.650167 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:21.650167 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:21.650167 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:21.650167 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:21.650167 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:21.650167 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:21.650167 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:21.651091 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:21.651091 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:21.651091 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 10:11:21.651091 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 10:11:21.651091 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 10:11:21.651091 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 10:11:21.651091 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 10:11:21.651091 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 10:11:21.651091 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 09 10:11:21.651091 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:21.654745 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 310/618] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Aug 9 10:11:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:21.660089 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18369ec5-8e16-4b02-9aa1-800d3f0cf386 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:21.832043 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a23f96-a9ff-4600-8650-39b686c0928c None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:21.848183 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18369ec5-8e16-4b02-9aa1-800d3f0cf386 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:21.894645 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf2bd20-31dd-48ba-a714-08d5800e9f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:21.895323 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf2bd20-31dd-48ba-a714-08d5800e9f96 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:21.895627 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf2bd20-31dd-48ba-a714-08d5800e9f96 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:21.895872 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf2bd20-31dd-48ba-a714-08d5800e9f96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:21.900378 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e729c18-81a2-4f0d-bc0e-918bfad2ce18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:21.901422 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e729c18-81a2-4f0d-bc0e-918bfad2ce18 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:21.901948 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e729c18-81a2-4f0d-bc0e-918bfad2ce18 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:21.902578 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e729c18-81a2-4f0d-bc0e-918bfad2ce18 None admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:21.903543 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e729c18-81a2-4f0d-bc0e-918bfad2ce18 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:21.904086 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e729c18-81a2-4f0d-bc0e-918bfad2ce18 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:21.905785 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e729c18-81a2-4f0d-bc0e-918bfad2ce18 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:21.918924 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf2bd20-31dd-48ba-a714-08d5800e9f96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:21.920381 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf2bd20-31dd-48ba-a714-08d5800e9f96 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:21.926253 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:21.926752 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 311/619] 10.222.0.36 () {56 vars in 1135 bytes} [Tue Aug 9 10:11:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:21.931461 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e729c18-81a2-4f0d-bc0e-918bfad2ce18 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:21.962797 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-8cf2bd20-31dd-48ba-a714-08d5800e9f96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:21.962797 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:21.962797 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:21.962797 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:21.962797 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:21.962797 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:21.962797 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:21.962797 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:21.962797 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:21.962797 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:21.962797 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:21.962797 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:21.962797 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 10:11:21.962797 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 10:11:21.962797 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 10:11:21.962797 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 10:11:21.963948 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:21.963948 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:21.963948 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:21.963948 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:21.963948 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:21.963948 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:21.963948 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:21.963948 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:21.963948 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:21.963948 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:21.963948 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:21.963948 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:21.963948 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:21.963948 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:21.963948 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:21.963948 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:21.963948 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 10:11:21.964910 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 10:11:21.964910 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:21.964910 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:11:21.964910 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 309/620] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:11:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:21.972031 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf2bd20-31dd-48ba-a714-08d5800e9f96 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:22.046922 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e729c18-81a2-4f0d-bc0e-918bfad2ce18 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:22.062604 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:22.088423 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ae60ae-ecf7-494d-8b73-5002ccc21862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:22.089051 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae60ae-ecf7-494d-8b73-5002ccc21862 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:22.089332 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae60ae-ecf7-494d-8b73-5002ccc21862 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:22.089663 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae60ae-ecf7-494d-8b73-5002ccc21862 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:22.101644 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ae60ae-ecf7-494d-8b73-5002ccc21862 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:22.103539 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ae60ae-ecf7-494d-8b73-5002ccc21862 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:22.126949 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-25ae60ae-ecf7-494d-8b73-5002ccc21862 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:22.126949 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:22.126949 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:22.126949 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:22.126949 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:22.126949 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:22.126949 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:22.126949 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:22.126949 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:22.126949 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:22.126949 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:22.126949 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:22.126949 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 10:11:22.126949 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 10:11:22.126949 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 10:11:22.126949 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 10:11:22.127920 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:22.127920 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:22.127920 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:22.127920 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:22.127920 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:22.127920 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:22.127920 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:22.127920 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:22.127920 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:22.127920 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:22.127920 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:22.127920 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:22.127920 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:22.127920 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:22.127920 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:22.127920 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:22.127920 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 10:11:22.128807 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 10:11:22.128807 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:22.128807 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:22.128807 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 312/621] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:11:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 10:11:22.130436 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da84ca-71e4-4e25-8921-192f5b77da92 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:22.130436 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da84ca-71e4-4e25-8921-192f5b77da92 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:22.130436 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da84ca-71e4-4e25-8921-192f5b77da92 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:22.133920 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 313/622] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:11:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:11:22.134882 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6da84ca-71e4-4e25-8921-192f5b77da92 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:22.139935 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf2bd20-31dd-48ba-a714-08d5800e9f96 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:22.176627 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b360b182-89f0-4ae8-bb2a-d2978ee37fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:22.177155 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b360b182-89f0-4ae8-bb2a-d2978ee37fbd None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:22.177438 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b360b182-89f0-4ae8-bb2a-d2978ee37fbd None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:22.177712 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b360b182-89f0-4ae8-bb2a-d2978ee37fbd None admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:22.178381 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b360b182-89f0-4ae8-bb2a-d2978ee37fbd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:22.178683 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b360b182-89f0-4ae8-bb2a-d2978ee37fbd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:22.180043 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b360b182-89f0-4ae8-bb2a-d2978ee37fbd None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:22.197680 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 310/623] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Aug 9 10:11:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:22.197680 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2833091a-91c5-4106-8f7a-f276e758afbb None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:22.197680 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2833091a-91c5-4106-8f7a-f276e758afbb None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:22.197680 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2833091a-91c5-4106-8f7a-f276e758afbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:22.200293 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:22.216998 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-2833091a-91c5-4106-8f7a-f276e758afbb None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:11:22.218666 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-2833091a-91c5-4106-8f7a-f276e758afbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:11:22.255918 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6da84ca-71e4-4e25-8921-192f5b77da92 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:22.291125 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ecf081-06be-4ce8-ad26-cccff846cf05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:22.291868 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ecf081-06be-4ce8-ad26-cccff846cf05 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:22.292249 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ecf081-06be-4ce8-ad26-cccff846cf05 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:22.292644 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ecf081-06be-4ce8-ad26-cccff846cf05 None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:22.293459 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ecf081-06be-4ce8-ad26-cccff846cf05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:22.293891 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ecf081-06be-4ce8-ad26-cccff846cf05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:22.295363 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ecf081-06be-4ce8-ad26-cccff846cf05 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:22.301921 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 311/624] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:11:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 10:11:22.303030 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2833091a-91c5-4106-8f7a-f276e758afbb None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:22.308134 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 314/625] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Aug 9 10:11:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:22.317867 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ecf081-06be-4ce8-ad26-cccff846cf05 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:22.362700 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:22.422784 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ecf081-06be-4ce8-ad26-cccff846cf05 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:22.424696 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2833091a-91c5-4106-8f7a-f276e758afbb None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:22.446299 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:22.462519 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329af3bb-80b4-4d2d-a0fd-189b84ee2fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:22.463249 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329af3bb-80b4-4d2d-a0fd-189b84ee2fd5 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:22.463578 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329af3bb-80b4-4d2d-a0fd-189b84ee2fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:22.463935 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329af3bb-80b4-4d2d-a0fd-189b84ee2fd5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:22.466742 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f3998d-8f15-4f54-b170-169648d817f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:22.467685 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f3998d-8f15-4f54-b170-169648d817f9 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:22.468164 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f3998d-8f15-4f54-b170-169648d817f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:22.468653 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f3998d-8f15-4f54-b170-169648d817f9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:22.472075 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329af3bb-80b4-4d2d-a0fd-189b84ee2fd5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:22.473540 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329af3bb-80b4-4d2d-a0fd-189b84ee2fd5 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:22.476301 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f3998d-8f15-4f54-b170-169648d817f9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:22.477967 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f3998d-8f15-4f54-b170-169648d817f9 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:22.486807 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-329af3bb-80b4-4d2d-a0fd-189b84ee2fd5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 09 10:11:22.486807 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:22.486807 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:22.486807 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:22.486807 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:22.486807 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:22.486807 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:22.486807 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:22.486807 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:22.486807 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:22.486807 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:22.486807 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:22.486807 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 10:11:22.486807 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 10:11:22.486807 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 10:11:22.486807 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 10:11:22.487758 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:22.487758 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:22.487758 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 10:11:22.487758 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 10:11:22.487758 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 10:11:22.487758 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 10:11:22.487758 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:22.487758 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:22.487758 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:22.487758 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:22.487758 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:22.487758 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:22.487758 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:22.487758 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:22.487758 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:22.487758 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:22.487758 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:22.487758 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:22.488727 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:22.488727 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:22.488727 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 10:11:22.488727 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 10:11:22.488727 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 10:11:22.488727 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 10:11:22.488727 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 10:11:22.488727 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 10:11:22.488727 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 09 10:11:22.488727 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:11:22.492503 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 312/626] 10.222.0.36 () {56 vars in 1093 bytes} [Tue Aug 9 10:11:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:22.493182 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329af3bb-80b4-4d2d-a0fd-189b84ee2fd5 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:22.495120 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-e6f3998d-8f15-4f54-b170-169648d817f9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 10:11:22.495120 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:22.495120 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:22.495120 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:22.495120 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:22.495120 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:22.495120 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:22.495120 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:22.495120 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:22.495120 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:22.495120 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:22.495120 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:22.495120 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 10:11:22.495120 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 10:11:22.495120 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 10:11:22.496048 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 10:11:22.496048 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:22.496048 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:22.496048 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:22.496048 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:22.496048 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:22.496048 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:22.496048 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:22.496048 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:22.496048 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:22.496048 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:22.496048 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:22.496048 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:22.496048 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:22.496048 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:22.496048 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:22.496048 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:22.497219 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 10:11:22.497219 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 10:11:22.497219 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 10:11:22.497219 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 10:11:22.497219 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 10:11:22.497219 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 10:11:22.497219 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 10:11:22.497219 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:22.500616 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 315/627] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Aug 9 10:11:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:22.501618 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f3998d-8f15-4f54-b170-169648d817f9 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:22.596263 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:22.600037 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329af3bb-80b4-4d2d-a0fd-189b84ee2fd5 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:22.611417 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f3998d-8f15-4f54-b170-169648d817f9 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:22.638000 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d39e01-41cf-40d2-b687-ce0bdf671bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:22.638661 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d39e01-41cf-40d2-b687-ce0bdf671bf3 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:22.638942 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d39e01-41cf-40d2-b687-ce0bdf671bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:22.639230 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d39e01-41cf-40d2-b687-ce0bdf671bf3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:22.648516 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7183ecd-94b7-460b-bc37-b7575d97d08a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:22.649395 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7183ecd-94b7-460b-bc37-b7575d97d08a None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:22.650028 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7183ecd-94b7-460b-bc37-b7575d97d08a None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:22.650505 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7183ecd-94b7-460b-bc37-b7575d97d08a None admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:22.650610 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d39e01-41cf-40d2-b687-ce0bdf671bf3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 10:11:22.651608 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7183ecd-94b7-460b-bc37-b7575d97d08a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:22.652231 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7183ecd-94b7-460b-bc37-b7575d97d08a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:22.653917 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7183ecd-94b7-460b-bc37-b7575d97d08a None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:22.656214 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-72d39e01-41cf-40d2-b687-ce0bdf671bf3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 10:11:22.656214 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:22.656214 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:22.656214 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:22.656214 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:22.656214 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:22.656214 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:22.656214 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:22.656214 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:22.656214 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:22.656214 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:22.656214 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:22.656214 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 10:11:22.656214 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 10:11:22.656214 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 10:11:22.656214 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 10:11:22.657120 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 10:11:22.657120 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 10:11:22.657120 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 10:11:22.657120 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 10:11:22.657120 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:22.657120 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:22.657120 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:22.657120 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:22.657120 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:22.657120 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:22.657120 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:22.657120 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:22.657120 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:22.657120 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:22.657120 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:22.657120 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:22.658021 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:22.658021 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:22.658021 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:22.658021 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:22.658021 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 10:11:22.658021 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 10:11:22.658021 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 10:11:22.658021 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 10:11:22.658021 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 10:11:22.658021 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 10:11:22.658021 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 10:11:22.658021 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:11:22.664973 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 313/628] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Aug 9 10:11:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:22.666923 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d39e01-41cf-40d2-b687-ce0bdf671bf3 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:22.679419 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 316/629] 10.222.0.36 () {56 vars in 1133 bytes} [Tue Aug 9 10:11:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:22.680585 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7183ecd-94b7-460b-bc37-b7575d97d08a None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:22.713039 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:22.789754 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7183ecd-94b7-460b-bc37-b7575d97d08a None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:22.791535 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d39e01-41cf-40d2-b687-ce0bdf671bf3 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:22.829461 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d362b6f8-39ed-43e1-a20d-4f49e82f8134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:22.829706 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7298fe0d-b8e0-4056-98aa-163bc85f0983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:22.830159 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d362b6f8-39ed-43e1-a20d-4f49e82f8134 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:22.830440 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d362b6f8-39ed-43e1-a20d-4f49e82f8134 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:22.830715 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d362b6f8-39ed-43e1-a20d-4f49e82f8134 None admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:22.831256 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7298fe0d-b8e0-4056-98aa-163bc85f0983 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:22.831449 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d362b6f8-39ed-43e1-a20d-4f49e82f8134 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:22.831758 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d362b6f8-39ed-43e1-a20d-4f49e82f8134 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:22.832109 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7298fe0d-b8e0-4056-98aa-163bc85f0983 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:22.832582 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7298fe0d-b8e0-4056-98aa-163bc85f0983 None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:22.833193 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d362b6f8-39ed-43e1-a20d-4f49e82f8134 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:22.833704 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7298fe0d-b8e0-4056-98aa-163bc85f0983 None admin] RBAC: Adding query filter params (name=service) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:22.834234 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7298fe0d-b8e0-4056-98aa-163bc85f0983 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:22.836047 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7298fe0d-b8e0-4056-98aa-163bc85f0983 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:22.845479 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 317/630] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Aug 9 10:11:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:22.846617 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7298fe0d-b8e0-4056-98aa-163bc85f0983 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:22.851041 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 314/631] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Aug 9 10:11:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:22.852519 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d362b6f8-39ed-43e1-a20d-4f49e82f8134 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:22.873593 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:22.946294 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:22.960858 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7298fe0d-b8e0-4056-98aa-163bc85f0983 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:22.966564 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d362b6f8-39ed-43e1-a20d-4f49e82f8134 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:22.997314 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7e71d4-1666-4416-9ca2-4da8925713d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:22.997690 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e71d4-1666-4416-9ca2-4da8925713d6 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:22.998001 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e71d4-1666-4416-9ca2-4da8925713d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:22.998288 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e71d4-1666-4416-9ca2-4da8925713d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:23.002264 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcf608a-12fd-45c5-ae42-2806746d8018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:23.002879 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf608a-12fd-45c5-ae42-2806746d8018 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:23.003154 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf608a-12fd-45c5-ae42-2806746d8018 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:23.003421 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf608a-12fd-45c5-ae42-2806746d8018 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:23.013964 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcf608a-12fd-45c5-ae42-2806746d8018 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:23.015393 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcf608a-12fd-45c5-ae42-2806746d8018 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:23.030588 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-3bcf608a-12fd-45c5-ae42-2806746d8018 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:23.030588 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:23.030588 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:23.030588 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:23.030588 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:23.030588 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:23.030588 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:23.030588 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:23.030588 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:23.030588 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:23.030588 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:23.030588 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:23.030588 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 10:11:23.030588 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 10:11:23.030588 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 10:11:23.030588 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 10:11:23.031734 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:23.031734 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:23.031734 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:23.031734 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:23.031734 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:23.031734 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:23.031734 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:23.031734 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:23.031734 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:23.031734 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:23.031734 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:23.031734 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:23.031734 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:23.031734 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:23.031734 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:23.031734 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:23.031734 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 10:11:23.032631 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 10:11:23.032631 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:23.032631 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:11:23.032631 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 315/632] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:11:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:23.032883 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcf608a-12fd-45c5-ae42-2806746d8018 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:23.076271 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7e71d4-1666-4416-9ca2-4da8925713d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:23.077722 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7e71d4-1666-4416-9ca2-4da8925713d6 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:23.109939 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:23.143513 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcf608a-12fd-45c5-ae42-2806746d8018 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:23.176665 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:23.180878 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cc0331-8ed8-48c3-b203-51e96f46d8c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:23.181533 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cc0331-8ed8-48c3-b203-51e96f46d8c5 None admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:23.181809 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cc0331-8ed8-48c3-b203-51e96f46d8c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:23.182110 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cc0331-8ed8-48c3-b203-51e96f46d8c5 None admin] PATH_INFO: `/v3/projects/28891cf6239a43469326a864fb0d216c/users/841c5dbaae774944b637c533ebd75b29/roles/1252647548644b48900ef09f1df438fd` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:23.187843 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 318/633] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Aug 9 10:11:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 10:11:23.189075 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e772c8f2-357a-43ab-8c7c-a44439fca72d None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:23.189362 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e772c8f2-357a-43ab-8c7c-a44439fca72d None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:23.189636 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e772c8f2-357a-43ab-8c7c-a44439fca72d None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:23.194298 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 319/634] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:11:23 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:11:23.194298 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e772c8f2-357a-43ab-8c7c-a44439fca72d None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:23.201300 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cc0331-8ed8-48c3-b203-51e96f46d8c5 None admin] RBAC: Authorizing `identity:create_grant(project_id=28891cf6239a43469326a864fb0d216c, user_id=841c5dbaae774944b637c533ebd75b29, role_id=1252647548644b48900ef09f1df438fd)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:23.202849 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cc0331-8ed8-48c3-b203-51e96f46d8c5 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:23.215033 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 316/635] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Aug 9 10:11:23 2022] PUT /identity/v3/projects/28891cf6239a43469326a864fb0d216c/users/841c5dbaae774944b637c533ebd75b29/roles/1252647548644b48900ef09f1df438fd => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:11:23.216220 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f107bfa-3ace-4f29-81e3-132a66f1fd95 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:23.216499 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f107bfa-3ace-4f29-81e3-132a66f1fd95 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:23.216836 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f107bfa-3ace-4f29-81e3-132a66f1fd95 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:23.218180 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 317/636] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:11:23 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:11:23.218743 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f107bfa-3ace-4f29-81e3-132a66f1fd95 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:23.320877 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e772c8f2-357a-43ab-8c7c-a44439fca72d None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:23.336182 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f107bfa-3ace-4f29-81e3-132a66f1fd95 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:23.358954 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:23.363834 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bced9f2-4af7-49ea-a1c9-4af7afd0c1c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:23.364619 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bced9f2-4af7-49ea-a1c9-4af7afd0c1c7 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:23.365614 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bced9f2-4af7-49ea-a1c9-4af7afd0c1c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:23.366091 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bced9f2-4af7-49ea-a1c9-4af7afd0c1c7 None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:23.366914 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bced9f2-4af7-49ea-a1c9-4af7afd0c1c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:23.367399 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bced9f2-4af7-49ea-a1c9-4af7afd0c1c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:23.369324 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bced9f2-4af7-49ea-a1c9-4af7afd0c1c7 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:23.377492 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057eee29-4771-41aa-b0f7-2b5683dd003b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:23.378366 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057eee29-4771-41aa-b0f7-2b5683dd003b None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:23.378871 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057eee29-4771-41aa-b0f7-2b5683dd003b None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:23.379304 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057eee29-4771-41aa-b0f7-2b5683dd003b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:23.382828 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 320/637] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Aug 9 10:11:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:23.384192 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b96065-1dc8-4886-8ca4-6273fd477943 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:23.384480 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b96065-1dc8-4886-8ca4-6273fd477943 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:23.384747 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b96065-1dc8-4886-8ca4-6273fd477943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:23.391528 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057eee29-4771-41aa-b0f7-2b5683dd003b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:23.392991 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057eee29-4771-41aa-b0f7-2b5683dd003b None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:23.403763 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-e3b96065-1dc8-4886-8ca4-6273fd477943 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:11:23.404937 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-e3b96065-1dc8-4886-8ca4-6273fd477943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:11:23.408918 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-057eee29-4771-41aa-b0f7-2b5683dd003b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:23.408918 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:23.408918 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:23.408918 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:23.408918 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:23.408918 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:23.408918 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:23.408918 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:23.408918 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:23.408918 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:23.408918 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:23.408918 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:23.408918 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 10:11:23.408918 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 10:11:23.408918 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 10:11:23.408918 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 10:11:23.409897 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:23.409897 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:23.409897 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:23.409897 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:23.409897 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:23.409897 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:23.409897 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:23.409897 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:23.409897 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:23.409897 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:23.409897 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:23.409897 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:23.409897 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:23.409897 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:23.409897 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:23.409897 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:23.409897 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 10:11:23.410804 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 10:11:23.410804 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:23.410804 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:11:23.410804 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 318/638] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:11:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:23.412404 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea70aaa2-5847-433a-9c82-5409bbae1357 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:23.412404 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea70aaa2-5847-433a-9c82-5409bbae1357 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:23.412404 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea70aaa2-5847-433a-9c82-5409bbae1357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:23.430184 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-ea70aaa2-5847-433a-9c82-5409bbae1357 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:11:23.431373 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-ea70aaa2-5847-433a-9c82-5409bbae1357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:11:23.465610 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:23.493954 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 321/639] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:11:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 10:11:23.493954 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b96065-1dc8-4886-8ca4-6273fd477943 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:23.510770 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 319/640] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:11:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 10:11:23.512470 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea70aaa2-5847-433a-9c82-5409bbae1357 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:23.609638 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b96065-1dc8-4886-8ca4-6273fd477943 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:23.620615 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea70aaa2-5847-433a-9c82-5409bbae1357 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:23.622855 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:23.647777 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f735e0b3-5a6f-47eb-8968-1015c546e96a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:23.648401 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f735e0b3-5a6f-47eb-8968-1015c546e96a None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:23.648677 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f735e0b3-5a6f-47eb-8968-1015c546e96a None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:23.648945 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f735e0b3-5a6f-47eb-8968-1015c546e96a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:23.656699 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f735e0b3-5a6f-47eb-8968-1015c546e96a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:23.658193 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f735e0b3-5a6f-47eb-8968-1015c546e96a None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:23.661385 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa0b27a-8f5a-4fa7-b5be-4dd90bbefc47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:23.662025 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa0b27a-8f5a-4fa7-b5be-4dd90bbefc47 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:23.662304 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa0b27a-8f5a-4fa7-b5be-4dd90bbefc47 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:23.662569 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa0b27a-8f5a-4fa7-b5be-4dd90bbefc47 None admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:23.663201 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa0b27a-8f5a-4fa7-b5be-4dd90bbefc47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:23.663503 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa0b27a-8f5a-4fa7-b5be-4dd90bbefc47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:23.664845 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa0b27a-8f5a-4fa7-b5be-4dd90bbefc47 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:23.671039 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-f735e0b3-5a6f-47eb-8968-1015c546e96a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 09 10:11:23.671039 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:23.671039 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:23.671039 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:23.671039 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:23.671039 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:23.671039 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:23.671039 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:23.671039 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:23.671039 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:23.671039 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:23.671039 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:23.671039 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 10:11:23.671039 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 10:11:23.671039 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 10:11:23.671039 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 10:11:23.671968 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:23.671968 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:23.671968 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 10:11:23.671968 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 10:11:23.671968 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 10:11:23.671968 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 10:11:23.671968 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:23.671968 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:23.671968 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:23.671968 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:23.671968 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:23.671968 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:23.671968 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:23.671968 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:23.671968 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:23.671968 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:23.671968 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:23.671968 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:23.672902 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:23.672902 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:23.672902 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 10:11:23.672902 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 10:11:23.672902 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 10:11:23.672902 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 10:11:23.672902 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 10:11:23.672902 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 10:11:23.672902 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 09 10:11:23.672902 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:23.676806 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 322/641] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Aug 9 10:11:23 2022] GET /identity/v3/users/cinder => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:23.677395 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f735e0b3-5a6f-47eb-8968-1015c546e96a None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:23.681925 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 320/642] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Aug 9 10:11:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:23.682784 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa0b27a-8f5a-4fa7-b5be-4dd90bbefc47 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:23.722346 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:23.788732 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f735e0b3-5a6f-47eb-8968-1015c546e96a None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:23.793878 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa0b27a-8f5a-4fa7-b5be-4dd90bbefc47 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:23.824697 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68363933-d37c-4dee-9cb9-8a829c73ec91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:23.825394 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68363933-d37c-4dee-9cb9-8a829c73ec91 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:23.825664 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68363933-d37c-4dee-9cb9-8a829c73ec91 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:23.825964 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68363933-d37c-4dee-9cb9-8a829c73ec91 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:23.831705 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ba94f7-23cf-4dc4-a249-16bae233eb5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:23.832328 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba94f7-23cf-4dc4-a249-16bae233eb5a None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:23.832605 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba94f7-23cf-4dc4-a249-16bae233eb5a None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:23.832867 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba94f7-23cf-4dc4-a249-16bae233eb5a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:23.836752 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68363933-d37c-4dee-9cb9-8a829c73ec91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 10:11:23.842011 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-68363933-d37c-4dee-9cb9-8a829c73ec91 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 10:11:23.842011 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:23.842011 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:23.842011 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:23.842011 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:23.842011 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:23.842011 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:23.842011 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:23.842011 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:23.842011 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:23.842011 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:23.842011 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:23.842011 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 10:11:23.842011 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 10:11:23.842011 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 10:11:23.842011 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 10:11:23.843023 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 10:11:23.843023 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 10:11:23.843023 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 10:11:23.843023 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 10:11:23.843023 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:23.843023 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:23.843023 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:23.843023 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:23.843023 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:23.843023 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:23.843023 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:23.843023 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:23.843023 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:23.843023 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:23.843023 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:23.843023 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:23.843878 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:23.843878 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:23.843878 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:23.843878 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:23.843878 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 10:11:23.843878 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 10:11:23.843878 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 10:11:23.843878 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 10:11:23.843878 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 10:11:23.843878 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 10:11:23.843878 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 10:11:23.843878 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:23.845704 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ba94f7-23cf-4dc4-a249-16bae233eb5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 10:11:23.847963 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 323/643] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Aug 9 10:11:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:23.848779 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68363933-d37c-4dee-9cb9-8a829c73ec91 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:23.851057 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-48ba94f7-23cf-4dc4-a249-16bae233eb5a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 10:11:23.851057 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:23.851057 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:23.851057 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:23.851057 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:23.851057 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:23.851057 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:23.851057 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:23.851057 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:23.851057 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:23.851057 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:23.851057 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:23.851057 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 10:11:23.851057 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 10:11:23.851057 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 10:11:23.851057 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 10:11:23.851969 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 10:11:23.851969 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 10:11:23.851969 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 10:11:23.851969 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 10:11:23.851969 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:23.851969 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:23.851969 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:23.851969 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:23.851969 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:23.851969 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:23.851969 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:23.851969 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:23.851969 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:23.851969 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:23.851969 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:23.851969 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:23.852860 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:23.852860 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:23.852860 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:23.852860 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:23.852860 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 10:11:23.852860 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 10:11:23.852860 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 10:11:23.852860 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 10:11:23.852860 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 10:11:23.852860 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 10:11:23.852860 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 10:11:23.852860 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:11:23.852860 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 321/644] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Aug 9 10:11:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:23.854924 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ba94f7-23cf-4dc4-a249-16bae233eb5a None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:23.882248 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:23.962959 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68363933-d37c-4dee-9cb9-8a829c73ec91 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:23.965168 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:23.971762 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ba94f7-23cf-4dc4-a249-16bae233eb5a None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:24.003613 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d47bd53-6d35-4337-a4af-ea6b3b24b72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:24.004547 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d47bd53-6d35-4337-a4af-ea6b3b24b72a None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:24.004999 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d47bd53-6d35-4337-a4af-ea6b3b24b72a None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:24.005444 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d47bd53-6d35-4337-a4af-ea6b3b24b72a None admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:24.006364 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d47bd53-6d35-4337-a4af-ea6b3b24b72a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:24.006855 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d47bd53-6d35-4337-a4af-ea6b3b24b72a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:24.008057 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f91b65-60b6-45bb-ab9e-946722b9b7d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:24.008596 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d47bd53-6d35-4337-a4af-ea6b3b24b72a None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:24.008727 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f91b65-60b6-45bb-ab9e-946722b9b7d8 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:24.008941 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f91b65-60b6-45bb-ab9e-946722b9b7d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:24.009213 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f91b65-60b6-45bb-ab9e-946722b9b7d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:24.016327 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f91b65-60b6-45bb-ab9e-946722b9b7d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:24.017934 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f91b65-60b6-45bb-ab9e-946722b9b7d8 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:24.028702 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 324/645] 10.222.0.36 () {56 vars in 1137 bytes} [Tue Aug 9 10:11:23 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:24.029511 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d47bd53-6d35-4337-a4af-ea6b3b24b72a None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:24.030920 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-14f91b65-60b6-45bb-ab9e-946722b9b7d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 10:11:24.030920 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:24.030920 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:24.030920 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:24.030920 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:24.030920 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:24.030920 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:24.030920 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:24.030920 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:24.030920 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:24.030920 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:24.030920 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:24.030920 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 10:11:24.030920 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 10:11:24.030920 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 10:11:24.031826 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 10:11:24.031826 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:24.031826 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:24.031826 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:24.031826 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:24.031826 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:24.031826 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:24.031826 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:24.031826 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:24.031826 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:24.031826 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:24.031826 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:24.031826 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:24.031826 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:24.031826 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:24.031826 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:24.031826 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:24.032732 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 10:11:24.032732 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 10:11:24.032732 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 10:11:24.032732 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 10:11:24.032732 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 10:11:24.032732 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 10:11:24.032732 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 10:11:24.032732 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:11:24.032732 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 322/646] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Aug 9 10:11:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:24.033222 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f91b65-60b6-45bb-ab9e-946722b9b7d8 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:24.126458 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:24.139982 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d47bd53-6d35-4337-a4af-ea6b3b24b72a None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:24.147149 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f91b65-60b6-45bb-ab9e-946722b9b7d8 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:24.178842 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a638d64-0b40-411c-b289-8f4a02b631a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:24.179444 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a638d64-0b40-411c-b289-8f4a02b631a8 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:24.179724 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a638d64-0b40-411c-b289-8f4a02b631a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:24.179997 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a638d64-0b40-411c-b289-8f4a02b631a8 None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:24.180655 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a638d64-0b40-411c-b289-8f4a02b631a8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:24.180955 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a638d64-0b40-411c-b289-8f4a02b631a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:24.182357 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a638d64-0b40-411c-b289-8f4a02b631a8 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:24.185196 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7baa9c9-9f7a-47c0-8433-9a579a0eb025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:24.186019 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7baa9c9-9f7a-47c0-8433-9a579a0eb025 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:24.186480 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7baa9c9-9f7a-47c0-8433-9a579a0eb025 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:24.186930 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7baa9c9-9f7a-47c0-8433-9a579a0eb025 None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:24.187902 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7baa9c9-9f7a-47c0-8433-9a579a0eb025 None admin] RBAC: Adding query filter params (name=service) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:24.188280 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7baa9c9-9f7a-47c0-8433-9a579a0eb025 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:24.189691 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7baa9c9-9f7a-47c0-8433-9a579a0eb025 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:24.195226 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 325/647] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Aug 9 10:11:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:24.195226 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a638d64-0b40-411c-b289-8f4a02b631a8 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:24.205652 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 323/648] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Aug 9 10:11:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:24.205652 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7baa9c9-9f7a-47c0-8433-9a579a0eb025 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:24.224160 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:24.303291 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a638d64-0b40-411c-b289-8f4a02b631a8 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:24.319942 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7baa9c9-9f7a-47c0-8433-9a579a0eb025 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:24.342722 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9da9d2-f821-470d-b778-d5247d20b681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:24.343505 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9da9d2-f821-470d-b778-d5247d20b681 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:24.343782 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9da9d2-f821-470d-b778-d5247d20b681 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:24.344054 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9da9d2-f821-470d-b778-d5247d20b681 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:24.364091 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1c3638-c4bc-4cea-8244-56efafa1215a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:24.364697 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1c3638-c4bc-4cea-8244-56efafa1215a None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:24.364971 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1c3638-c4bc-4cea-8244-56efafa1215a None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:24.365239 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1c3638-c4bc-4cea-8244-56efafa1215a None admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:24.365954 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1c3638-c4bc-4cea-8244-56efafa1215a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:24.366260 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1c3638-c4bc-4cea-8244-56efafa1215a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:24.368485 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1c3638-c4bc-4cea-8244-56efafa1215a None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:24.382881 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 324/649] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Aug 9 10:11:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:24.383638 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1c3638-c4bc-4cea-8244-56efafa1215a None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:24.389895 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:24.420351 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9da9d2-f821-470d-b778-d5247d20b681 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:24.421817 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9da9d2-f821-470d-b778-d5247d20b681 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:24.449020 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:24.498520 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1c3638-c4bc-4cea-8244-56efafa1215a None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:24.529574 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 326/650] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Aug 9 10:11:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 10:11:24.530421 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9da9d2-f821-470d-b778-d5247d20b681 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:24.538760 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec1bcdb-12ee-4b71-b0c6-8ad355bad516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:24.539377 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec1bcdb-12ee-4b71-b0c6-8ad355bad516 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:24.539750 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec1bcdb-12ee-4b71-b0c6-8ad355bad516 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:24.540028 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec1bcdb-12ee-4b71-b0c6-8ad355bad516 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:24.551730 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec1bcdb-12ee-4b71-b0c6-8ad355bad516 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:24.553161 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec1bcdb-12ee-4b71-b0c6-8ad355bad516 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:24.567089 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-8ec1bcdb-12ee-4b71-b0c6-8ad355bad516 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:24.567089 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:24.567089 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:24.567089 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:24.567089 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:24.567089 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:24.567089 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:24.567089 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:24.567089 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:24.567089 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:24.567089 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:24.567089 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:24.567089 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 10:11:24.567089 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 10:11:24.567089 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 10:11:24.567089 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 10:11:24.568006 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:24.568006 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:24.568006 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:24.568006 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:24.568006 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:24.568006 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:24.568006 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:24.568006 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:24.568006 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:24.568006 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:24.568006 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:24.568006 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:24.568006 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:24.568006 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:24.568006 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:24.568006 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:24.568006 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 10:11:24.568919 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 10:11:24.568919 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:24.568919 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:11:24.568919 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 325/651] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:11:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:24.568919 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec1bcdb-12ee-4b71-b0c6-8ad355bad516 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:24.633675 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:24.640786 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9da9d2-f821-470d-b778-d5247d20b681 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:24.666348 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:24.680144 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23e6dd1-feda-4c7d-9fdd-28a321f8f09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:24.680762 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23e6dd1-feda-4c7d-9fdd-28a321f8f09d None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:24.681036 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23e6dd1-feda-4c7d-9fdd-28a321f8f09d None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:24.681301 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23e6dd1-feda-4c7d-9fdd-28a321f8f09d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:24.681805 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec1bcdb-12ee-4b71-b0c6-8ad355bad516 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:24.692272 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23e6dd1-feda-4c7d-9fdd-28a321f8f09d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:24.693722 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23e6dd1-feda-4c7d-9fdd-28a321f8f09d None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:24.709725 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-a23e6dd1-feda-4c7d-9fdd-28a321f8f09d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:24.709725 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:24.709725 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:24.709725 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:24.709725 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:24.709725 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:24.709725 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:24.709725 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:24.709725 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:24.709725 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:24.709725 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:24.709725 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:24.709725 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 10:11:24.709725 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 10:11:24.709725 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 10:11:24.709725 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 10:11:24.710742 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:24.710742 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:24.710742 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:24.710742 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:24.710742 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:24.710742 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:24.710742 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:24.710742 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:24.710742 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:24.710742 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:24.710742 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:24.710742 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:24.710742 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:24.710742 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:24.710742 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:24.710742 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:24.710742 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 10:11:24.711637 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 10:11:24.711637 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:24.711637 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:24.711637 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 327/652] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:11:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:24.711637 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23e6dd1-feda-4c7d-9fdd-28a321f8f09d None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:24.741428 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71f4fb3-6af9-47b4-acff-f86ef6b0880f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:24.742115 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f4fb3-6af9-47b4-acff-f86ef6b0880f None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:24.742325 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f4fb3-6af9-47b4-acff-f86ef6b0880f None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:24.742592 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f4fb3-6af9-47b4-acff-f86ef6b0880f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:24.743312 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71f4fb3-6af9-47b4-acff-f86ef6b0880f None admin] RBAC: Adding query filter params (role.id=1252647548644b48900ef09f1df438fd, scope.project.id=28891cf6239a43469326a864fb0d216c, user.id=eb863beaaa9f495c8b64655996c061f2) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:24.743614 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71f4fb3-6af9-47b4-acff-f86ef6b0880f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:24.745055 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71f4fb3-6af9-47b4-acff-f86ef6b0880f None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:24.758002 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 326/653] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Aug 9 10:11:24 2022] GET /identity/v3/role_assignments?user.id=eb863beaaa9f495c8b64655996c061f2&scope.project.id=28891cf6239a43469326a864fb0d216c&role.id=1252647548644b48900ef09f1df438fd => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:24.758002 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71f4fb3-6af9-47b4-acff-f86ef6b0880f None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:24.852434 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23e6dd1-feda-4c7d-9fdd-28a321f8f09d None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:24.883462 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71f4fb3-6af9-47b4-acff-f86ef6b0880f None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:24.899984 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739afb35-60f1-4c5f-a660-b02cc58a51ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:24.900546 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739afb35-60f1-4c5f-a660-b02cc58a51ec None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:24.901090 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739afb35-60f1-4c5f-a660-b02cc58a51ec None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:24.901363 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739afb35-60f1-4c5f-a660-b02cc58a51ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:24.908961 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:24.919735 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739afb35-60f1-4c5f-a660-b02cc58a51ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:24.921774 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739afb35-60f1-4c5f-a660-b02cc58a51ec None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:24.927448 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcca69b3-0081-4e07-b48f-d2a4c83b48c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:24.928045 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcca69b3-0081-4e07-b48f-d2a4c83b48c1 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:24.928316 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcca69b3-0081-4e07-b48f-d2a4c83b48c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:24.928580 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcca69b3-0081-4e07-b48f-d2a4c83b48c1 None admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:24.929208 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcca69b3-0081-4e07-b48f-d2a4c83b48c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:24.930231 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcca69b3-0081-4e07-b48f-d2a4c83b48c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:24.931915 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcca69b3-0081-4e07-b48f-d2a4c83b48c1 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:24.938496 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-739afb35-60f1-4c5f-a660-b02cc58a51ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:24.938496 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:24.938496 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:24.938496 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:24.938496 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:24.938496 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:24.938496 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:24.938496 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:24.938496 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:24.938496 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:24.938496 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:24.938496 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:24.938496 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 10:11:24.938496 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 10:11:24.938496 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 10:11:24.938496 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 10:11:24.939448 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:24.939448 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:24.939448 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:24.939448 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:24.939448 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:24.939448 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:24.939448 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:24.939448 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:24.939448 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:24.939448 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:24.939448 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:24.939448 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:24.939448 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:24.939448 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:24.939448 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:24.939448 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:24.939448 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 10:11:24.940353 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 10:11:24.940353 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:24.940353 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:24.940353 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 328/654] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:11:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:24.941672 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739afb35-60f1-4c5f-a660-b02cc58a51ec None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:24.954088 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 327/655] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Aug 9 10:11:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:24.954769 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcca69b3-0081-4e07-b48f-d2a4c83b48c1 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:24.980920 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:25.079775 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739afb35-60f1-4c5f-a660-b02cc58a51ec None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:25.083680 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcca69b3-0081-4e07-b48f-d2a4c83b48c1 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:25.117404 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbdea3a-f858-4679-a689-6fda4ed7b349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:25.118103 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbdea3a-f858-4679-a689-6fda4ed7b349 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:25.118448 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbdea3a-f858-4679-a689-6fda4ed7b349 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:25.118794 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbdea3a-f858-4679-a689-6fda4ed7b349 None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:25.119486 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbdea3a-f858-4679-a689-6fda4ed7b349 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:25.119852 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbdea3a-f858-4679-a689-6fda4ed7b349 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:25.121490 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbdea3a-f858-4679-a689-6fda4ed7b349 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:25.131601 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce718598-d08a-43db-a479-6de50eec2221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:25.132754 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce718598-d08a-43db-a479-6de50eec2221 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:25.133208 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce718598-d08a-43db-a479-6de50eec2221 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:25.133651 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce718598-d08a-43db-a479-6de50eec2221 None admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:25.134502 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce718598-d08a-43db-a479-6de50eec2221 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:25.134951 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 329/656] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Aug 9 10:11:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:25.135171 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce718598-d08a-43db-a479-6de50eec2221 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:25.136081 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbdea3a-f858-4679-a689-6fda4ed7b349 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:25.137453 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce718598-d08a-43db-a479-6de50eec2221 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:25.154016 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 328/657] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Aug 9 10:11:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:25.154939 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce718598-d08a-43db-a479-6de50eec2221 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:25.202291 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:25.235536 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:25.252456 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbdea3a-f858-4679-a689-6fda4ed7b349 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:25.264963 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce718598-d08a-43db-a479-6de50eec2221 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:25.290167 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138718a3-4b4c-4c89-98ce-4f45e9a9e2de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:25.291045 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138718a3-4b4c-4c89-98ce-4f45e9a9e2de None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:25.291324 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138718a3-4b4c-4c89-98ce-4f45e9a9e2de None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:25.291593 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138718a3-4b4c-4c89-98ce-4f45e9a9e2de None admin] PATH_INFO: `/v3/users/glance` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:25.298696 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138718a3-4b4c-4c89-98ce-4f45e9a9e2de None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:25.300152 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138718a3-4b4c-4c89-98ce-4f45e9a9e2de None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:25.301308 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518e6c0b-e864-4345-9a2a-dbeecbe7a6de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:25.302305 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518e6c0b-e864-4345-9a2a-dbeecbe7a6de None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:25.303187 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518e6c0b-e864-4345-9a2a-dbeecbe7a6de None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:25.303636 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518e6c0b-e864-4345-9a2a-dbeecbe7a6de None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:25.312006 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-138718a3-4b4c-4c89-98ce-4f45e9a9e2de None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 09 10:11:25.312006 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:25.312006 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:25.312006 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:25.312006 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:25.312006 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:25.312006 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:25.312006 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:25.312006 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:25.312006 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:25.312006 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:25.312006 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:25.312006 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 10:11:25.312006 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 10:11:25.312006 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 10:11:25.312006 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 10:11:25.312957 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:25.312957 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:25.312957 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 10:11:25.312957 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 10:11:25.312957 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 10:11:25.312957 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 10:11:25.312957 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:25.312957 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:25.312957 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:25.312957 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:25.312957 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:25.312957 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:25.312957 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:25.312957 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:25.312957 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:25.312957 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:25.312957 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:25.312957 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:25.313948 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:25.313948 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:25.313948 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 10:11:25.313948 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 10:11:25.313948 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 10:11:25.313948 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 10:11:25.313948 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 10:11:25.313948 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 10:11:25.313948 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 09 10:11:25.313948 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:25.313948 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 330/658] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Aug 9 10:11:25 2022] GET /identity/v3/users/glance => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:25.313948 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138718a3-4b4c-4c89-98ce-4f45e9a9e2de None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:25.315456 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518e6c0b-e864-4345-9a2a-dbeecbe7a6de None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:25.318174 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518e6c0b-e864-4345-9a2a-dbeecbe7a6de None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:25.330059 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-518e6c0b-e864-4345-9a2a-dbeecbe7a6de None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 09 10:11:25.330059 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:25.330059 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:25.330059 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:25.330059 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:25.330059 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:25.330059 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:25.330059 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:25.330059 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:25.330059 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:25.330059 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:25.330059 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:25.330059 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 10:11:25.330059 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 10:11:25.330059 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 10:11:25.330059 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 10:11:25.331004 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:25.331004 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:25.331004 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 10:11:25.331004 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 10:11:25.331004 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 10:11:25.331004 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 10:11:25.331004 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:25.331004 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:25.331004 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:25.331004 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:25.331004 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:25.331004 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:25.331004 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:25.331004 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:25.331004 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:25.331004 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:25.331004 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:25.331004 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:25.331933 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:25.331933 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:25.331933 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 10:11:25.331933 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 10:11:25.331933 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 10:11:25.331933 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 10:11:25.331933 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 10:11:25.331933 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 10:11:25.331933 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 09 10:11:25.331933 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:11:25.331933 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 329/659] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Aug 9 10:11:25 2022] GET /identity/v3/users/neutron => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:25.333164 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5025537d-b852-469c-8c58-8c04f750aa50 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:25.333164 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5025537d-b852-469c-8c58-8c04f750aa50 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:25.333164 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5025537d-b852-469c-8c58-8c04f750aa50 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:25.334274 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 330/660] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:11:25 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:11:25.334972 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5025537d-b852-469c-8c58-8c04f750aa50 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:25.435523 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138718a3-4b4c-4c89-98ce-4f45e9a9e2de None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:25.440039 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:25.447597 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5025537d-b852-469c-8c58-8c04f750aa50 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:25.477416 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbcd034-f2f1-4929-a87c-35b2f0ba229e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:25.478068 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbcd034-f2f1-4929-a87c-35b2f0ba229e None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:25.478347 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbcd034-f2f1-4929-a87c-35b2f0ba229e None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:25.478618 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbcd034-f2f1-4929-a87c-35b2f0ba229e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:25.485907 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbcd034-f2f1-4929-a87c-35b2f0ba229e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:25.486109 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce6c816-4416-4e34-ba8d-e27ffcf7e171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:25.486663 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce6c816-4416-4e34-ba8d-e27ffcf7e171 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:25.486937 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce6c816-4416-4e34-ba8d-e27ffcf7e171 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:25.487204 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce6c816-4416-4e34-ba8d-e27ffcf7e171 None admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:25.487410 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbcd034-f2f1-4929-a87c-35b2f0ba229e None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:25.487906 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce6c816-4416-4e34-ba8d-e27ffcf7e171 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:25.488205 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce6c816-4416-4e34-ba8d-e27ffcf7e171 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:25.489591 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce6c816-4416-4e34-ba8d-e27ffcf7e171 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:25.498991 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-8cbcd034-f2f1-4929-a87c-35b2f0ba229e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 10:11:25.498991 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:25.498991 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:25.498991 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:25.498991 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:25.498991 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:25.498991 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:25.498991 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:25.498991 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:25.498991 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:25.498991 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:25.498991 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:25.498991 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 10:11:25.498991 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 10:11:25.498991 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 10:11:25.499930 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 10:11:25.499930 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:25.499930 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:25.499930 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:25.499930 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:25.499930 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:25.499930 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:25.499930 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:25.499930 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:25.499930 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:25.499930 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:25.499930 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:25.499930 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:25.499930 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:25.499930 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:25.499930 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:25.499930 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:25.505777 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 10:11:25.505777 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 10:11:25.505777 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 10:11:25.505777 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 10:11:25.505777 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 10:11:25.505777 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 10:11:25.505777 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 10:11:25.505777 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:25.505777 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 331/661] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Aug 9 10:11:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:25.505777 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbcd034-f2f1-4929-a87c-35b2f0ba229e None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:25.510903 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 331/662] 10.222.0.36 () {56 vars in 1137 bytes} [Tue Aug 9 10:11:25 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:25.513679 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:25.516032 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71715d36-c96e-4c71-b0ff-36144e708dd8 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:25.516366 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71715d36-c96e-4c71-b0ff-36144e708dd8 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:25.516963 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71715d36-c96e-4c71-b0ff-36144e708dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:25.538559 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-71715d36-c96e-4c71-b0ff-36144e708dd8 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:11:25.539842 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-71715d36-c96e-4c71-b0ff-36144e708dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:11:25.617942 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 332/663] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:11:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 10:11:25.618162 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbcd034-f2f1-4929-a87c-35b2f0ba229e None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:25.618274 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71715d36-c96e-4c71-b0ff-36144e708dd8 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:25.660501 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0005783-26f4-462f-8840-cd6f3607b491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:25.661094 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0005783-26f4-462f-8840-cd6f3607b491 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:25.661373 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0005783-26f4-462f-8840-cd6f3607b491 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:25.661647 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0005783-26f4-462f-8840-cd6f3607b491 None admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:25.662402 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0005783-26f4-462f-8840-cd6f3607b491 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:25.662706 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0005783-26f4-462f-8840-cd6f3607b491 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:25.664114 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0005783-26f4-462f-8840-cd6f3607b491 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:25.687227 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 332/664] 10.222.0.36 () {56 vars in 1139 bytes} [Tue Aug 9 10:11:25 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:25.687227 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0005783-26f4-462f-8840-cd6f3607b491 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:25.711157 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:25.724862 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71715d36-c96e-4c71-b0ff-36144e708dd8 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:25.749299 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:25.762182 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c56f86c-f0e3-4273-b797-d9f2eb33fdf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:25.762758 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c56f86c-f0e3-4273-b797-d9f2eb33fdf3 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:25.763345 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c56f86c-f0e3-4273-b797-d9f2eb33fdf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:25.763631 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c56f86c-f0e3-4273-b797-d9f2eb33fdf3 None admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:25.764317 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c56f86c-f0e3-4273-b797-d9f2eb33fdf3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:25.764618 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c56f86c-f0e3-4273-b797-d9f2eb33fdf3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:25.766720 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c56f86c-f0e3-4273-b797-d9f2eb33fdf3 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:25.779409 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 333/665] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Aug 9 10:11:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:25.780576 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c56f86c-f0e3-4273-b797-d9f2eb33fdf3 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:25.789301 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0005783-26f4-462f-8840-cd6f3607b491 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:25.823567 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be3cfd1-bc9d-4f5d-8bd3-ec19f4b0f8ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:25.824680 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be3cfd1-bc9d-4f5d-8bd3-ec19f4b0f8ad None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:25.824955 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be3cfd1-bc9d-4f5d-8bd3-ec19f4b0f8ad None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:25.825216 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be3cfd1-bc9d-4f5d-8bd3-ec19f4b0f8ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:25.889303 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c56f86c-f0e3-4273-b797-d9f2eb33fdf3 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:25.895395 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be3cfd1-bc9d-4f5d-8bd3-ec19f4b0f8ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:25.896882 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be3cfd1-bc9d-4f5d-8bd3-ec19f4b0f8ad None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:25.923309 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6717137c-6cca-414d-a1d2-ea2492763429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:25.923928 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6717137c-6cca-414d-a1d2-ea2492763429 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:25.924202 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6717137c-6cca-414d-a1d2-ea2492763429 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:25.924480 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6717137c-6cca-414d-a1d2-ea2492763429 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:25.938728 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6717137c-6cca-414d-a1d2-ea2492763429 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 10:11:25.944000 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-6717137c-6cca-414d-a1d2-ea2492763429 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 10:11:25.944000 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:25.944000 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:25.944000 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:25.944000 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:25.944000 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:25.944000 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:25.944000 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:25.944000 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:25.944000 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:25.944000 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:25.944000 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:25.944000 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 10:11:25.944000 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 10:11:25.944000 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 10:11:25.944000 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 10:11:25.945166 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 10:11:25.945166 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 10:11:25.945166 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 10:11:25.945166 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 10:11:25.945166 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:25.945166 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:25.945166 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:25.945166 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:25.945166 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:25.945166 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:25.945166 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:25.945166 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:25.945166 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:25.945166 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:25.945166 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:25.945166 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:25.946170 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:25.946170 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:25.946170 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:25.946170 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:25.946170 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 10:11:25.946170 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 10:11:25.946170 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 10:11:25.946170 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 10:11:25.946170 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 10:11:25.946170 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 10:11:25.946170 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 10:11:25.946170 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:11:25.950264 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 334/666] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Aug 9 10:11:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:25.951153 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6717137c-6cca-414d-a1d2-ea2492763429 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:25.966114 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:25.973819 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:26.017775 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 333/667] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Aug 9 10:11:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 10:11:26.018915 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be3cfd1-bc9d-4f5d-8bd3-ec19f4b0f8ad None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:26.069585 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6717137c-6cca-414d-a1d2-ea2492763429 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:26.106582 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15639e8f-a059-47d4-8b49-4fbb1089665b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:26.107185 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15639e8f-a059-47d4-8b49-4fbb1089665b None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:26.107455 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15639e8f-a059-47d4-8b49-4fbb1089665b None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:26.107723 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15639e8f-a059-47d4-8b49-4fbb1089665b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:26.130083 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be3cfd1-bc9d-4f5d-8bd3-ec19f4b0f8ad None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:26.168488 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de56b901-c551-4ce9-9b0d-39bc05667bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:26.169381 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de56b901-c551-4ce9-9b0d-39bc05667bf2 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:26.169930 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de56b901-c551-4ce9-9b0d-39bc05667bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:26.170216 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de56b901-c551-4ce9-9b0d-39bc05667bf2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:26.171080 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de56b901-c551-4ce9-9b0d-39bc05667bf2 None admin] RBAC: Adding query filter params (role.id=1252647548644b48900ef09f1df438fd, scope.project.id=28891cf6239a43469326a864fb0d216c, user.id=1f6c687a38524de0bf23d87ae91d3b0f) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:26.171388 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de56b901-c551-4ce9-9b0d-39bc05667bf2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:26.173425 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de56b901-c551-4ce9-9b0d-39bc05667bf2 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:26.177951 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15639e8f-a059-47d4-8b49-4fbb1089665b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:26.179613 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15639e8f-a059-47d4-8b49-4fbb1089665b None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:26.189990 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 334/668] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Aug 9 10:11:26 2022] GET /identity/v3/role_assignments?user.id=1f6c687a38524de0bf23d87ae91d3b0f&scope.project.id=28891cf6239a43469326a864fb0d216c&role.id=1252647548644b48900ef09f1df438fd => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:26.189990 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de56b901-c551-4ce9-9b0d-39bc05667bf2 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:26.200657 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:26.227185 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:26.311829 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 335/669] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Aug 9 10:11:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 10:11:26.313265 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15639e8f-a059-47d4-8b49-4fbb1089665b None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:26.335956 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de56b901-c551-4ce9-9b0d-39bc05667bf2 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:26.379257 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8538d8c6-73f7-48b1-ac0d-e5134a9e60b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:26.379862 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8538d8c6-73f7-48b1-ac0d-e5134a9e60b4 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:26.380137 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8538d8c6-73f7-48b1-ac0d-e5134a9e60b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:26.380403 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8538d8c6-73f7-48b1-ac0d-e5134a9e60b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:26.381062 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8538d8c6-73f7-48b1-ac0d-e5134a9e60b4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:26.381475 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8538d8c6-73f7-48b1-ac0d-e5134a9e60b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:26.383145 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8538d8c6-73f7-48b1-ac0d-e5134a9e60b4 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:26.392967 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 335/670] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Aug 9 10:11:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:26.398351 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8538d8c6-73f7-48b1-ac0d-e5134a9e60b4 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:26.452150 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15639e8f-a059-47d4-8b49-4fbb1089665b None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:26.510930 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:26.525605 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8538d8c6-73f7-48b1-ac0d-e5134a9e60b4 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:26.567004 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1370b993-6d01-4d20-8a92-1b39ec0da34a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:26.568098 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1370b993-6d01-4d20-8a92-1b39ec0da34a None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:26.568596 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1370b993-6d01-4d20-8a92-1b39ec0da34a None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:26.569073 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1370b993-6d01-4d20-8a92-1b39ec0da34a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:26.586183 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1370b993-6d01-4d20-8a92-1b39ec0da34a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:26.588017 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1370b993-6d01-4d20-8a92-1b39ec0da34a None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:26.604114 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-1370b993-6d01-4d20-8a92-1b39ec0da34a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:26.604114 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:26.604114 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:26.604114 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:26.604114 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:26.604114 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:26.604114 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:26.604114 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:26.604114 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:26.604114 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:26.604114 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:26.604114 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:26.604114 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 10:11:26.604114 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 10:11:26.604114 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 10:11:26.604114 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 10:11:26.605227 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:26.605227 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:26.605227 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:26.605227 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:26.605227 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:26.605227 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:26.605227 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:26.605227 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:26.605227 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:26.605227 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:26.605227 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:26.605227 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:26.605227 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:26.605227 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:26.605227 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:26.605227 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:26.605227 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 10:11:26.607120 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 10:11:26.607120 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:26.607120 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:26.607120 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 336/671] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:11:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:26.607120 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1370b993-6d01-4d20-8a92-1b39ec0da34a None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:26.626252 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:26.645351 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc993c0a-5797-491e-a988-748e981c8d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:26.646492 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc993c0a-5797-491e-a988-748e981c8d2f None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:26.647039 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc993c0a-5797-491e-a988-748e981c8d2f None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:26.647520 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc993c0a-5797-491e-a988-748e981c8d2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:26.660067 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc993c0a-5797-491e-a988-748e981c8d2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:26.661893 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc993c0a-5797-491e-a988-748e981c8d2f None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:26.678108 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-cc993c0a-5797-491e-a988-748e981c8d2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:26.678108 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:26.678108 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:26.678108 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:26.678108 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:26.678108 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:26.678108 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:26.678108 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:26.678108 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:26.678108 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:26.678108 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:26.678108 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:26.678108 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 10:11:26.678108 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 10:11:26.678108 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 10:11:26.678108 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 10:11:26.679079 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:26.679079 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:26.679079 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:26.679079 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:26.679079 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:26.679079 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:26.679079 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:26.679079 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:26.679079 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:26.679079 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:26.679079 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:26.679079 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:26.679079 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:26.679079 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:26.679079 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:26.679079 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:26.679079 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 10:11:26.680015 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 10:11:26.680015 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:26.680015 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:11:26.682440 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 336/672] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:11:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 370 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:26.684247 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc993c0a-5797-491e-a988-748e981c8d2f None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:26.728721 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1370b993-6d01-4d20-8a92-1b39ec0da34a None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:26.766486 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1be00e-7fd9-48aa-80a0-1fe5edde6f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:26.767578 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1be00e-7fd9-48aa-80a0-1fe5edde6f31 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:26.768070 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1be00e-7fd9-48aa-80a0-1fe5edde6f31 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:26.768644 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1be00e-7fd9-48aa-80a0-1fe5edde6f31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:26.780864 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1be00e-7fd9-48aa-80a0-1fe5edde6f31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:26.782777 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1be00e-7fd9-48aa-80a0-1fe5edde6f31 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:26.784831 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:26.803624 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-cf1be00e-7fd9-48aa-80a0-1fe5edde6f31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:26.803624 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:26.803624 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:26.803624 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:26.803624 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:26.803624 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:26.803624 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:26.803624 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:26.803624 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:26.803624 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:26.803624 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:26.803624 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:26.803624 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 10:11:26.803624 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 10:11:26.803624 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 10:11:26.803624 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 10:11:26.804643 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:26.804643 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:26.804643 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:26.804643 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:26.804643 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:26.804643 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:26.804643 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:26.804643 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:26.804643 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:26.804643 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:26.804643 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:26.804643 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:26.804643 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:26.804643 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:26.804643 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:26.804643 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:26.804643 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 10:11:26.805535 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 10:11:26.805535 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:26.805535 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:26.807704 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 337/673] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:11:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:26.809919 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1be00e-7fd9-48aa-80a0-1fe5edde6f31 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:26.814676 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc993c0a-5797-491e-a988-748e981c8d2f None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:26.858367 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b8e22a-51dc-48cd-a987-28392f31eea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:26.858972 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b8e22a-51dc-48cd-a987-28392f31eea9 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:26.859245 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b8e22a-51dc-48cd-a987-28392f31eea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:26.859514 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b8e22a-51dc-48cd-a987-28392f31eea9 None admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:26.860478 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b8e22a-51dc-48cd-a987-28392f31eea9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:26.860777 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b8e22a-51dc-48cd-a987-28392f31eea9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:26.862433 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b8e22a-51dc-48cd-a987-28392f31eea9 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:26.877931 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 337/674] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Aug 9 10:11:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:26.879031 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b8e22a-51dc-48cd-a987-28392f31eea9 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:26.905911 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:26.935668 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1be00e-7fd9-48aa-80a0-1fe5edde6f31 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:26.980934 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f548285-1a8b-468e-9e70-5ead86a3dc81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:26.982035 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f548285-1a8b-468e-9e70-5ead86a3dc81 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:26.982316 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f548285-1a8b-468e-9e70-5ead86a3dc81 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:26.982586 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f548285-1a8b-468e-9e70-5ead86a3dc81 None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:26.983235 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f548285-1a8b-468e-9e70-5ead86a3dc81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:26.983536 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f548285-1a8b-468e-9e70-5ead86a3dc81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:26.984910 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f548285-1a8b-468e-9e70-5ead86a3dc81 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:26.996106 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b8e22a-51dc-48cd-a987-28392f31eea9 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:26.997647 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 338/675] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Aug 9 10:11:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:26.998319 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f548285-1a8b-468e-9e70-5ead86a3dc81 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:27.039026 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9112bf00-63d1-4f1e-8624-b2664afaef52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:27.039801 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9112bf00-63d1-4f1e-8624-b2664afaef52 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:27.040073 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9112bf00-63d1-4f1e-8624-b2664afaef52 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:27.040341 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9112bf00-63d1-4f1e-8624-b2664afaef52 None admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:27.041361 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9112bf00-63d1-4f1e-8624-b2664afaef52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:27.041649 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9112bf00-63d1-4f1e-8624-b2664afaef52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:27.044496 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9112bf00-63d1-4f1e-8624-b2664afaef52 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:27.053952 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:27.062130 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 338/676] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Aug 9 10:11:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:27.063988 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103a59fb-1e3d-483a-b76b-db1a853a66b2 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:27.064271 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103a59fb-1e3d-483a-b76b-db1a853a66b2 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:27.064539 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103a59fb-1e3d-483a-b76b-db1a853a66b2 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:27.065968 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 339/677] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:11:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:11:27.071060 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103a59fb-1e3d-483a-b76b-db1a853a66b2 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:27.104695 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f548285-1a8b-468e-9e70-5ead86a3dc81 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:27.142988 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0deff92-7988-463e-9ba4-45bcaef3230c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:27.143615 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0deff92-7988-463e-9ba4-45bcaef3230c None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:27.143904 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0deff92-7988-463e-9ba4-45bcaef3230c None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:27.144156 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0deff92-7988-463e-9ba4-45bcaef3230c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:27.150940 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0deff92-7988-463e-9ba4-45bcaef3230c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:27.153265 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0deff92-7988-463e-9ba4-45bcaef3230c None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:27.156416 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:27.164504 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-c0deff92-7988-463e-9ba4-45bcaef3230c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 10:11:27.164504 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:27.164504 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:27.164504 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:27.164504 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:27.164504 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:27.164504 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:27.164504 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:27.164504 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:27.164504 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:27.164504 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:27.164504 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:27.164504 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 10:11:27.164504 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 10:11:27.164504 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 10:11:27.165392 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 10:11:27.165392 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:27.165392 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:27.165392 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:27.165392 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:27.165392 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:27.165392 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:27.165392 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:27.165392 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:27.165392 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:27.165392 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:27.165392 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:27.165392 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:27.165392 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:27.165392 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:27.165392 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:27.165392 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:27.166606 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 10:11:27.166606 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 10:11:27.166606 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 10:11:27.166606 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 10:11:27.166606 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 10:11:27.166606 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 10:11:27.166606 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 10:11:27.166606 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:27.170890 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 339/678] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Aug 9 10:11:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:27.171646 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0deff92-7988-463e-9ba4-45bcaef3230c None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:27.181317 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103a59fb-1e3d-483a-b76b-db1a853a66b2 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:27.220330 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d130eae3-9817-45ee-a86c-8a8196f7575f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:27.221230 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d130eae3-9817-45ee-a86c-8a8196f7575f None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:27.221567 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d130eae3-9817-45ee-a86c-8a8196f7575f None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:27.222005 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d130eae3-9817-45ee-a86c-8a8196f7575f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:27.229122 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d130eae3-9817-45ee-a86c-8a8196f7575f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:27.231250 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d130eae3-9817-45ee-a86c-8a8196f7575f None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:27.242479 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-d130eae3-9817-45ee-a86c-8a8196f7575f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 10:11:27.242479 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:27.242479 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:27.242479 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:27.242479 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:27.242479 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:27.242479 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:27.242479 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:27.242479 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:27.242479 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:27.242479 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:27.242479 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:27.242479 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 10:11:27.242479 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 10:11:27.242479 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 10:11:27.243365 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 10:11:27.243365 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:27.243365 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:27.243365 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:27.243365 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:27.243365 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:27.243365 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:27.243365 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:27.243365 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:27.243365 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:27.243365 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:27.243365 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:27.243365 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:27.243365 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:27.243365 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:27.243365 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:27.243365 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:27.244266 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 10:11:27.244266 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 10:11:27.244266 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 10:11:27.244266 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 10:11:27.244266 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 10:11:27.244266 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 10:11:27.244266 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 10:11:27.244266 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:11:27.244266 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 340/679] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Aug 9 10:11:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:27.245258 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a17c04-fc9f-43ac-adb8-0aa8d1a0be0b None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:27.245258 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a17c04-fc9f-43ac-adb8-0aa8d1a0be0b None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:27.245258 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a17c04-fc9f-43ac-adb8-0aa8d1a0be0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:27.263914 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-65a17c04-fc9f-43ac-adb8-0aa8d1a0be0b None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:11:27.265110 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-65a17c04-fc9f-43ac-adb8-0aa8d1a0be0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:11:27.282190 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0deff92-7988-463e-9ba4-45bcaef3230c None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:27.297801 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:27.319652 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9c96d7-599b-42a0-8374-2b23857960e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:27.320275 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c96d7-599b-42a0-8374-2b23857960e6 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:27.320553 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c96d7-599b-42a0-8374-2b23857960e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:27.320829 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c96d7-599b-42a0-8374-2b23857960e6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:27.329452 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9c96d7-599b-42a0-8374-2b23857960e6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:27.330996 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9c96d7-599b-42a0-8374-2b23857960e6 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:27.341911 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 341/680] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:11:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 10:11:27.341911 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a17c04-fc9f-43ac-adb8-0aa8d1a0be0b None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:27.347996 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-8e9c96d7-599b-42a0-8374-2b23857960e6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 09 10:11:27.347996 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:27.347996 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:27.347996 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:27.347996 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:27.347996 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:27.347996 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:27.347996 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:27.347996 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:27.347996 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:27.347996 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:27.347996 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:27.347996 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 10:11:27.347996 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 10:11:27.347996 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 10:11:27.347996 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 10:11:27.348968 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:27.348968 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:27.348968 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 10:11:27.348968 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 10:11:27.348968 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 10:11:27.348968 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 10:11:27.348968 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:27.348968 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:27.348968 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:27.348968 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:27.348968 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:27.348968 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:27.348968 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:27.348968 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:27.348968 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:27.348968 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:27.348968 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:27.348968 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:27.350222 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:27.350222 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:27.350222 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 10:11:27.350222 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 10:11:27.350222 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 10:11:27.350222 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 10:11:27.350222 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 10:11:27.350222 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 10:11:27.350222 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 09 10:11:27.350222 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:27.350222 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 340/681] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Aug 9 10:11:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:27.350222 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9c96d7-599b-42a0-8374-2b23857960e6 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:27.421645 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:27.462964 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a17c04-fc9f-43ac-adb8-0aa8d1a0be0b None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:27.468197 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9c96d7-599b-42a0-8374-2b23857960e6 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:27.502281 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d78d4-822e-4d34-844e-bf8c69531134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:27.502457 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4634ee-d3ac-47e8-979b-cd221fb96312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:27.502803 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d78d4-822e-4d34-844e-bf8c69531134 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:27.502907 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4634ee-d3ac-47e8-979b-cd221fb96312 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:27.503074 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d78d4-822e-4d34-844e-bf8c69531134 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:27.503168 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4634ee-d3ac-47e8-979b-cd221fb96312 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:27.503338 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d78d4-822e-4d34-844e-bf8c69531134 None admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:27.503441 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4634ee-d3ac-47e8-979b-cd221fb96312 None admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:27.504019 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644d78d4-822e-4d34-844e-bf8c69531134 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:27.504124 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4634ee-d3ac-47e8-979b-cd221fb96312 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:27.504318 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644d78d4-822e-4d34-844e-bf8c69531134 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:27.504412 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4634ee-d3ac-47e8-979b-cd221fb96312 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:27.505725 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644d78d4-822e-4d34-844e-bf8c69531134 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:27.505833 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4634ee-d3ac-47e8-979b-cd221fb96312 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:27.523632 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 341/682] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Aug 9 10:11:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:27.524124 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 342/683] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Aug 9 10:11:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:27.524124 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4634ee-d3ac-47e8-979b-cd221fb96312 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:27.524718 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d78d4-822e-4d34-844e-bf8c69531134 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:27.559836 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:27.626827 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4634ee-d3ac-47e8-979b-cd221fb96312 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:27.629823 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d78d4-822e-4d34-844e-bf8c69531134 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:27.655460 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:27.663762 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c9e25b-d285-4dbd-95a6-df004da57b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:27.664591 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c9e25b-d285-4dbd-95a6-df004da57b95 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:27.664874 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c9e25b-d285-4dbd-95a6-df004da57b95 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:27.665169 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c9e25b-d285-4dbd-95a6-df004da57b95 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:27.666872 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa259151-e00d-4b06-8d2c-866b5a381fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:27.668188 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa259151-e00d-4b06-8d2c-866b5a381fca None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:27.668736 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa259151-e00d-4b06-8d2c-866b5a381fca None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:27.668992 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa259151-e00d-4b06-8d2c-866b5a381fca None admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:27.669707 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa259151-e00d-4b06-8d2c-866b5a381fca None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:27.670030 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa259151-e00d-4b06-8d2c-866b5a381fca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:27.671446 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa259151-e00d-4b06-8d2c-866b5a381fca None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:27.676404 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c9e25b-d285-4dbd-95a6-df004da57b95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 10:11:27.681495 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-64c9e25b-d285-4dbd-95a6-df004da57b95 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 10:11:27.681495 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:27.681495 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:27.681495 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:27.681495 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:27.681495 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:27.681495 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:27.681495 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:27.681495 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:27.681495 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:27.681495 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:27.681495 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:27.681495 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 10:11:27.681495 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 10:11:27.681495 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 10:11:27.681495 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 10:11:27.682646 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 10:11:27.682646 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 10:11:27.682646 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 10:11:27.682646 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 10:11:27.682646 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:27.682646 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:27.682646 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:27.682646 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:27.682646 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:27.682646 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:27.682646 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:27.682646 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:27.682646 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:27.682646 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:27.682646 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:27.682646 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:27.684038 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:27.684038 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:27.684038 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:27.684038 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:27.684038 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 10:11:27.684038 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 10:11:27.684038 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 10:11:27.684038 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 10:11:27.684038 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 10:11:27.684038 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 10:11:27.684038 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 10:11:27.684038 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:11:27.684038 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 343/684] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Aug 9 10:11:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:27.684038 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c9e25b-d285-4dbd-95a6-df004da57b95 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:27.697512 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 342/685] 10.222.0.36 () {56 vars in 1135 bytes} [Tue Aug 9 10:11:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:27.698239 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa259151-e00d-4b06-8d2c-866b5a381fca None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:27.789171 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c9e25b-d285-4dbd-95a6-df004da57b95 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:27.793444 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:27.803898 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa259151-e00d-4b06-8d2c-866b5a381fca None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:27.825723 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1192b1e4-6218-4d1f-8fe1-9e58fd5a0fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:27.826353 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1192b1e4-6218-4d1f-8fe1-9e58fd5a0fe0 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:27.826681 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1192b1e4-6218-4d1f-8fe1-9e58fd5a0fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:27.826955 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1192b1e4-6218-4d1f-8fe1-9e58fd5a0fe0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:27.827664 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1192b1e4-6218-4d1f-8fe1-9e58fd5a0fe0 None admin] RBAC: Adding query filter params (role.id=1252647548644b48900ef09f1df438fd, scope.project.id=28891cf6239a43469326a864fb0d216c, user.id=07540b72afd34927855c41db09a7b030) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:27.828056 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1192b1e4-6218-4d1f-8fe1-9e58fd5a0fe0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:27.829403 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1192b1e4-6218-4d1f-8fe1-9e58fd5a0fe0 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:27.835470 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 344/686] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Aug 9 10:11:27 2022] GET /identity/v3/role_assignments?user.id=07540b72afd34927855c41db09a7b030&scope.project.id=28891cf6239a43469326a864fb0d216c&role.id=1252647548644b48900ef09f1df438fd => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:27.836245 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1192b1e4-6218-4d1f-8fe1-9e58fd5a0fe0 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:27.851339 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aead212-3ddf-498f-b1bf-7797ba9e5024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:27.852127 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aead212-3ddf-498f-b1bf-7797ba9e5024 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:27.852502 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aead212-3ddf-498f-b1bf-7797ba9e5024 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:27.852870 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aead212-3ddf-498f-b1bf-7797ba9e5024 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:27.853991 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aead212-3ddf-498f-b1bf-7797ba9e5024 None admin] RBAC: Adding query filter params (role.id=1252647548644b48900ef09f1df438fd, scope.project.id=28891cf6239a43469326a864fb0d216c, user.id=9169847a16764da3a2a1dbb5f5f56438) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:27.854331 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aead212-3ddf-498f-b1bf-7797ba9e5024 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:27.856115 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aead212-3ddf-498f-b1bf-7797ba9e5024 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:27.870557 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 343/687] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Aug 9 10:11:27 2022] GET /identity/v3/role_assignments?user.id=9169847a16764da3a2a1dbb5f5f56438&scope.project.id=28891cf6239a43469326a864fb0d216c&role.id=1252647548644b48900ef09f1df438fd => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:27.871716 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aead212-3ddf-498f-b1bf-7797ba9e5024 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:27.906161 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:27.966986 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1192b1e4-6218-4d1f-8fe1-9e58fd5a0fe0 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:28.012887 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed63da2-a0b6-4f28-9c9f-1c836b8841bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:28.012887 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed63da2-a0b6-4f28-9c9f-1c836b8841bb None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:28.013203 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed63da2-a0b6-4f28-9c9f-1c836b8841bb None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:28.013470 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed63da2-a0b6-4f28-9c9f-1c836b8841bb None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:28.014196 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed63da2-a0b6-4f28-9c9f-1c836b8841bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:28.014299 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed63da2-a0b6-4f28-9c9f-1c836b8841bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:28.015640 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed63da2-a0b6-4f28-9c9f-1c836b8841bb None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:28.036510 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 345/688] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Aug 9 10:11:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:28.037893 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed63da2-a0b6-4f28-9c9f-1c836b8841bb None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:28.052091 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aead212-3ddf-498f-b1bf-7797ba9e5024 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:28.093353 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a7d712-da66-4a99-aa40-b68ec6b3a0c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:28.094430 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a7d712-da66-4a99-aa40-b68ec6b3a0c6 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:28.094976 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a7d712-da66-4a99-aa40-b68ec6b3a0c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:28.095461 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a7d712-da66-4a99-aa40-b68ec6b3a0c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:28.125747 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:28.157536 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed63da2-a0b6-4f28-9c9f-1c836b8841bb None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:28.179106 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a7d712-da66-4a99-aa40-b68ec6b3a0c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:28.180714 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a7d712-da66-4a99-aa40-b68ec6b3a0c6 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:28.184822 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:28.203773 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a231f775-d3bc-4664-997e-9792659a103e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:28.204406 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a231f775-d3bc-4664-997e-9792659a103e None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:28.204678 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a231f775-d3bc-4664-997e-9792659a103e None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:28.204945 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a231f775-d3bc-4664-997e-9792659a103e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:28.218108 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a231f775-d3bc-4664-997e-9792659a103e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:28.219554 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a231f775-d3bc-4664-997e-9792659a103e None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:28.237746 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-a231f775-d3bc-4664-997e-9792659a103e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:28.237746 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:28.237746 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:28.237746 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:28.237746 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:28.237746 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:28.237746 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:28.237746 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:28.237746 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:28.237746 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:28.237746 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:28.237746 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:28.237746 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 10:11:28.237746 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 10:11:28.237746 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 10:11:28.237746 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 10:11:28.238761 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:28.238761 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:28.238761 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:28.238761 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:28.238761 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:28.238761 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:28.238761 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:28.238761 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:28.238761 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:28.238761 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:28.238761 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:28.238761 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:28.238761 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:28.238761 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:28.238761 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:28.238761 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:28.238761 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 10:11:28.239674 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 10:11:28.239674 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:28.239674 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:11:28.240759 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 346/689] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:11:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:28.242514 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a231f775-d3bc-4664-997e-9792659a103e None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:28.301531 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 344/690] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Aug 9 10:11:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 10:11:28.307004 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a7d712-da66-4a99-aa40-b68ec6b3a0c6 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:28.350236 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a231f775-d3bc-4664-997e-9792659a103e None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:28.373351 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:28.397446 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f008ba-36a0-4b13-81c7-eb663e9d8ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:28.398340 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f008ba-36a0-4b13-81c7-eb663e9d8ea9 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:28.398670 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f008ba-36a0-4b13-81c7-eb663e9d8ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:28.398944 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f008ba-36a0-4b13-81c7-eb663e9d8ea9 None admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:28.399834 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f008ba-36a0-4b13-81c7-eb663e9d8ea9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:28.400133 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f008ba-36a0-4b13-81c7-eb663e9d8ea9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:28.402169 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f008ba-36a0-4b13-81c7-eb663e9d8ea9 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:28.415991 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a7d712-da66-4a99-aa40-b68ec6b3a0c6 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:28.424118 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 347/691] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Aug 9 10:11:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:11:28.425631 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7474f8e1-34c5-48aa-9caf-c365515c15b3 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:28.426652 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7474f8e1-34c5-48aa-9caf-c365515c15b3 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:28.426936 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7474f8e1-34c5-48aa-9caf-c365515c15b3 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:28.428412 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 348/692] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:11:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:11:28.430223 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7474f8e1-34c5-48aa-9caf-c365515c15b3 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:28.465966 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:28.469818 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36af91fb-bcb8-4e3f-9ddd-70a8e0906ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:28.470467 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36af91fb-bcb8-4e3f-9ddd-70a8e0906ada None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:28.470736 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36af91fb-bcb8-4e3f-9ddd-70a8e0906ada None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:28.470998 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36af91fb-bcb8-4e3f-9ddd-70a8e0906ada None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:28.483872 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36af91fb-bcb8-4e3f-9ddd-70a8e0906ada None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:28.485582 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36af91fb-bcb8-4e3f-9ddd-70a8e0906ada None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:28.500168 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-36af91fb-bcb8-4e3f-9ddd-70a8e0906ada None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:28.500168 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:28.500168 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:28.500168 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:28.500168 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:28.500168 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:28.500168 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:28.500168 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:28.500168 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:28.500168 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:28.500168 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:28.500168 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:28.500168 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 10:11:28.500168 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 10:11:28.500168 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 10:11:28.500168 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 10:11:28.501417 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:28.501417 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:28.501417 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:28.501417 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:28.501417 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:28.501417 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:28.501417 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:28.501417 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:28.501417 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:28.501417 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:28.501417 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:28.501417 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:28.501417 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:28.501417 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:28.501417 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:28.501417 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:28.501417 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 10:11:28.502544 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 10:11:28.502544 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:28.502544 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:28.507880 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 345/693] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:11:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:28.507880 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccfe3ea-1b49-4953-a1ae-91aa23570b4b None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:28.507880 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccfe3ea-1b49-4953-a1ae-91aa23570b4b None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:28.507880 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccfe3ea-1b49-4953-a1ae-91aa23570b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:28.524647 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-3ccfe3ea-1b49-4953-a1ae-91aa23570b4b None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:11:28.525932 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-3ccfe3ea-1b49-4953-a1ae-91aa23570b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:11:28.579723 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7474f8e1-34c5-48aa-9caf-c365515c15b3 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:28.602244 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 346/694] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:11:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 10:11:28.603407 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccfe3ea-1b49-4953-a1ae-91aa23570b4b None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:28.627359 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e1608-35c4-45a8-bbd2-003876d11e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:28.628519 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e1608-35c4-45a8-bbd2-003876d11e88 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:28.629380 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e1608-35c4-45a8-bbd2-003876d11e88 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:28.630095 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e1608-35c4-45a8-bbd2-003876d11e88 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:28.641652 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5e1608-35c4-45a8-bbd2-003876d11e88 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:28.643355 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5e1608-35c4-45a8-bbd2-003876d11e88 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:28.646920 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:28.659791 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-6c5e1608-35c4-45a8-bbd2-003876d11e88 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 09 10:11:28.659791 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:28.659791 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:28.659791 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:28.659791 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:28.659791 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:28.659791 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:28.659791 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:28.659791 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:28.659791 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:28.659791 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:28.659791 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:28.659791 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 10:11:28.659791 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 10:11:28.659791 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 10:11:28.659791 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 10:11:28.660991 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:28.660991 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:28.660991 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 10:11:28.660991 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 10:11:28.660991 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 10:11:28.660991 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 10:11:28.660991 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:28.660991 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:28.660991 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:28.660991 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:28.660991 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:28.660991 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:28.660991 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:28.660991 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:28.660991 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:28.660991 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:28.660991 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:28.660991 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:28.662185 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:28.662185 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:28.662185 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 10:11:28.662185 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 10:11:28.662185 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 10:11:28.662185 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 10:11:28.662185 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 10:11:28.662185 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 10:11:28.662185 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 09 10:11:28.662185 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:11:28.663629 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 349/695] 10.222.0.36 () {56 vars in 1093 bytes} [Tue Aug 9 10:11:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:28.664458 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e1608-35c4-45a8-bbd2-003876d11e88 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:28.721428 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccfe3ea-1b49-4953-a1ae-91aa23570b4b None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:28.760516 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef54a7b-f389-4465-9f3f-5e601a4e62e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:28.761322 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef54a7b-f389-4465-9f3f-5e601a4e62e2 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:28.761705 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef54a7b-f389-4465-9f3f-5e601a4e62e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:28.762124 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef54a7b-f389-4465-9f3f-5e601a4e62e2 None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:28.762700 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:28.763847 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef54a7b-f389-4465-9f3f-5e601a4e62e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:28.764422 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef54a7b-f389-4465-9f3f-5e601a4e62e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:28.766140 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef54a7b-f389-4465-9f3f-5e601a4e62e2 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:28.776432 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e1608-35c4-45a8-bbd2-003876d11e88 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:28.780547 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 347/696] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Aug 9 10:11:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:28.781678 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef54a7b-f389-4465-9f3f-5e601a4e62e2 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:28.813291 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df53420b-3f70-4c8c-aef8-1a2e19160bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:28.813948 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df53420b-3f70-4c8c-aef8-1a2e19160bba None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:28.814223 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df53420b-3f70-4c8c-aef8-1a2e19160bba None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:28.814488 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df53420b-3f70-4c8c-aef8-1a2e19160bba None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:28.815064 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df53420b-3f70-4c8c-aef8-1a2e19160bba None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:28.816412 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df53420b-3f70-4c8c-aef8-1a2e19160bba None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:28.828285 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-df53420b-3f70-4c8c-aef8-1a2e19160bba None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 09 10:11:28.828285 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:28.828285 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 10:11:28.828285 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 10:11:28.828285 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 10:11:28.828285 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 10:11:28.828285 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 10:11:28.828285 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 10:11:28.828285 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 09 10:11:28.828285 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:11:28.828285 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 10:11:28.828285 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:11:28.828285 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:28.828285 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:28.828285 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:28.828285 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:28.828285 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:28.829378 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:28.829378 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:28.829378 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:28.829378 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:28.829378 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:28.829378 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:28.829378 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 10:11:28.829378 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 10:11:28.829378 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 10:11:28.829378 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 10:11:28.829378 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:28.829378 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:28.829378 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:28.829378 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:28.829378 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:28.829378 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:28.835466 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:28.835466 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:28.835466 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:28.835466 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:28.835466 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:28.835466 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:28.835466 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:28.835466 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:28.835466 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:28.835466 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:28.835466 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 10:11:28.835466 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 10:11:28.835466 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 09 10:11:28.835466 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:11:28.835466 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 350/697] 10.222.0.36 () {56 vars in 1129 bytes} [Tue Aug 9 10:11:28 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:28.836346 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df53420b-3f70-4c8c-aef8-1a2e19160bba None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:28.898752 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:28.903642 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef54a7b-f389-4465-9f3f-5e601a4e62e2 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:28.938214 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df53420b-3f70-4c8c-aef8-1a2e19160bba None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:28.942158 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa272fef-b2bf-4978-85d6-a803d21128e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:28.943016 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa272fef-b2bf-4978-85d6-a803d21128e9 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:28.945511 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa272fef-b2bf-4978-85d6-a803d21128e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:28.946086 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa272fef-b2bf-4978-85d6-a803d21128e9 None admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:28.947145 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa272fef-b2bf-4978-85d6-a803d21128e9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:28.947775 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa272fef-b2bf-4978-85d6-a803d21128e9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:28.949646 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa272fef-b2bf-4978-85d6-a803d21128e9 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:28.974854 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 348/698] 10.222.0.36 () {56 vars in 1133 bytes} [Tue Aug 9 10:11:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:28.975037 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0af953-cce7-4fc5-b572-52cbad287c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:28.975622 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0af953-cce7-4fc5-b572-52cbad287c4b None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:28.975890 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0af953-cce7-4fc5-b572-52cbad287c4b None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:28.976156 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0af953-cce7-4fc5-b572-52cbad287c4b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:28.976864 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa272fef-b2bf-4978-85d6-a803d21128e9 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:28.983414 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0af953-cce7-4fc5-b572-52cbad287c4b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:28.984858 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0af953-cce7-4fc5-b572-52cbad287c4b None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:28.997209 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-fa0af953-cce7-4fc5-b572-52cbad287c4b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 10:11:28.997209 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:28.997209 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:28.997209 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:28.997209 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:28.997209 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:28.997209 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:28.997209 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:28.997209 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:28.997209 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:28.997209 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:28.997209 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:28.997209 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 10:11:28.997209 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 10:11:28.997209 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 10:11:28.998239 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 10:11:28.998239 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:28.998239 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:28.998239 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:28.998239 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:28.998239 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:28.998239 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:28.998239 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:28.998239 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:28.998239 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:28.998239 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:28.998239 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:28.998239 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:28.998239 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:28.998239 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:28.998239 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:28.998239 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:28.999160 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 10:11:28.999160 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 10:11:28.999160 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 10:11:28.999160 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 10:11:28.999160 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 10:11:28.999160 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 10:11:28.999160 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 10:11:28.999160 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:11:28.999160 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 351/699] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Aug 9 10:11:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:28.999669 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0af953-cce7-4fc5-b572-52cbad287c4b None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:29.015612 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:29.092941 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa272fef-b2bf-4978-85d6-a803d21128e9 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:29.105086 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0af953-cce7-4fc5-b572-52cbad287c4b None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:29.129911 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1170be5-e9c7-4b4f-a50f-0f4c4d2c58b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:29.130847 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1170be5-e9c7-4b4f-a50f-0f4c4d2c58b2 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:29.131343 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1170be5-e9c7-4b4f-a50f-0f4c4d2c58b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:29.131920 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1170be5-e9c7-4b4f-a50f-0f4c4d2c58b2 None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:29.132842 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1170be5-e9c7-4b4f-a50f-0f4c4d2c58b2 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:29.133349 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1170be5-e9c7-4b4f-a50f-0f4c4d2c58b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:29.135063 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1170be5-e9c7-4b4f-a50f-0f4c4d2c58b2 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:29.144787 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e831302e-6464-445d-9b22-14f8a290c5ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:29.144787 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e831302e-6464-445d-9b22-14f8a290c5ef None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:29.144787 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e831302e-6464-445d-9b22-14f8a290c5ef None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:29.144787 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e831302e-6464-445d-9b22-14f8a290c5ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:29.145397 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 349/700] 10.222.0.36 () {56 vars in 1124 bytes} [Tue Aug 9 10:11:28 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:29.146456 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1170be5-e9c7-4b4f-a50f-0f4c4d2c58b2 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:29.170684 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:29.226559 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e831302e-6464-445d-9b22-14f8a290c5ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:29.228000 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e831302e-6464-445d-9b22-14f8a290c5ef None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:29.259088 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1170be5-e9c7-4b4f-a50f-0f4c4d2c58b2 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:29.262283 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:29.296965 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d041116a-4cc0-4eab-8a99-8ff3d0996b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:29.297569 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d041116a-4cc0-4eab-8a99-8ff3d0996b66 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:29.297867 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d041116a-4cc0-4eab-8a99-8ff3d0996b66 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:29.298145 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d041116a-4cc0-4eab-8a99-8ff3d0996b66 None admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:29.298839 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d041116a-4cc0-4eab-8a99-8ff3d0996b66 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:29.299143 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d041116a-4cc0-4eab-8a99-8ff3d0996b66 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:29.300575 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d041116a-4cc0-4eab-8a99-8ff3d0996b66 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:29.313280 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 350/701] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Aug 9 10:11:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:29.314145 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d041116a-4cc0-4eab-8a99-8ff3d0996b66 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:29.353099 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 352/702] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Aug 9 10:11:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 09 10:11:29.354156 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e831302e-6464-445d-9b22-14f8a290c5ef None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:29.425288 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:29.446684 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d041116a-4cc0-4eab-8a99-8ff3d0996b66 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:29.463090 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e831302e-6464-445d-9b22-14f8a290c5ef None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:29.477278 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:29.486326 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da669663-aa74-41c5-8858-1507ac8c42c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:29.487253 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da669663-aa74-41c5-8858-1507ac8c42c3 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:29.487675 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da669663-aa74-41c5-8858-1507ac8c42c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:29.488087 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da669663-aa74-41c5-8858-1507ac8c42c3 None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:29.488888 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da669663-aa74-41c5-8858-1507ac8c42c3 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:29.489345 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da669663-aa74-41c5-8858-1507ac8c42c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:29.491115 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da669663-aa74-41c5-8858-1507ac8c42c3 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:29.498287 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 351/703] 10.222.0.36 () {56 vars in 1124 bytes} [Tue Aug 9 10:11:29 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:29.499341 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da669663-aa74-41c5-8858-1507ac8c42c3 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:29.501648 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f09dc9-9331-4e6b-b1b4-8827df6e92de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:29.502400 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f09dc9-9331-4e6b-b1b4-8827df6e92de None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:29.502684 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f09dc9-9331-4e6b-b1b4-8827df6e92de None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:29.502955 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f09dc9-9331-4e6b-b1b4-8827df6e92de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:29.504484 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f09dc9-9331-4e6b-b1b4-8827df6e92de None admin] RBAC: Adding query filter params (role.id=1252647548644b48900ef09f1df438fd, scope.project.id=28891cf6239a43469326a864fb0d216c, user.id=841c5dbaae774944b637c533ebd75b29) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:29.504484 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f09dc9-9331-4e6b-b1b4-8827df6e92de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:29.505581 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f09dc9-9331-4e6b-b1b4-8827df6e92de None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:29.513782 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 353/704] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Aug 9 10:11:29 2022] GET /identity/v3/role_assignments?user.id=841c5dbaae774944b637c533ebd75b29&scope.project.id=28891cf6239a43469326a864fb0d216c&role.id=1252647548644b48900ef09f1df438fd => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:29.623059 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da669663-aa74-41c5-8858-1507ac8c42c3 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:29.663126 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e293e668-059d-4385-98c0-027ad3a913f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:29.664032 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e293e668-059d-4385-98c0-027ad3a913f1 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:29.664486 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e293e668-059d-4385-98c0-027ad3a913f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:29.664914 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e293e668-059d-4385-98c0-027ad3a913f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:29.681421 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e293e668-059d-4385-98c0-027ad3a913f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:29.683724 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e293e668-059d-4385-98c0-027ad3a913f1 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:29.691402 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:29.707366 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-e293e668-059d-4385-98c0-027ad3a913f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:29.707366 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:29.707366 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:29.707366 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:29.707366 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:29.707366 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:29.707366 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:29.707366 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:29.707366 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:29.707366 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:29.707366 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:29.707366 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:29.707366 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 10:11:29.707366 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 10:11:29.707366 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 10:11:29.707366 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 10:11:29.708389 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:29.708389 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:29.708389 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:29.708389 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:29.708389 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:29.708389 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:29.708389 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:29.708389 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:29.708389 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:29.708389 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:29.708389 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:29.708389 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:29.708389 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:29.708389 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:29.708389 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:29.708389 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:29.708389 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 10:11:29.709277 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 10:11:29.709277 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:29.709277 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:29.709277 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 352/705] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:11:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:29.715667 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f09dc9-9331-4e6b-b1b4-8827df6e92de None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:29.832417 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f09dc9-9331-4e6b-b1b4-8827df6e92de None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:29.871389 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6524517c-913a-4d0e-b70f-44bec02018a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:29.872047 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6524517c-913a-4d0e-b70f-44bec02018a2 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:29.872335 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6524517c-913a-4d0e-b70f-44bec02018a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:29.872580 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6524517c-913a-4d0e-b70f-44bec02018a2 None admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:29.873272 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6524517c-913a-4d0e-b70f-44bec02018a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:29.873514 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6524517c-913a-4d0e-b70f-44bec02018a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:29.874900 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6524517c-913a-4d0e-b70f-44bec02018a2 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:29.887806 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 354/706] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Aug 9 10:11:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:29.893365 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e293e668-059d-4385-98c0-027ad3a913f1 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:30.007403 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e293e668-059d-4385-98c0-027ad3a913f1 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:30.044688 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950c848f-c70c-4402-87fd-fc86a0fc9feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:30.045339 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950c848f-c70c-4402-87fd-fc86a0fc9feb None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:30.045598 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950c848f-c70c-4402-87fd-fc86a0fc9feb None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:30.045899 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950c848f-c70c-4402-87fd-fc86a0fc9feb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:30.052946 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950c848f-c70c-4402-87fd-fc86a0fc9feb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:30.054536 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950c848f-c70c-4402-87fd-fc86a0fc9feb None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:30.066556 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-950c848f-c70c-4402-87fd-fc86a0fc9feb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 10:11:30.066556 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:30.066556 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:30.066556 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:30.066556 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:30.066556 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:30.066556 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:30.066556 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:30.066556 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:30.066556 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:30.066556 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:30.066556 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:30.066556 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 10:11:30.066556 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 10:11:30.066556 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 10:11:30.067483 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 10:11:30.067483 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:30.067483 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:30.067483 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:30.067483 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:30.067483 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:30.067483 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:30.067483 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:30.067483 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:30.067483 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:30.067483 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:30.067483 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:30.067483 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:30.067483 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:30.067483 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:30.067483 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:30.067483 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:30.068358 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 10:11:30.068358 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 10:11:30.068358 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 10:11:30.068358 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 10:11:30.068358 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 10:11:30.068358 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 10:11:30.068358 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 10:11:30.068358 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:30.068358 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 353/707] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Aug 9 10:11:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:30.073599 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6524517c-913a-4d0e-b70f-44bec02018a2 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:30.126944 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:30.221896 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6524517c-913a-4d0e-b70f-44bec02018a2 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:30.259225 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a716a7-65fb-4ba6-8d9b-905423edafb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:30.260210 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a716a7-65fb-4ba6-8d9b-905423edafb1 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:30.260712 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a716a7-65fb-4ba6-8d9b-905423edafb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:30.261704 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a716a7-65fb-4ba6-8d9b-905423edafb1 None admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:30.263132 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a716a7-65fb-4ba6-8d9b-905423edafb1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:30.263644 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a716a7-65fb-4ba6-8d9b-905423edafb1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:30.265262 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a716a7-65fb-4ba6-8d9b-905423edafb1 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:30.278751 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 355/708] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Aug 9 10:11:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:30.285908 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950c848f-c70c-4402-87fd-fc86a0fc9feb None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:30.371990 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea76f746-2ca3-4fbb-b799-64dddcf4a670 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:30.372934 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea76f746-2ca3-4fbb-b799-64dddcf4a670 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:30.373434 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea76f746-2ca3-4fbb-b799-64dddcf4a670 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:30.375342 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 356/709] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:11:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:11:30.380136 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:30.385737 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a58e7c5-a07e-4955-ac08-c093d5141144 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:30.386052 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a58e7c5-a07e-4955-ac08-c093d5141144 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:30.387306 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a58e7c5-a07e-4955-ac08-c093d5141144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:30.421776 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-7a58e7c5-a07e-4955-ac08-c093d5141144 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:11:30.423000 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-7a58e7c5-a07e-4955-ac08-c093d5141144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:11:30.435772 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950c848f-c70c-4402-87fd-fc86a0fc9feb None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:30.481672 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e288e7-870e-47f8-b7ee-8dc45b7458bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:30.482308 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e288e7-870e-47f8-b7ee-8dc45b7458bb None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:30.482588 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e288e7-870e-47f8-b7ee-8dc45b7458bb None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:30.482859 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e288e7-870e-47f8-b7ee-8dc45b7458bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:30.484212 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e288e7-870e-47f8-b7ee-8dc45b7458bb None admin] RBAC: Adding query filter params (role.id=89ca30cbbb634be8a96e9921aa56626b, scope.project.id=28891cf6239a43469326a864fb0d216c, user.id=eb863beaaa9f495c8b64655996c061f2) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:30.484526 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e288e7-870e-47f8-b7ee-8dc45b7458bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:30.486504 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e288e7-870e-47f8-b7ee-8dc45b7458bb None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:30.495025 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 354/710] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Aug 9 10:11:30 2022] GET /identity/v3/role_assignments?user.id=eb863beaaa9f495c8b64655996c061f2&scope.project.id=28891cf6239a43469326a864fb0d216c&role.id=89ca30cbbb634be8a96e9921aa56626b => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:30.497090 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a326112-cdbd-44b5-b724-e0a69476c2e0 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:30.497413 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a326112-cdbd-44b5-b724-e0a69476c2e0 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:30.497734 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a326112-cdbd-44b5-b724-e0a69476c2e0 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:30.505907 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 355/711] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:11:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:11:30.507544 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 357/712] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:11:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 10:11:30.508095 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3988aa36-5269-43bc-9ea9-b682033ecd63 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:30.508520 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3988aa36-5269-43bc-9ea9-b682033ecd63 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:30.508951 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3988aa36-5269-43bc-9ea9-b682033ecd63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:30.529762 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-3988aa36-5269-43bc-9ea9-b682033ecd63 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:11:30.531370 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-3988aa36-5269-43bc-9ea9-b682033ecd63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:11:30.557480 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a58e7c5-a07e-4955-ac08-c093d5141144 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:30.623239 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:30.654400 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 356/713] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:11:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 10:11:30.719825 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3988aa36-5269-43bc-9ea9-b682033ecd63 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:30.739882 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a58e7c5-a07e-4955-ac08-c093d5141144 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:30.780640 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b87968f-fc8d-4da6-b3e6-369c1d1a698d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:30.781274 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b87968f-fc8d-4da6-b3e6-369c1d1a698d None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:30.781554 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b87968f-fc8d-4da6-b3e6-369c1d1a698d None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:30.781823 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b87968f-fc8d-4da6-b3e6-369c1d1a698d None admin] PATH_INFO: `/v3/services/network` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:30.782581 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b87968f-fc8d-4da6-b3e6-369c1d1a698d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:30.783991 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b87968f-fc8d-4da6-b3e6-369c1d1a698d None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:30.795169 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-5b87968f-fc8d-4da6-b3e6-369c1d1a698d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 09 10:11:30.795169 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:30.795169 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 10:11:30.795169 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 10:11:30.795169 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 10:11:30.795169 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 10:11:30.795169 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 10:11:30.795169 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 10:11:30.795169 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 09 10:11:30.795169 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:11:30.795169 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 10:11:30.795169 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:11:30.795169 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:30.795169 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:30.795169 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:30.795169 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:30.795169 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:30.796152 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:30.796152 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:30.796152 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:30.796152 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:30.796152 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:30.796152 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:30.796152 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 10:11:30.796152 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 10:11:30.796152 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 10:11:30.796152 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 10:11:30.796152 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:30.796152 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:30.796152 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:30.796152 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:30.796152 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:30.796152 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:30.797081 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:30.797081 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:30.797081 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:30.797081 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:30.797081 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:30.797081 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:30.797081 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:30.797081 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:30.797081 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:30.797081 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:30.797081 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 10:11:30.797081 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 10:11:30.797081 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 09 10:11:30.797081 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:11:30.797081 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 358/714] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Aug 9 10:11:30 2022] GET /identity/v3/services/network => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:30.806524 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b87968f-fc8d-4da6-b3e6-369c1d1a698d None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:30.812118 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:30.897050 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3988aa36-5269-43bc-9ea9-b682033ecd63 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:30.967490 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c23512-4c7a-4130-9130-cdfe5598954c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:30.968494 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c23512-4c7a-4130-9130-cdfe5598954c None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:30.969004 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c23512-4c7a-4130-9130-cdfe5598954c None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:30.969471 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c23512-4c7a-4130-9130-cdfe5598954c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:30.983750 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:30.987069 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c23512-4c7a-4130-9130-cdfe5598954c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:30.988921 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c23512-4c7a-4130-9130-cdfe5598954c None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:31.003802 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b87968f-fc8d-4da6-b3e6-369c1d1a698d None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:31.019728 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-06c23512-4c7a-4130-9130-cdfe5598954c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:31.019728 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:31.019728 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:31.019728 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:31.019728 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:31.019728 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:31.019728 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:31.019728 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:31.019728 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:31.019728 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:31.019728 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:31.019728 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:31.019728 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 10:11:31.019728 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 10:11:31.019728 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 10:11:31.019728 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 10:11:31.020703 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:31.020703 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:31.020703 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:31.020703 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:31.020703 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:31.020703 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:31.020703 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:31.020703 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:31.020703 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:31.020703 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:31.020703 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:31.020703 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:31.020703 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:31.020703 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:31.020703 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:31.020703 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:31.020703 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 10:11:31.021583 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 10:11:31.021583 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:31.021583 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:31.024980 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 357/715] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:11:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 10:11:31.031115 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c23512-4c7a-4130-9130-cdfe5598954c None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:31.073443 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e7cb76-b990-4ed3-ba36-44aa8f2735ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:31.074769 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e7cb76-b990-4ed3-ba36-44aa8f2735ea None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:31.075058 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e7cb76-b990-4ed3-ba36-44aa8f2735ea None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:31.075329 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e7cb76-b990-4ed3-ba36-44aa8f2735ea None admin] PATH_INFO: `/v3/services` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:31.076077 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e7cb76-b990-4ed3-ba36-44aa8f2735ea None admin] RBAC: Adding query filter params (name=network) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:31.076386 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e7cb76-b990-4ed3-ba36-44aa8f2735ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:31.077818 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e7cb76-b990-4ed3-ba36-44aa8f2735ea None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:31.093873 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 359/716] 10.222.0.36 () {56 vars in 1112 bytes} [Tue Aug 9 10:11:30 2022] GET /identity/v3/services?name=network => generated 124 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:11:31.097159 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e7cb76-b990-4ed3-ba36-44aa8f2735ea None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:31.204067 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e7cb76-b990-4ed3-ba36-44aa8f2735ea None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:31.234837 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c23512-4c7a-4130-9130-cdfe5598954c None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:31.241868 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:31.242818 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f1d876-b709-4c52-a530-03e47a7d9de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:31.243452 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f1d876-b709-4c52-a530-03e47a7d9de2 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:31.243736 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f1d876-b709-4c52-a530-03e47a7d9de2 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:31.244008 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f1d876-b709-4c52-a530-03e47a7d9de2 None admin] PATH_INFO: `/v3/services` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:31.244654 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f1d876-b709-4c52-a530-03e47a7d9de2 None admin] RBAC: Adding query filter params (type=network) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:31.244977 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f1d876-b709-4c52-a530-03e47a7d9de2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:31.246460 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f1d876-b709-4c52-a530-03e47a7d9de2 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:31.252880 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 360/717] 10.222.0.36 () {56 vars in 1112 bytes} [Tue Aug 9 10:11:31 2022] GET /identity/v3/services?type=network => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:11:31.297317 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248e7ce7-7b3e-4a58-9558-4802244d718e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:31.297962 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248e7ce7-7b3e-4a58-9558-4802244d718e None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:31.298247 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248e7ce7-7b3e-4a58-9558-4802244d718e None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:31.298521 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248e7ce7-7b3e-4a58-9558-4802244d718e None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:31.299182 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248e7ce7-7b3e-4a58-9558-4802244d718e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:31.299486 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248e7ce7-7b3e-4a58-9558-4802244d718e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:31.300906 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248e7ce7-7b3e-4a58-9558-4802244d718e None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:31.318471 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 358/718] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Aug 9 10:11:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:11:31.323838 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f1d876-b709-4c52-a530-03e47a7d9de2 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:31.357590 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:31.446969 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f1d876-b709-4c52-a530-03e47a7d9de2 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:31.484417 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0e56e5-c168-4d11-9ca3-4b2c7486ca0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:31.484953 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e56e5-c168-4d11-9ca3-4b2c7486ca0d None admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:31.485237 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e56e5-c168-4d11-9ca3-4b2c7486ca0d None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:31.485510 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e56e5-c168-4d11-9ca3-4b2c7486ca0d None admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:31.486184 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0e56e5-c168-4d11-9ca3-4b2c7486ca0d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:31.487624 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0e56e5-c168-4d11-9ca3-4b2c7486ca0d None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:31.518026 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 361/719] 10.222.0.36 () {60 vars in 1132 bytes} [Tue Aug 9 10:11:31 2022] POST /identity/v3/users => generated 254 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 10:11:32.080099 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fc1999-4935-414c-ae58-dd3cace1e1dc None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:32.080640 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fc1999-4935-414c-ae58-dd3cace1e1dc None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:32.080640 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fc1999-4935-414c-ae58-dd3cace1e1dc None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:32.082004 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 359/720] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:11:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:11:32.087459 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b493a0-567d-4fe2-8361-53fd93def41e None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:32.087751 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b493a0-567d-4fe2-8361-53fd93def41e None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:32.088026 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b493a0-567d-4fe2-8361-53fd93def41e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:32.108474 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-73b493a0-567d-4fe2-8361-53fd93def41e None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:11:32.109659 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-73b493a0-567d-4fe2-8361-53fd93def41e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:11:32.114680 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee0ce8-35ef-48c9-896c-58b2d9a1b00d None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:32.114962 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee0ce8-35ef-48c9-896c-58b2d9a1b00d None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:32.115234 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee0ce8-35ef-48c9-896c-58b2d9a1b00d None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:32.116798 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 360/721] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:11:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 10:11:32.121952 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a867e-d1ce-4681-9de7-0e95a7fff0ce None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:32.122239 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a867e-d1ce-4681-9de7-0e95a7fff0ce None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:32.122513 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a867e-d1ce-4681-9de7-0e95a7fff0ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:32.142803 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-d89a867e-d1ce-4681-9de7-0e95a7fff0ce None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:11:32.144314 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-d89a867e-d1ce-4681-9de7-0e95a7fff0ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:11:32.210555 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 362/722] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:11:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 10:11:32.236458 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 361/723] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:11:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 10:11:32.247051 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b493a0-567d-4fe2-8361-53fd93def41e None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:32.259267 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:32.260340 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89a867e-d1ce-4681-9de7-0e95a7fff0ce None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:32.397205 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:32.423233 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89a867e-d1ce-4681-9de7-0e95a7fff0ce None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:32.435380 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b493a0-567d-4fe2-8361-53fd93def41e None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:32.493119 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb183744-ad21-4869-a284-130a30ae86f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:32.493640 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb183744-ad21-4869-a284-130a30ae86f1 None admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:32.493940 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb183744-ad21-4869-a284-130a30ae86f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:32.494209 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb183744-ad21-4869-a284-130a30ae86f1 None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:32.494845 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb183744-ad21-4869-a284-130a30ae86f1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:32.496933 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb183744-ad21-4869-a284-130a30ae86f1 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:32.518872 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534e68a6-481d-4cd7-b115-55c50d561c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:32.519625 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534e68a6-481d-4cd7-b115-55c50d561c56 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:32.519910 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534e68a6-481d-4cd7-b115-55c50d561c56 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:32.520180 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534e68a6-481d-4cd7-b115-55c50d561c56 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:32.531959 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534e68a6-481d-4cd7-b115-55c50d561c56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 10:11:32.536895 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-534e68a6-481d-4cd7-b115-55c50d561c56 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 10:11:32.536895 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:32.536895 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:32.536895 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:32.536895 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:32.536895 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:32.536895 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:32.536895 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:32.536895 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:32.536895 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:32.536895 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:32.536895 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:32.536895 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 10:11:32.536895 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 10:11:32.536895 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 10:11:32.536895 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 10:11:32.538245 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 10:11:32.538245 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 10:11:32.538245 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 10:11:32.538245 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 10:11:32.538245 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:32.538245 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:32.538245 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:32.538245 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:32.538245 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:32.538245 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:32.538245 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:32.538245 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:32.538245 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:32.538245 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:32.538245 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:32.538245 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:32.539094 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:32.539094 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:32.539094 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:32.539094 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:32.539094 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 10:11:32.539094 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 10:11:32.539094 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 10:11:32.539094 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 10:11:32.539094 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 10:11:32.539094 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 10:11:32.539094 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 10:11:32.539094 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:11:32.540183 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 363/724] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Aug 9 10:11:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:32.548322 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534e68a6-481d-4cd7-b115-55c50d561c56 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:32.551783 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 362/725] 10.222.0.36 () {60 vars in 1141 bytes} [Tue Aug 9 10:11:32 2022] POST /identity/v3/services => generated 251 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:11:32.663533 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:32.708212 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534e68a6-481d-4cd7-b115-55c50d561c56 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:32.758100 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc90238c-71d6-404e-9ed4-7ad5983e54fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:32.758647 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc90238c-71d6-404e-9ed4-7ad5983e54fa None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:32.758925 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc90238c-71d6-404e-9ed4-7ad5983e54fa None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:32.759197 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc90238c-71d6-404e-9ed4-7ad5983e54fa None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:32.759932 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc90238c-71d6-404e-9ed4-7ad5983e54fa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:32.760239 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc90238c-71d6-404e-9ed4-7ad5983e54fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:32.762960 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc90238c-71d6-404e-9ed4-7ad5983e54fa None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:32.774790 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 364/726] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Aug 9 10:11:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:11:32.782963 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb183744-ad21-4869-a284-130a30ae86f1 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:32.889888 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c514c-b03a-4510-97ed-b03409933ebf None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:32.889888 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c514c-b03a-4510-97ed-b03409933ebf None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:32.889888 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c514c-b03a-4510-97ed-b03409933ebf None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:32.893805 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 365/727] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:11:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:11:32.894796 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb183744-ad21-4869-a284-130a30ae86f1 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:32.898179 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90beda22-bc59-4903-b003-c83298b036f6 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:32.898459 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90beda22-bc59-4903-b003-c83298b036f6 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:32.898726 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90beda22-bc59-4903-b003-c83298b036f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:32.919913 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-90beda22-bc59-4903-b003-c83298b036f6 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:11:32.921204 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-90beda22-bc59-4903-b003-c83298b036f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:11:32.929440 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f234ee6b-0355-451f-9a91-c22ee95f91eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:32.930099 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f234ee6b-0355-451f-9a91-c22ee95f91eb None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:32.930377 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f234ee6b-0355-451f-9a91-c22ee95f91eb None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:32.930645 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f234ee6b-0355-451f-9a91-c22ee95f91eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:32.943555 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f234ee6b-0355-451f-9a91-c22ee95f91eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:32.944149 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f234ee6b-0355-451f-9a91-c22ee95f91eb None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:32.960147 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-f234ee6b-0355-451f-9a91-c22ee95f91eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:32.960147 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:32.960147 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:32.960147 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:32.960147 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:32.960147 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:32.960147 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:32.960147 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:32.960147 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:32.960147 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:32.960147 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:32.960147 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:32.960147 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 10:11:32.960147 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 10:11:32.960147 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 10:11:32.960147 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 10:11:32.961133 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:32.961133 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:32.961133 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:32.961133 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:32.961133 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:32.961133 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:32.961133 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:32.961133 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:32.961133 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:32.961133 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:32.961133 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:32.961133 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:32.961133 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:32.961133 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:32.961133 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:32.961133 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:32.961133 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 10:11:32.962036 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 10:11:32.962036 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:32.962036 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:32.962036 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 363/728] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:11:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:32.970881 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f234ee6b-0355-451f-9a91-c22ee95f91eb None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:32.982188 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:33.007926 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 366/729] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:11:32 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 09 10:11:33.045767 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90beda22-bc59-4903-b003-c83298b036f6 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:33.086028 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f234ee6b-0355-451f-9a91-c22ee95f91eb None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:33.124653 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97723b5f-7674-45f5-9e0f-f651d83dd35d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:33.125286 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97723b5f-7674-45f5-9e0f-f651d83dd35d None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:33.125524 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97723b5f-7674-45f5-9e0f-f651d83dd35d None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:33.125787 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97723b5f-7674-45f5-9e0f-f651d83dd35d None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:33.126472 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97723b5f-7674-45f5-9e0f-f651d83dd35d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:33.126774 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97723b5f-7674-45f5-9e0f-f651d83dd35d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:33.128154 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97723b5f-7674-45f5-9e0f-f651d83dd35d None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:33.141222 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 364/730] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Aug 9 10:11:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:33.146571 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97723b5f-7674-45f5-9e0f-f651d83dd35d None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:33.198365 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:33.258229 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:33.291515 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90beda22-bc59-4903-b003-c83298b036f6 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:33.321712 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97723b5f-7674-45f5-9e0f-f651d83dd35d None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:33.364302 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebb8c35-48a2-4af9-96f4-8cfc81b23901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:33.365241 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebb8c35-48a2-4af9-96f4-8cfc81b23901 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:33.365661 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebb8c35-48a2-4af9-96f4-8cfc81b23901 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:33.366109 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebb8c35-48a2-4af9-96f4-8cfc81b23901 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:33.393469 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebb8c35-48a2-4af9-96f4-8cfc81b23901 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 10:11:33.399391 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-4ebb8c35-48a2-4af9-96f4-8cfc81b23901 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 10:11:33.399391 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:33.399391 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:33.399391 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:33.399391 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:33.399391 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:33.399391 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:33.399391 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:33.399391 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:33.399391 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:33.399391 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:33.399391 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:33.399391 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 10:11:33.399391 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 10:11:33.399391 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 10:11:33.399391 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 10:11:33.400323 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 10:11:33.400323 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 10:11:33.400323 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 10:11:33.400323 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 10:11:33.400323 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:33.400323 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:33.400323 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:33.400323 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:33.400323 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:33.400323 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:33.400323 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:33.400323 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:33.400323 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:33.400323 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:33.400323 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:33.400323 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:33.401140 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:33.401140 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:33.401140 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:33.401140 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:33.401140 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 10:11:33.401140 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 10:11:33.401140 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 10:11:33.401140 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 10:11:33.401140 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 10:11:33.401140 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 10:11:33.401140 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 10:11:33.401140 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:11:33.401140 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 367/731] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Aug 9 10:11:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 10:11:33.406985 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebb8c35-48a2-4af9-96f4-8cfc81b23901 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:33.416581 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6aa5fd-34b4-4ec2-84b9-7dcaa5816264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:33.417899 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6aa5fd-34b4-4ec2-84b9-7dcaa5816264 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:33.418195 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6aa5fd-34b4-4ec2-84b9-7dcaa5816264 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:33.418457 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6aa5fd-34b4-4ec2-84b9-7dcaa5816264 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:33.440942 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6aa5fd-34b4-4ec2-84b9-7dcaa5816264 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:33.442571 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6aa5fd-34b4-4ec2-84b9-7dcaa5816264 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:33.465381 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-1a6aa5fd-34b4-4ec2-84b9-7dcaa5816264 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 09 10:11:33.465381 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:33.465381 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:33.465381 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:33.465381 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:33.465381 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:33.465381 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:33.465381 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:33.465381 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:33.465381 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:33.465381 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:33.465381 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:33.465381 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 10:11:33.465381 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 10:11:33.465381 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 10:11:33.465381 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 10:11:33.466426 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:33.466426 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:33.466426 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 10:11:33.466426 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 10:11:33.466426 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 10:11:33.466426 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 10:11:33.466426 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:33.466426 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:33.466426 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:33.466426 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:33.466426 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:33.466426 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:33.466426 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:33.466426 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:33.466426 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:33.466426 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:33.466426 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:33.466426 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:33.467345 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:33.467345 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:33.467345 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 10:11:33.467345 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 10:11:33.467345 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 10:11:33.467345 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 10:11:33.467345 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 10:11:33.467345 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 10:11:33.467345 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 09 10:11:33.467345 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:33.467345 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 365/732] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Aug 9 10:11:33 2022] GET /identity/v3/users/swift => generated 83 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:33.475058 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6aa5fd-34b4-4ec2-84b9-7dcaa5816264 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:33.522649 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebb8c35-48a2-4af9-96f4-8cfc81b23901 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:33.538288 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:33.560111 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b351caad-0b5b-454c-a70e-2333928d4eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:33.561031 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b351caad-0b5b-454c-a70e-2333928d4eb1 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:33.561532 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b351caad-0b5b-454c-a70e-2333928d4eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:33.562042 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b351caad-0b5b-454c-a70e-2333928d4eb1 None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:33.562909 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b351caad-0b5b-454c-a70e-2333928d4eb1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:33.563403 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b351caad-0b5b-454c-a70e-2333928d4eb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:33.564960 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b351caad-0b5b-454c-a70e-2333928d4eb1 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:33.575126 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 368/733] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Aug 9 10:11:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:33.586783 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b351caad-0b5b-454c-a70e-2333928d4eb1 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:33.665291 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6aa5fd-34b4-4ec2-84b9-7dcaa5816264 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:33.702215 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:33.725977 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01877395-ed54-4045-b76e-faff09b443a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:33.727282 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01877395-ed54-4045-b76e-faff09b443a5 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:33.727760 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01877395-ed54-4045-b76e-faff09b443a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:33.728223 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01877395-ed54-4045-b76e-faff09b443a5 None admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:33.729146 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01877395-ed54-4045-b76e-faff09b443a5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:33.729641 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01877395-ed54-4045-b76e-faff09b443a5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:33.732369 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01877395-ed54-4045-b76e-faff09b443a5 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:33.762969 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b351caad-0b5b-454c-a70e-2333928d4eb1 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:33.765454 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 366/734] 10.222.0.36 () {56 vars in 1135 bytes} [Tue Aug 9 10:11:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:33.770977 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01877395-ed54-4045-b76e-faff09b443a5 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:33.802492 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ea7e1f-94ee-41f9-9cdc-310b075ed0d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:33.803167 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea7e1f-94ee-41f9-9cdc-310b075ed0d9 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:33.803448 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea7e1f-94ee-41f9-9cdc-310b075ed0d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:33.803716 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea7e1f-94ee-41f9-9cdc-310b075ed0d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:33.815189 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ea7e1f-94ee-41f9-9cdc-310b075ed0d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:33.816634 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ea7e1f-94ee-41f9-9cdc-310b075ed0d9 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:33.833029 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-05ea7e1f-94ee-41f9-9cdc-310b075ed0d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:33.833029 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:33.833029 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:33.833029 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:33.833029 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:33.833029 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:33.833029 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:33.833029 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:33.833029 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:33.833029 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:33.833029 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:33.833029 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:33.833029 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 10:11:33.833029 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 10:11:33.833029 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 10:11:33.833029 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 10:11:33.834026 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:33.834026 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:33.834026 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:33.834026 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:33.834026 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:33.834026 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:33.834026 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:33.834026 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:33.834026 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:33.834026 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:33.834026 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:33.834026 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:33.834026 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:33.834026 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:33.834026 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:33.834026 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:33.834026 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 10:11:33.834920 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 10:11:33.834920 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:33.834920 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:11:33.834920 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 369/735] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:11:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:33.846942 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ea7e1f-94ee-41f9-9cdc-310b075ed0d9 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:33.884846 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01877395-ed54-4045-b76e-faff09b443a5 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:33.899548 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:33.927620 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcb2c77-b883-4d4e-a1d1-29a0a65d02b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:33.929306 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb2c77-b883-4d4e-a1d1-29a0a65d02b1 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:33.930146 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb2c77-b883-4d4e-a1d1-29a0a65d02b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:33.930797 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb2c77-b883-4d4e-a1d1-29a0a65d02b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:34.013426 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:34.023149 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ea7e1f-94ee-41f9-9cdc-310b075ed0d9 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:34.033619 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcb2c77-b883-4d4e-a1d1-29a0a65d02b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:34.035600 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcb2c77-b883-4d4e-a1d1-29a0a65d02b1 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:34.062260 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ccc90d-7dfc-4ef1-b1b2-9bcc2791dee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:34.062862 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ccc90d-7dfc-4ef1-b1b2-9bcc2791dee2 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:34.063138 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ccc90d-7dfc-4ef1-b1b2-9bcc2791dee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:34.063408 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ccc90d-7dfc-4ef1-b1b2-9bcc2791dee2 None admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:34.064141 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ccc90d-7dfc-4ef1-b1b2-9bcc2791dee2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:34.064539 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ccc90d-7dfc-4ef1-b1b2-9bcc2791dee2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:34.065928 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ccc90d-7dfc-4ef1-b1b2-9bcc2791dee2 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:34.081341 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 370/736] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Aug 9 10:11:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:34.082839 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af04aa7-1b6a-40a2-aabf-129dd2bdb5b3 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:34.083174 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af04aa7-1b6a-40a2-aabf-129dd2bdb5b3 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:34.083484 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af04aa7-1b6a-40a2-aabf-129dd2bdb5b3 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:34.084924 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 371/737] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:11:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:11:34.086220 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af04aa7-1b6a-40a2-aabf-129dd2bdb5b3 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:34.150788 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 367/738] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Aug 9 10:11:33 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 09 10:11:34.152179 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db3c1a3-5e58-4ab9-a8eb-1405c62bbdeb None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:34.152469 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db3c1a3-5e58-4ab9-a8eb-1405c62bbdeb None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:34.152846 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db3c1a3-5e58-4ab9-a8eb-1405c62bbdeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:34.171921 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-2db3c1a3-5e58-4ab9-a8eb-1405c62bbdeb None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:11:34.173108 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-2db3c1a3-5e58-4ab9-a8eb-1405c62bbdeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:11:34.178244 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:34.195514 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af04aa7-1b6a-40a2-aabf-129dd2bdb5b3 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:34.232055 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de052b9-1082-424b-8020-89daab6e6096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:34.232936 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de052b9-1082-424b-8020-89daab6e6096 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:34.233308 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de052b9-1082-424b-8020-89daab6e6096 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:34.233675 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de052b9-1082-424b-8020-89daab6e6096 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:34.241345 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de052b9-1082-424b-8020-89daab6e6096 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:34.243083 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de052b9-1082-424b-8020-89daab6e6096 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:34.254113 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 368/739] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:11:34 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 09 10:11:34.254991 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db3c1a3-5e58-4ab9-a8eb-1405c62bbdeb None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:34.255624 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-4de052b9-1082-424b-8020-89daab6e6096 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 09 10:11:34.255624 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:34.255624 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:34.255624 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:34.255624 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:34.255624 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:34.255624 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:34.255624 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:34.255624 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:34.255624 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:34.255624 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:34.255624 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:34.255624 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 10:11:34.255624 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 10:11:34.255624 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 10:11:34.255624 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 10:11:34.256712 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:34.256712 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:34.256712 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 10:11:34.256712 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 10:11:34.256712 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 10:11:34.256712 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 10:11:34.256712 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:34.256712 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:34.256712 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:34.256712 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:34.256712 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:34.256712 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:34.256712 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:34.256712 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:34.256712 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:34.256712 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:34.256712 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:34.256712 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:34.258241 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:34.258241 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:34.258241 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 10:11:34.258241 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 10:11:34.258241 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 10:11:34.258241 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 10:11:34.258241 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 10:11:34.258241 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 10:11:34.258241 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 09 10:11:34.258241 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:11:34.259383 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 372/740] 10.222.0.36 () {56 vars in 1093 bytes} [Tue Aug 9 10:11:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:34.265151 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de052b9-1082-424b-8020-89daab6e6096 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:34.278902 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:34.377292 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db3c1a3-5e58-4ab9-a8eb-1405c62bbdeb None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:34.379136 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de052b9-1082-424b-8020-89daab6e6096 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:34.414312 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc93778-dbe8-4103-b773-344c61157673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:34.414945 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc93778-dbe8-4103-b773-344c61157673 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:34.415229 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc93778-dbe8-4103-b773-344c61157673 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:34.415742 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc93778-dbe8-4103-b773-344c61157673 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:34.416726 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368feae0-8dbd-4102-99a0-d0ca2241373b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:34.418297 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368feae0-8dbd-4102-99a0-d0ca2241373b None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:34.418736 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368feae0-8dbd-4102-99a0-d0ca2241373b None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:34.419202 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368feae0-8dbd-4102-99a0-d0ca2241373b None admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:34.420072 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368feae0-8dbd-4102-99a0-d0ca2241373b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:34.420581 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368feae0-8dbd-4102-99a0-d0ca2241373b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:34.422178 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368feae0-8dbd-4102-99a0-d0ca2241373b None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:34.426969 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc93778-dbe8-4103-b773-344c61157673 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:34.428408 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc93778-dbe8-4103-b773-344c61157673 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:34.445593 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-4dc93778-dbe8-4103-b773-344c61157673 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:34.445593 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:34.445593 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:34.445593 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:34.445593 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:34.445593 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:34.445593 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:34.445593 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:34.445593 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:34.445593 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:34.445593 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:34.445593 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:34.445593 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 10:11:34.445593 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 10:11:34.445593 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 10:11:34.445593 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 10:11:34.446661 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:34.446661 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:34.446661 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:34.446661 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:34.446661 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:34.446661 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:34.446661 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:34.446661 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:34.446661 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:34.446661 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:34.446661 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:34.446661 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:34.446661 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:34.446661 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:34.446661 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:34.446661 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:34.446661 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 10:11:34.447546 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 10:11:34.447546 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:34.447546 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:34.447546 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 369/741] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:11:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:34.447546 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc93778-dbe8-4103-b773-344c61157673 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:34.448583 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 373/742] 10.222.0.36 () {56 vars in 1133 bytes} [Tue Aug 9 10:11:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:34.449787 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368feae0-8dbd-4102-99a0-d0ca2241373b None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:34.453910 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:34.514027 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:34.555063 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368feae0-8dbd-4102-99a0-d0ca2241373b None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:34.555592 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc93778-dbe8-4103-b773-344c61157673 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:34.592317 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a8c1d6-0d3d-4288-9664-09ffb8eb5bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:34.592647 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796feec0-0fa9-40a7-8de5-59cc9d6ea75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:34.592911 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8c1d6-0d3d-4288-9664-09ffb8eb5bef None admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:34.593188 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8c1d6-0d3d-4288-9664-09ffb8eb5bef None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:34.593452 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8c1d6-0d3d-4288-9664-09ffb8eb5bef None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:34.594083 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796feec0-0fa9-40a7-8de5-59cc9d6ea75e None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:34.594207 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a8c1d6-0d3d-4288-9664-09ffb8eb5bef None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:34.594696 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796feec0-0fa9-40a7-8de5-59cc9d6ea75e None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:34.595143 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796feec0-0fa9-40a7-8de5-59cc9d6ea75e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:34.595455 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a8c1d6-0d3d-4288-9664-09ffb8eb5bef None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:34.607588 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796feec0-0fa9-40a7-8de5-59cc9d6ea75e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:34.609326 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796feec0-0fa9-40a7-8de5-59cc9d6ea75e None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:34.610115 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 370/743] 10.222.0.36 () {60 vars in 1141 bytes} [Tue Aug 9 10:11:34 2022] POST /identity/v3/services => generated 240 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:11:34.610899 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a8c1d6-0d3d-4288-9664-09ffb8eb5bef None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:34.636988 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-796feec0-0fa9-40a7-8de5-59cc9d6ea75e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:34.636988 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:34.636988 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:34.636988 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:34.636988 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:34.636988 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:34.636988 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:34.636988 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:34.636988 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:34.636988 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:34.636988 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:34.636988 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:34.636988 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 10:11:34.636988 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 10:11:34.636988 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 10:11:34.636988 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 10:11:34.638355 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:34.638355 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:34.638355 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:34.638355 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:34.638355 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:34.638355 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:34.638355 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:34.638355 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:34.638355 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:34.638355 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:34.638355 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:34.638355 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:34.638355 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:34.638355 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:34.638355 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:34.638355 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:34.638355 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 10:11:34.639477 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 10:11:34.639477 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:34.639477 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:11:34.646195 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 374/744] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:11:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:34.648064 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e44fc-33ce-4505-bbce-12e64a4680cc None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:34.648603 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e44fc-33ce-4505-bbce-12e64a4680cc None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:34.649025 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e44fc-33ce-4505-bbce-12e64a4680cc None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:34.650952 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 375/745] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:11:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:11:34.652022 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324e44fc-33ce-4505-bbce-12e64a4680cc None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:34.722065 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:34.744454 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a8c1d6-0d3d-4288-9664-09ffb8eb5bef None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:34.768288 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:34.780823 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324e44fc-33ce-4505-bbce-12e64a4680cc None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:34.789278 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eefd935-b8a4-421f-ad20-79eb600adba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:34.789932 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eefd935-b8a4-421f-ad20-79eb600adba4 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:34.790198 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eefd935-b8a4-421f-ad20-79eb600adba4 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:34.790718 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eefd935-b8a4-421f-ad20-79eb600adba4 None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:34.791365 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eefd935-b8a4-421f-ad20-79eb600adba4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:34.791662 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eefd935-b8a4-421f-ad20-79eb600adba4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:34.793596 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eefd935-b8a4-421f-ad20-79eb600adba4 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:34.807743 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 371/746] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Aug 9 10:11:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:34.809759 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc09cd7-710f-4328-b31b-3090291c0958 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:34.810213 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc09cd7-710f-4328-b31b-3090291c0958 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:34.811429 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc09cd7-710f-4328-b31b-3090291c0958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:34.833631 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-5fc09cd7-710f-4328-b31b-3090291c0958 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:11:34.835280 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-5fc09cd7-710f-4328-b31b-3090291c0958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:11:34.841636 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ee58e5-c330-49fd-80af-633b0f4e4f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:34.842295 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee58e5-c330-49fd-80af-633b0f4e4f28 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:34.842617 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee58e5-c330-49fd-80af-633b0f4e4f28 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:34.842902 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee58e5-c330-49fd-80af-633b0f4e4f28 None admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:34.844014 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ee58e5-c330-49fd-80af-633b0f4e4f28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:34.844321 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ee58e5-c330-49fd-80af-633b0f4e4f28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:34.846141 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ee58e5-c330-49fd-80af-633b0f4e4f28 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:34.861024 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 376/747] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Aug 9 10:11:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:34.861875 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ee58e5-c330-49fd-80af-633b0f4e4f28 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:34.988712 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ee58e5-c330-49fd-80af-633b0f4e4f28 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:35.007247 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:35.027578 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897b638d-d804-494d-937b-4c3f64fbaebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:35.028206 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b638d-d804-494d-937b-4c3f64fbaebc None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:35.028479 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b638d-d804-494d-937b-4c3f64fbaebc None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:35.028745 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b638d-d804-494d-937b-4c3f64fbaebc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:35.036412 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897b638d-d804-494d-937b-4c3f64fbaebc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:35.037705 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897b638d-d804-494d-937b-4c3f64fbaebc None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:35.050225 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-897b638d-d804-494d-937b-4c3f64fbaebc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 10:11:35.050225 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:35.050225 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:35.050225 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:35.050225 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:35.050225 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:35.050225 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:35.050225 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:35.050225 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:35.050225 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:35.050225 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:35.050225 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:35.050225 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 10:11:35.050225 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 10:11:35.050225 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 10:11:35.051312 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 10:11:35.051312 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:35.051312 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:35.051312 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:35.051312 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:35.051312 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:35.051312 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:35.051312 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:35.051312 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:35.051312 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:35.051312 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:35.051312 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:35.051312 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:35.051312 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:35.051312 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:35.051312 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:35.051312 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:35.052378 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 10:11:35.052378 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 10:11:35.052378 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 10:11:35.052378 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 10:11:35.052378 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 10:11:35.052378 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 10:11:35.052378 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 10:11:35.052378 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:11:35.052378 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 377/748] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Aug 9 10:11:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:35.052378 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897b638d-d804-494d-937b-4c3f64fbaebc None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:35.061918 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 372/749] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:11:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 10:11:35.061918 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e0310-9554-479a-8de3-15e149425ee9 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:35.061918 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e0310-9554-479a-8de3-15e149425ee9 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:35.061918 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e0310-9554-479a-8de3-15e149425ee9 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:35.061918 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 373/750] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:11:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:11:35.066000 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52e0310-9554-479a-8de3-15e149425ee9 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:35.168744 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897b638d-d804-494d-937b-4c3f64fbaebc None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:35.171888 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52e0310-9554-479a-8de3-15e149425ee9 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:35.182767 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:35.205814 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ff9942-25b7-4f87-901a-a88a8dc1d8f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:35.206380 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff9942-25b7-4f87-901a-a88a8dc1d8f2 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:35.206671 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff9942-25b7-4f87-901a-a88a8dc1d8f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:35.206926 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff9942-25b7-4f87-901a-a88a8dc1d8f2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:35.208211 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee219e0e-2dd6-44b0-bbe8-14e9daa02829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:35.209132 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee219e0e-2dd6-44b0-bbe8-14e9daa02829 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:35.209672 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee219e0e-2dd6-44b0-bbe8-14e9daa02829 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:35.210170 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee219e0e-2dd6-44b0-bbe8-14e9daa02829 None admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:35.211070 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee219e0e-2dd6-44b0-bbe8-14e9daa02829 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:35.211573 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee219e0e-2dd6-44b0-bbe8-14e9daa02829 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:35.213222 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee219e0e-2dd6-44b0-bbe8-14e9daa02829 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:35.213484 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ff9942-25b7-4f87-901a-a88a8dc1d8f2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:35.215688 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ff9942-25b7-4f87-901a-a88a8dc1d8f2 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:35.226114 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 374/751] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Aug 9 10:11:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:35.227322 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609f0023-a0e4-4adf-b87d-e3195014064d None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:35.227608 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609f0023-a0e4-4adf-b87d-e3195014064d None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:35.227882 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609f0023-a0e4-4adf-b87d-e3195014064d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:35.228782 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-97ff9942-25b7-4f87-901a-a88a8dc1d8f2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 10:11:35.228782 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:35.228782 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:35.228782 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:35.228782 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:35.228782 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:35.228782 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:35.228782 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:35.228782 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:35.228782 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:35.228782 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:35.228782 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:35.228782 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 10:11:35.228782 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 10:11:35.228782 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 10:11:35.229642 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 10:11:35.229642 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:35.229642 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:35.229642 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:35.229642 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:35.229642 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:35.229642 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:35.229642 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:35.229642 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:35.229642 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:35.229642 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:35.229642 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:35.229642 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:35.229642 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:35.229642 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:35.229642 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:35.229642 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:35.231416 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 10:11:35.231416 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 10:11:35.231416 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 10:11:35.231416 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 10:11:35.231416 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 10:11:35.231416 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 10:11:35.231416 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 10:11:35.231416 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:11:35.233160 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 378/752] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Aug 9 10:11:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:35.234097 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ff9942-25b7-4f87-901a-a88a8dc1d8f2 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:35.251177 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-609f0023-a0e4-4adf-b87d-e3195014064d None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:11:35.252444 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-609f0023-a0e4-4adf-b87d-e3195014064d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:11:35.275586 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:35.323566 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 375/753] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:11:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 10:11:35.324765 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609f0023-a0e4-4adf-b87d-e3195014064d None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:35.352489 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ff9942-25b7-4f87-901a-a88a8dc1d8f2 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:35.387731 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782dfd56-2e3a-43a4-95af-5c0a666542ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:35.388358 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782dfd56-2e3a-43a4-95af-5c0a666542ff None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:35.388636 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782dfd56-2e3a-43a4-95af-5c0a666542ff None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:35.388900 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782dfd56-2e3a-43a4-95af-5c0a666542ff None admin] PATH_INFO: `/v3/roles/service` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:35.399245 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782dfd56-2e3a-43a4-95af-5c0a666542ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 10:11:35.405028 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-782dfd56-2e3a-43a4-95af-5c0a666542ff None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 10:11:35.405028 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:35.405028 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:35.405028 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:35.405028 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:35.405028 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:35.405028 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:35.405028 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:35.405028 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:35.405028 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:35.405028 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:35.405028 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:35.405028 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 10:11:35.405028 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 10:11:35.405028 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 10:11:35.405028 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 10:11:35.406020 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 10:11:35.406020 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 10:11:35.406020 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 10:11:35.406020 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 10:11:35.406020 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:35.406020 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:35.406020 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:35.406020 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:35.406020 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:35.406020 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:35.406020 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:35.406020 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:35.406020 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:35.406020 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:35.406020 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:35.406020 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:35.406854 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:35.406854 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:35.406854 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:35.406854 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:35.406854 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 10:11:35.406854 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 10:11:35.406854 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 10:11:35.406854 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 10:11:35.406854 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 10:11:35.406854 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 10:11:35.406854 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 10:11:35.406854 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:11:35.406854 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 379/754] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Aug 9 10:11:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:35.407554 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782dfd56-2e3a-43a4-95af-5c0a666542ff None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:35.450381 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:35.454129 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609f0023-a0e4-4adf-b87d-e3195014064d None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:35.492068 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6772808-401f-4e68-9f84-b660cb32f521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:35.492578 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6772808-401f-4e68-9f84-b660cb32f521 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:35.492895 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6772808-401f-4e68-9f84-b660cb32f521 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:35.493167 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6772808-401f-4e68-9f84-b660cb32f521 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:35.493913 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6772808-401f-4e68-9f84-b660cb32f521 None admin] RBAC: Adding query filter params (role.id=89ca30cbbb634be8a96e9921aa56626b, scope.project.id=28891cf6239a43469326a864fb0d216c, user.id=841c5dbaae774944b637c533ebd75b29) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:35.494224 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6772808-401f-4e68-9f84-b660cb32f521 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:35.495701 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6772808-401f-4e68-9f84-b660cb32f521 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:35.501180 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 376/755] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Aug 9 10:11:35 2022] GET /identity/v3/role_assignments?user.id=841c5dbaae774944b637c533ebd75b29&scope.project.id=28891cf6239a43469326a864fb0d216c&role.id=89ca30cbbb634be8a96e9921aa56626b => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:35.501767 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6772808-401f-4e68-9f84-b660cb32f521 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:35.518381 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:35.529141 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782dfd56-2e3a-43a4-95af-5c0a666542ff None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:35.570146 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20c02b6-41cd-46b5-96fb-bbd6b5060db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:35.571050 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20c02b6-41cd-46b5-96fb-bbd6b5060db1 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:35.571349 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20c02b6-41cd-46b5-96fb-bbd6b5060db1 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:35.571681 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20c02b6-41cd-46b5-96fb-bbd6b5060db1 None admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:35.572511 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20c02b6-41cd-46b5-96fb-bbd6b5060db1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:35.572965 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20c02b6-41cd-46b5-96fb-bbd6b5060db1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:35.575893 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20c02b6-41cd-46b5-96fb-bbd6b5060db1 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:35.591494 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 380/756] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Aug 9 10:11:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:35.592370 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20c02b6-41cd-46b5-96fb-bbd6b5060db1 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:35.646495 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6772808-401f-4e68-9f84-b660cb32f521 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:35.696721 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2b08bf-df93-4eb1-af49-1d49d9e3f553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:35.697504 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b08bf-df93-4eb1-af49-1d49d9e3f553 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:35.697950 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b08bf-df93-4eb1-af49-1d49d9e3f553 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:35.698226 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b08bf-df93-4eb1-af49-1d49d9e3f553 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:35.699616 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2b08bf-df93-4eb1-af49-1d49d9e3f553 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:35.701698 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2b08bf-df93-4eb1-af49-1d49d9e3f553 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:35.709357 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20c02b6-41cd-46b5-96fb-bbd6b5060db1 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:35.716969 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-9a2b08bf-df93-4eb1-af49-1d49d9e3f553 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 09 10:11:35.716969 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:35.716969 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 10:11:35.716969 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 10:11:35.716969 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 10:11:35.716969 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 10:11:35.716969 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 10:11:35.716969 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 10:11:35.716969 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 09 10:11:35.716969 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:35.716969 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 10:11:35.716969 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:35.716969 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:35.716969 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:35.716969 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:35.716969 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:35.716969 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:35.717978 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:35.717978 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:35.717978 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:35.717978 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:35.717978 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:35.717978 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:35.717978 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 10:11:35.717978 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 10:11:35.717978 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 10:11:35.717978 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 10:11:35.717978 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:35.717978 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:35.717978 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:35.717978 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:35.717978 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:35.717978 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:35.718806 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:35.718806 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:35.718806 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:35.718806 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:35.718806 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:35.718806 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:35.718806 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:35.718806 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:35.718806 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:35.718806 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:35.718806 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 10:11:35.718806 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 10:11:35.718806 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 09 10:11:35.718806 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:35.719622 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 377/757] 10.222.0.36 () {56 vars in 1129 bytes} [Tue Aug 9 10:11:35 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:35.720577 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2b08bf-df93-4eb1-af49-1d49d9e3f553 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:35.747424 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246a8115-c43d-40a4-af59-c3c17a393850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:35.748112 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a8115-c43d-40a4-af59-c3c17a393850 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:35.748514 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a8115-c43d-40a4-af59-c3c17a393850 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:35.748889 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a8115-c43d-40a4-af59-c3c17a393850 None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:35.749641 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246a8115-c43d-40a4-af59-c3c17a393850 None admin] RBAC: Adding query filter params (name=service) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:35.750064 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246a8115-c43d-40a4-af59-c3c17a393850 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:35.751507 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246a8115-c43d-40a4-af59-c3c17a393850 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:35.756611 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:35.761685 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 381/758] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Aug 9 10:11:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:35.767023 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246a8115-c43d-40a4-af59-c3c17a393850 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:35.787634 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:35.861670 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2b08bf-df93-4eb1-af49-1d49d9e3f553 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:35.895339 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246a8115-c43d-40a4-af59-c3c17a393850 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:35.902908 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6f359b-caa1-48ee-8580-1f047c6adf15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:35.903625 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f359b-caa1-48ee-8580-1f047c6adf15 None admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:35.903970 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f359b-caa1-48ee-8580-1f047c6adf15 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:35.904316 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f359b-caa1-48ee-8580-1f047c6adf15 None admin] PATH_INFO: `/v3/projects/28891cf6239a43469326a864fb0d216c/users/eb863beaaa9f495c8b64655996c061f2/roles/89ca30cbbb634be8a96e9921aa56626b` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:35.906394 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6f359b-caa1-48ee-8580-1f047c6adf15 None admin] RBAC: Authorizing `identity:create_grant(project_id=28891cf6239a43469326a864fb0d216c, user_id=eb863beaaa9f495c8b64655996c061f2, role_id=89ca30cbbb634be8a96e9921aa56626b)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:35.908117 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6f359b-caa1-48ee-8580-1f047c6adf15 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:35.925931 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 378/759] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Aug 9 10:11:35 2022] PUT /identity/v3/projects/28891cf6239a43469326a864fb0d216c/users/eb863beaaa9f495c8b64655996c061f2/roles/89ca30cbbb634be8a96e9921aa56626b => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:11:35.927302 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6f359b-caa1-48ee-8580-1f047c6adf15 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:35.938904 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32970b11-4bc6-41a0-97d0-975ff5576a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:35.939778 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32970b11-4bc6-41a0-97d0-975ff5576a6c None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:35.940233 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32970b11-4bc6-41a0-97d0-975ff5576a6c None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:35.940669 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32970b11-4bc6-41a0-97d0-975ff5576a6c None admin] PATH_INFO: `/v3/services` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:35.941648 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32970b11-4bc6-41a0-97d0-975ff5576a6c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:35.942170 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32970b11-4bc6-41a0-97d0-975ff5576a6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:35.943838 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32970b11-4bc6-41a0-97d0-975ff5576a6c None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:35.950454 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 382/760] 10.222.0.36 () {56 vars in 1124 bytes} [Tue Aug 9 10:11:35 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:35.960258 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32970b11-4bc6-41a0-97d0-975ff5576a6c None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:36.050618 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:36.064504 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6f359b-caa1-48ee-8580-1f047c6adf15 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:36.107176 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1814d3-2405-4b4f-a5e1-6f1474618d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:36.107922 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1814d3-2405-4b4f-a5e1-6f1474618d35 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:36.108271 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1814d3-2405-4b4f-a5e1-6f1474618d35 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:36.108617 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1814d3-2405-4b4f-a5e1-6f1474618d35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:36.122014 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1814d3-2405-4b4f-a5e1-6f1474618d35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:36.123584 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1814d3-2405-4b4f-a5e1-6f1474618d35 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:36.132571 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:36.144246 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-9e1814d3-2405-4b4f-a5e1-6f1474618d35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:36.144246 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:36.144246 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:36.144246 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:36.144246 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:36.144246 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:36.144246 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:36.144246 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:36.144246 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:36.144246 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:36.144246 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:36.144246 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:36.144246 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 10:11:36.144246 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 10:11:36.144246 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 10:11:36.144246 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 10:11:36.145433 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:36.145433 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:36.145433 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:36.145433 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:36.145433 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:36.145433 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:36.145433 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:36.145433 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:36.145433 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:36.145433 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:36.145433 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:36.145433 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:36.145433 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:36.145433 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:36.145433 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:36.145433 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:36.145433 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 10:11:36.146576 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 10:11:36.146576 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:36.146576 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:36.147531 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 379/761] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:11:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:36.153149 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1814d3-2405-4b4f-a5e1-6f1474618d35 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:36.154608 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32970b11-4bc6-41a0-97d0-975ff5576a6c None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:36.207957 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1805ffb9-42cd-41fb-80b9-1a74c7b47942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:36.208696 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1805ffb9-42cd-41fb-80b9-1a74c7b47942 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:36.209043 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1805ffb9-42cd-41fb-80b9-1a74c7b47942 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:36.209390 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1805ffb9-42cd-41fb-80b9-1a74c7b47942 None admin] PATH_INFO: `/v3/services` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:36.210576 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1805ffb9-42cd-41fb-80b9-1a74c7b47942 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:36.210975 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1805ffb9-42cd-41fb-80b9-1a74c7b47942 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:36.212839 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1805ffb9-42cd-41fb-80b9-1a74c7b47942 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:36.220924 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 383/762] 10.222.0.36 () {56 vars in 1124 bytes} [Tue Aug 9 10:11:35 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:36.227119 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1805ffb9-42cd-41fb-80b9-1a74c7b47942 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:36.282675 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1814d3-2405-4b4f-a5e1-6f1474618d35 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:36.327719 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dad1a0-3362-417f-a7e3-30b4d4eedf7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:36.328251 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dad1a0-3362-417f-a7e3-30b4d4eedf7e None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:36.328535 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dad1a0-3362-417f-a7e3-30b4d4eedf7e None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:36.328812 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dad1a0-3362-417f-a7e3-30b4d4eedf7e None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:36.329465 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dad1a0-3362-417f-a7e3-30b4d4eedf7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:36.329772 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dad1a0-3362-417f-a7e3-30b4d4eedf7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:36.332019 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dad1a0-3362-417f-a7e3-30b4d4eedf7e None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:36.343041 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1805ffb9-42cd-41fb-80b9-1a74c7b47942 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:36.348380 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 380/763] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Aug 9 10:11:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:11:36.348877 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:36.355757 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dad1a0-3362-417f-a7e3-30b4d4eedf7e None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:36.380108 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050c9b35-5d17-4c6f-9788-717f52cf2f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:36.380723 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c9b35-5d17-4c6f-9788-717f52cf2f40 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:36.381006 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c9b35-5d17-4c6f-9788-717f52cf2f40 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:36.381281 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c9b35-5d17-4c6f-9788-717f52cf2f40 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:36.382012 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050c9b35-5d17-4c6f-9788-717f52cf2f40 None admin] RBAC: Adding query filter params (interface=public, service_id=97fcee37ead147be8df023a555f09b67, region_id=RegionOne) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:36.382330 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050c9b35-5d17-4c6f-9788-717f52cf2f40 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:36.383755 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050c9b35-5d17-4c6f-9788-717f52cf2f40 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:36.392483 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 384/764] 10.222.0.36 () {56 vars in 1251 bytes} [Tue Aug 9 10:11:36 2022] GET /identity/v3/endpoints?service_id=97fcee37ead147be8df023a555f09b67&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:36.397810 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050c9b35-5d17-4c6f-9788-717f52cf2f40 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:36.413771 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:36.555720 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dad1a0-3362-417f-a7e3-30b4d4eedf7e None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:36.593334 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050c9b35-5d17-4c6f-9788-717f52cf2f40 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:36.622426 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fc40bc-1288-4013-91c3-a7bcc5177332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:36.623158 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc40bc-1288-4013-91c3-a7bcc5177332 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:36.623440 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc40bc-1288-4013-91c3-a7bcc5177332 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:36.623713 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc40bc-1288-4013-91c3-a7bcc5177332 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:36.631695 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fc40bc-1288-4013-91c3-a7bcc5177332 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:36.633140 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fc40bc-1288-4013-91c3-a7bcc5177332 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:36.646152 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-e0fc40bc-1288-4013-91c3-a7bcc5177332 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 09 10:11:36.646152 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:36.646152 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:36.646152 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:36.646152 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:36.646152 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:36.646152 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:36.646152 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:36.646152 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:36.646152 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:36.646152 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:36.646152 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:36.646152 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 10:11:36.646152 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 10:11:36.646152 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 10:11:36.646152 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 10:11:36.647104 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:36.647104 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:36.647104 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 10:11:36.647104 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 10:11:36.647104 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 10:11:36.647104 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 10:11:36.647104 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:36.647104 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:36.647104 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:36.647104 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:36.647104 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:36.647104 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:36.647104 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:36.647104 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:36.647104 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:36.647104 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:36.647104 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:36.647104 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:36.648084 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:36.648084 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:36.648084 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 10:11:36.648084 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 10:11:36.648084 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 10:11:36.648084 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 10:11:36.648084 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 10:11:36.648084 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 10:11:36.648084 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 09 10:11:36.648084 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:36.648084 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 381/765] 10.222.0.36 () {56 vars in 1117 bytes} [Tue Aug 9 10:11:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:36.655224 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fc40bc-1288-4013-91c3-a7bcc5177332 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:36.682096 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfb3962-f797-4cdc-8c33-cf0dce6d1a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:36.682709 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb3962-f797-4cdc-8c33-cf0dce6d1a3f None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:36.683581 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb3962-f797-4cdc-8c33-cf0dce6d1a3f None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:36.683856 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb3962-f797-4cdc-8c33-cf0dce6d1a3f None admin] PATH_INFO: `/v3/services` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:36.684472 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfb3962-f797-4cdc-8c33-cf0dce6d1a3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:36.685865 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfb3962-f797-4cdc-8c33-cf0dce6d1a3f None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:36.707366 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 385/766] 10.222.0.36 () {56 vars in 1087 bytes} [Tue Aug 9 10:11:36 2022] GET /identity/v3/services => generated 772 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:36.774308 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:36.828324 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fc40bc-1288-4013-91c3-a7bcc5177332 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:36.872285 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1f094f-3d60-4f6f-8aa6-2cc09d105289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:36.872813 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1f094f-3d60-4f6f-8aa6-2cc09d105289 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:36.873092 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1f094f-3d60-4f6f-8aa6-2cc09d105289 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:36.873362 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1f094f-3d60-4f6f-8aa6-2cc09d105289 None admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:36.874116 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1f094f-3d60-4f6f-8aa6-2cc09d105289 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:36.874420 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1f094f-3d60-4f6f-8aa6-2cc09d105289 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:36.875845 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1f094f-3d60-4f6f-8aa6-2cc09d105289 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:36.907782 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 382/767] 10.222.0.36 () {56 vars in 1149 bytes} [Tue Aug 9 10:11:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:36.913352 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfb3962-f797-4cdc-8c33-cf0dce6d1a3f None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:36.925327 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae97ba3-45a0-4730-b124-cd64fa75bb35 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:36.925652 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae97ba3-45a0-4730-b124-cd64fa75bb35 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:36.925883 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae97ba3-45a0-4730-b124-cd64fa75bb35 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:36.931627 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 383/768] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:11:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:11:36.932967 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cae484-3447-4963-9b8c-c51f932f5a04 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:36.933252 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cae484-3447-4963-9b8c-c51f932f5a04 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:36.933523 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cae484-3447-4963-9b8c-c51f932f5a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:36.975850 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-e0cae484-3447-4963-9b8c-c51f932f5a04 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:11:36.977092 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-e0cae484-3447-4963-9b8c-c51f932f5a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:11:37.048694 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:37.083638 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 384/769] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:11:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 10:11:37.095844 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfb3962-f797-4cdc-8c33-cf0dce6d1a3f None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:37.128640 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cae484-3447-4963-9b8c-c51f932f5a04 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:37.132351 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc62901c-cf5e-4f54-aa80-0841394a904c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:37.134036 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62901c-cf5e-4f54-aa80-0841394a904c None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:37.134469 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62901c-cf5e-4f54-aa80-0841394a904c None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:37.134893 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62901c-cf5e-4f54-aa80-0841394a904c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:37.195961 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:37.234352 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc62901c-cf5e-4f54-aa80-0841394a904c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:37.237532 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc62901c-cf5e-4f54-aa80-0841394a904c None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:37.277122 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cae484-3447-4963-9b8c-c51f932f5a04 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:37.346035 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343abd36-f9e3-46d1-b1fc-c7faa1b95cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:37.353872 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343abd36-f9e3-46d1-b1fc-c7faa1b95cff None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:37.353872 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343abd36-f9e3-46d1-b1fc-c7faa1b95cff None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:37.353872 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343abd36-f9e3-46d1-b1fc-c7faa1b95cff None admin] PATH_INFO: `/v3/services/network` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:37.353872 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343abd36-f9e3-46d1-b1fc-c7faa1b95cff None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:37.356957 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343abd36-f9e3-46d1-b1fc-c7faa1b95cff None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:37.392265 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-343abd36-f9e3-46d1-b1fc-c7faa1b95cff None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 09 10:11:37.392265 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:37.392265 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 10:11:37.392265 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 10:11:37.392265 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 10:11:37.392265 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 10:11:37.392265 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 10:11:37.392265 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 10:11:37.392265 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 09 10:11:37.392265 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:37.392265 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 10:11:37.392265 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:37.392265 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:37.392265 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:37.392265 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:37.392265 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:37.392265 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:37.393286 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:37.393286 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:37.393286 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:37.393286 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:37.393286 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:37.393286 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:37.393286 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 10:11:37.393286 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 10:11:37.393286 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 10:11:37.393286 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 10:11:37.393286 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:37.393286 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:37.393286 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:37.393286 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:37.393286 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:37.393286 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:37.394168 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:37.394168 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:37.394168 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:37.394168 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:37.394168 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:37.394168 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:37.394168 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:37.394168 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:37.394168 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:37.394168 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:37.394168 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 10:11:37.394168 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 10:11:37.394168 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 09 10:11:37.394168 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:37.405114 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 385/770] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Aug 9 10:11:37 2022] GET /identity/v3/services/network => generated 88 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 10:11:37.417655 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343abd36-f9e3-46d1-b1fc-c7faa1b95cff None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:37.455087 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:37.570171 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 386/771] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Aug 9 10:11:36 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 657 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 10:11:37.580756 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc62901c-cf5e-4f54-aa80-0841394a904c None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:37.727951 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343abd36-f9e3-46d1-b1fc-c7faa1b95cff None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:37.763671 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:37.819552 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd87c93-c0cb-4f8c-9b7d-884374f9fded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:37.820169 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd87c93-c0cb-4f8c-9b7d-884374f9fded None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:37.820444 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd87c93-c0cb-4f8c-9b7d-884374f9fded None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:37.820712 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd87c93-c0cb-4f8c-9b7d-884374f9fded None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:37.821344 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd87c93-c0cb-4f8c-9b7d-884374f9fded None admin] RBAC: Adding query filter params (name=network) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:37.821638 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd87c93-c0cb-4f8c-9b7d-884374f9fded None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:37.823028 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd87c93-c0cb-4f8c-9b7d-884374f9fded None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:37.827185 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc62901c-cf5e-4f54-aa80-0841394a904c None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:37.837474 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 386/772] 10.222.0.36 () {56 vars in 1112 bytes} [Tue Aug 9 10:11:37 2022] GET /identity/v3/services?name=network => generated 124 bytes in 417 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:37.841786 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd87c93-c0cb-4f8c-9b7d-884374f9fded None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:37.891256 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44763367-265b-49d2-a736-81244f92deee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:37.892296 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44763367-265b-49d2-a736-81244f92deee None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:37.893360 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44763367-265b-49d2-a736-81244f92deee None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:37.893833 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44763367-265b-49d2-a736-81244f92deee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:37.913010 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44763367-265b-49d2-a736-81244f92deee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:37.916708 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44763367-265b-49d2-a736-81244f92deee None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:37.944057 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-44763367-265b-49d2-a736-81244f92deee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:37.944057 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:37.944057 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:37.944057 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:37.944057 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:37.944057 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:37.944057 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:37.944057 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:37.944057 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:37.944057 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:37.944057 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:37.944057 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:37.944057 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 10:11:37.944057 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 10:11:37.944057 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 10:11:37.944057 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 10:11:37.945053 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:37.945053 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:37.945053 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:37.945053 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:37.945053 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:37.945053 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:37.945053 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:37.945053 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:37.945053 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:37.945053 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:37.945053 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:37.945053 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:37.945053 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:37.945053 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:37.945053 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:37.945053 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:37.945053 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 10:11:37.945977 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 10:11:37.945977 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:37.945977 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:11:37.949067 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 387/773] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:11:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:37.957016 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44763367-265b-49d2-a736-81244f92deee None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:37.993773 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:38.009876 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd87c93-c0cb-4f8c-9b7d-884374f9fded None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:38.053725 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23675cfe-4718-4c60-83b8-0fe0b93f70cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:38.054371 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23675cfe-4718-4c60-83b8-0fe0b93f70cc None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:38.054653 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23675cfe-4718-4c60-83b8-0fe0b93f70cc None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:38.054924 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23675cfe-4718-4c60-83b8-0fe0b93f70cc None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:38.055559 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23675cfe-4718-4c60-83b8-0fe0b93f70cc None admin] RBAC: Adding query filter params (type=network) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:38.055870 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23675cfe-4718-4c60-83b8-0fe0b93f70cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:38.057234 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23675cfe-4718-4c60-83b8-0fe0b93f70cc None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:38.064788 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 387/774] 10.222.0.36 () {56 vars in 1112 bytes} [Tue Aug 9 10:11:37 2022] GET /identity/v3/services?type=network => generated 350 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:11:38.066110 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3810dea8-a388-45a5-9dd6-896b9db8f8b2 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:38.066398 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3810dea8-a388-45a5-9dd6-896b9db8f8b2 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:38.066674 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3810dea8-a388-45a5-9dd6-896b9db8f8b2 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:38.069974 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 388/775] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:11:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:11:38.070927 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3810dea8-a388-45a5-9dd6-896b9db8f8b2 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:38.098456 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44763367-265b-49d2-a736-81244f92deee None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:38.121022 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:38.135194 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c899cb7-b285-487c-a1fb-64ad1fa7f25e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:38.135576 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c899cb7-b285-487c-a1fb-64ad1fa7f25e None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:38.135999 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c899cb7-b285-487c-a1fb-64ad1fa7f25e None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:38.136554 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c899cb7-b285-487c-a1fb-64ad1fa7f25e None admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:38.137506 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c899cb7-b285-487c-a1fb-64ad1fa7f25e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:38.137756 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c899cb7-b285-487c-a1fb-64ad1fa7f25e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:38.139249 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c899cb7-b285-487c-a1fb-64ad1fa7f25e None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:38.157179 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 388/776] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Aug 9 10:11:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:38.157179 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af24e4-1e23-4a72-8fbb-b30341b0b78c None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:38.157179 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af24e4-1e23-4a72-8fbb-b30341b0b78c None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:38.157179 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af24e4-1e23-4a72-8fbb-b30341b0b78c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:38.172537 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-93af24e4-1e23-4a72-8fbb-b30341b0b78c None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:11:38.173831 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-93af24e4-1e23-4a72-8fbb-b30341b0b78c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:11:38.195164 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3810dea8-a388-45a5-9dd6-896b9db8f8b2 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:38.234415 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af61a394-f461-40bd-983f-8c0d877129a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:38.235294 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af61a394-f461-40bd-983f-8c0d877129a5 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:38.235722 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af61a394-f461-40bd-983f-8c0d877129a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:38.236144 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af61a394-f461-40bd-983f-8c0d877129a5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:38.237113 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af61a394-f461-40bd-983f-8c0d877129a5 None admin] RBAC: Adding query filter params (interface=public, service_id=8d22fcabf8db4114801590d4ca6e6e7c, region_id=RegionOne) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:38.237631 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af61a394-f461-40bd-983f-8c0d877129a5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:38.239164 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af61a394-f461-40bd-983f-8c0d877129a5 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:38.253944 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 389/777] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:11:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 10:11:38.253944 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93af24e4-1e23-4a72-8fbb-b30341b0b78c None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:38.257417 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 389/778] 10.222.0.36 () {56 vars in 1251 bytes} [Tue Aug 9 10:11:38 2022] GET /identity/v3/endpoints?service_id=8d22fcabf8db4114801590d4ca6e6e7c&interface=public®ion_id=RegionOne => generated 194 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:38.262714 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af61a394-f461-40bd-983f-8c0d877129a5 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:38.263542 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:38.347704 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93af24e4-1e23-4a72-8fbb-b30341b0b78c None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:38.384947 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1873ffba-b570-4227-aefa-f1824f2e2d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:38.385593 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1873ffba-b570-4227-aefa-f1824f2e2d97 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:38.385727 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af61a394-f461-40bd-983f-8c0d877129a5 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:38.386907 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1873ffba-b570-4227-aefa-f1824f2e2d97 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:38.386907 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1873ffba-b570-4227-aefa-f1824f2e2d97 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:38.389923 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:38.394724 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1873ffba-b570-4227-aefa-f1824f2e2d97 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:38.396167 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1873ffba-b570-4227-aefa-f1824f2e2d97 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:38.408375 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-1873ffba-b570-4227-aefa-f1824f2e2d97 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 10:11:38.408375 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:38.408375 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:38.408375 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:38.408375 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:38.408375 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:38.408375 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:38.408375 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:38.408375 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:38.408375 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:38.408375 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:38.408375 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:38.408375 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 10:11:38.408375 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 10:11:38.408375 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 10:11:38.409254 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 10:11:38.409254 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:38.409254 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:38.409254 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:38.409254 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:38.409254 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:38.409254 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:38.409254 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:38.409254 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:38.409254 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:38.409254 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:38.409254 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:38.409254 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:38.409254 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:38.409254 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:38.409254 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:38.409254 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:38.410998 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 10:11:38.410998 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 10:11:38.410998 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 10:11:38.410998 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 10:11:38.410998 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 10:11:38.410998 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 10:11:38.410998 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 10:11:38.410998 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:11:38.410998 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 390/779] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Aug 9 10:11:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:38.410998 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1873ffba-b570-4227-aefa-f1824f2e2d97 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:38.427192 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718639e4-27e5-4f9a-82f7-932cade89b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:38.427795 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718639e4-27e5-4f9a-82f7-932cade89b04 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:38.428075 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718639e4-27e5-4f9a-82f7-932cade89b04 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:38.428368 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718639e4-27e5-4f9a-82f7-932cade89b04 None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:38.428951 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718639e4-27e5-4f9a-82f7-932cade89b04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:38.430357 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718639e4-27e5-4f9a-82f7-932cade89b04 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:38.441885 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 390/780] 10.222.0.36 () {56 vars in 1087 bytes} [Tue Aug 9 10:11:38 2022] GET /identity/v3/services => generated 772 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:38.441885 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c860dc-e556-49f2-a6c7-41fe61b62297 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:38.441885 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c860dc-e556-49f2-a6c7-41fe61b62297 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:38.441885 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c860dc-e556-49f2-a6c7-41fe61b62297 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:38.441885 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 391/781] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:11:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:11:38.441885 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c860dc-e556-49f2-a6c7-41fe61b62297 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:38.507641 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:38.544789 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1873ffba-b570-4227-aefa-f1824f2e2d97 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:38.568346 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c860dc-e556-49f2-a6c7-41fe61b62297 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:38.584043 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2d18b5-2bad-4ada-925c-d9c4e941336c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:38.584749 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d18b5-2bad-4ada-925c-d9c4e941336c None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:38.585029 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d18b5-2bad-4ada-925c-d9c4e941336c None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:38.585298 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d18b5-2bad-4ada-925c-d9c4e941336c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:38.600257 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2d18b5-2bad-4ada-925c-d9c4e941336c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 10:11:38.606711 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-9b2d18b5-2bad-4ada-925c-d9c4e941336c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 10:11:38.606711 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:38.606711 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:38.606711 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:38.606711 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:38.606711 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:38.606711 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:38.606711 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:38.606711 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:38.606711 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:38.606711 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:38.606711 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:38.606711 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 10:11:38.606711 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 10:11:38.606711 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 10:11:38.606711 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 10:11:38.607693 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 10:11:38.607693 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 10:11:38.607693 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 10:11:38.607693 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 10:11:38.607693 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:38.607693 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:38.607693 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:38.607693 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:38.607693 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:38.607693 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:38.607693 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:38.607693 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:38.607693 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:38.607693 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:38.607693 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:38.607693 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:38.608512 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:38.608512 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:38.608512 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:38.608512 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:38.608512 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 10:11:38.608512 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 10:11:38.608512 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 10:11:38.608512 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 10:11:38.608512 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 10:11:38.608512 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 10:11:38.608512 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 10:11:38.608512 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:11:38.608512 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 391/782] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Aug 9 10:11:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:38.609787 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4972bf4f-ef87-4c22-b522-47b6ba76d9ff None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:38.609787 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4972bf4f-ef87-4c22-b522-47b6ba76d9ff None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:38.610061 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4972bf4f-ef87-4c22-b522-47b6ba76d9ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:38.617386 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31c6d54-6b48-4371-81b3-cfb54009986b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:38.619143 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c6d54-6b48-4371-81b3-cfb54009986b None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:38.619470 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c6d54-6b48-4371-81b3-cfb54009986b None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:38.619744 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31c6d54-6b48-4371-81b3-cfb54009986b None admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:38.620529 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31c6d54-6b48-4371-81b3-cfb54009986b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:38.620836 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31c6d54-6b48-4371-81b3-cfb54009986b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:38.626090 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31c6d54-6b48-4371-81b3-cfb54009986b None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:38.638603 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-4972bf4f-ef87-4c22-b522-47b6ba76d9ff None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:11:38.639816 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-4972bf4f-ef87-4c22-b522-47b6ba76d9ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:11:38.644622 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 392/783] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Aug 9 10:11:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:38.645647 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31c6d54-6b48-4371-81b3-cfb54009986b None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:38.678520 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:38.722525 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 392/784] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:11:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 10:11:38.722525 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4972bf4f-ef87-4c22-b522-47b6ba76d9ff None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:38.779561 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31c6d54-6b48-4371-81b3-cfb54009986b None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:38.810179 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:38.822197 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfe32c1-b772-4910-9b07-5b9c108086f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:38.823162 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe32c1-b772-4910-9b07-5b9c108086f7 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:38.824964 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe32c1-b772-4910-9b07-5b9c108086f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:38.825473 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe32c1-b772-4910-9b07-5b9c108086f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:38.826443 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfe32c1-b772-4910-9b07-5b9c108086f7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:38.826948 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfe32c1-b772-4910-9b07-5b9c108086f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:38.828607 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfe32c1-b772-4910-9b07-5b9c108086f7 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:38.843654 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 393/785] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Aug 9 10:11:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:38.845006 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfe32c1-b772-4910-9b07-5b9c108086f7 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:38.849697 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4972bf4f-ef87-4c22-b522-47b6ba76d9ff None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:38.890793 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960632a5-89a8-483a-9ab8-974ec83155ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:38.891399 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960632a5-89a8-483a-9ab8-974ec83155ef None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:38.891674 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960632a5-89a8-483a-9ab8-974ec83155ef None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:38.891946 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960632a5-89a8-483a-9ab8-974ec83155ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:38.892776 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960632a5-89a8-483a-9ab8-974ec83155ef None admin] RBAC: Adding query filter params (role.id=1252647548644b48900ef09f1df438fd, scope.project.id=28891cf6239a43469326a864fb0d216c, user.id=cedc4d6c59c44c6d8fb7179070db5e91) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:38.893088 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960632a5-89a8-483a-9ab8-974ec83155ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:38.894657 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960632a5-89a8-483a-9ab8-974ec83155ef None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:38.903434 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 393/786] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Aug 9 10:11:38 2022] GET /identity/v3/role_assignments?user.id=cedc4d6c59c44c6d8fb7179070db5e91&scope.project.id=28891cf6239a43469326a864fb0d216c&role.id=1252647548644b48900ef09f1df438fd => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:38.904697 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960632a5-89a8-483a-9ab8-974ec83155ef None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:39.002378 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:39.021363 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfe32c1-b772-4910-9b07-5b9c108086f7 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:39.091944 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12273f9-8eca-45ce-9976-e4ce2b1d4e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:39.092498 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12273f9-8eca-45ce-9976-e4ce2b1d4e62 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:39.092779 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12273f9-8eca-45ce-9976-e4ce2b1d4e62 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:39.093051 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12273f9-8eca-45ce-9976-e4ce2b1d4e62 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:39.104266 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12273f9-8eca-45ce-9976-e4ce2b1d4e62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 10:11:39.109671 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960632a5-89a8-483a-9ab8-974ec83155ef None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:39.110567 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-c12273f9-8eca-45ce-9976-e4ce2b1d4e62 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 10:11:39.110567 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:39.110567 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:39.110567 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:39.110567 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:39.110567 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:39.110567 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:39.110567 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:39.110567 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:39.110567 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:39.110567 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:39.110567 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:39.110567 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 10:11:39.110567 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 10:11:39.110567 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 10:11:39.110567 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 10:11:39.111476 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 10:11:39.111476 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 10:11:39.111476 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 10:11:39.111476 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 10:11:39.111476 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:39.111476 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:39.111476 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:39.111476 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:39.111476 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:39.111476 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:39.111476 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:39.111476 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:39.111476 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:39.111476 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:39.111476 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:39.111476 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:39.112316 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:39.112316 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:39.112316 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:39.112316 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:39.112316 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 10:11:39.112316 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 10:11:39.112316 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 10:11:39.112316 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 10:11:39.112316 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 10:11:39.112316 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 10:11:39.112316 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 10:11:39.112316 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:39.112316 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 394/787] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Aug 9 10:11:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:39.119656 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12273f9-8eca-45ce-9976-e4ce2b1d4e62 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:39.149010 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:39.158929 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41246a9e-83bc-4930-ade1-b8311b8f1ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:39.160121 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41246a9e-83bc-4930-ade1-b8311b8f1ec8 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:39.160877 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41246a9e-83bc-4930-ade1-b8311b8f1ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:39.161772 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41246a9e-83bc-4930-ade1-b8311b8f1ec8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:39.182954 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41246a9e-83bc-4930-ade1-b8311b8f1ec8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:39.185312 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41246a9e-83bc-4930-ade1-b8311b8f1ec8 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:39.213823 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-41246a9e-83bc-4930-ade1-b8311b8f1ec8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:39.213823 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:39.213823 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:39.213823 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:39.213823 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:39.213823 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:39.213823 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:39.213823 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:39.213823 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:39.213823 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:39.213823 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:39.213823 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:39.213823 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 10:11:39.213823 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 10:11:39.213823 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 10:11:39.213823 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 10:11:39.215095 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:39.215095 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:39.215095 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:39.215095 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:39.215095 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:39.215095 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:39.215095 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:39.215095 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:39.215095 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:39.215095 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:39.215095 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:39.215095 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:39.215095 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:39.215095 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:39.215095 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:39.215095 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:39.215095 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 10:11:39.215983 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 10:11:39.215983 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:39.215983 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:11:39.219185 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 394/788] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:11:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:39.224745 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41246a9e-83bc-4930-ade1-b8311b8f1ec8 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:39.309574 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12273f9-8eca-45ce-9976-e4ce2b1d4e62 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:39.354186 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98738fa-12e1-438c-9c54-9289d242f84d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:39.355262 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98738fa-12e1-438c-9c54-9289d242f84d None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:39.355549 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98738fa-12e1-438c-9c54-9289d242f84d None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:39.355833 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98738fa-12e1-438c-9c54-9289d242f84d None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:39.356504 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98738fa-12e1-438c-9c54-9289d242f84d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:39.356816 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98738fa-12e1-438c-9c54-9289d242f84d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:39.358233 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98738fa-12e1-438c-9c54-9289d242f84d None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:39.367953 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41246a9e-83bc-4930-ade1-b8311b8f1ec8 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:39.368256 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 395/789] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Aug 9 10:11:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:39.369773 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc08e2-6d7e-4153-baaa-e6586c1b520c None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:39.370344 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc08e2-6d7e-4153-baaa-e6586c1b520c None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:39.370785 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc08e2-6d7e-4153-baaa-e6586c1b520c None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:39.376149 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 396/790] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:11:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:11:39.377818 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0569833f-797a-416d-82f4-9f529930ae6f None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:39.378228 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0569833f-797a-416d-82f4-9f529930ae6f None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:39.378608 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0569833f-797a-416d-82f4-9f529930ae6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:39.398391 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-0569833f-797a-416d-82f4-9f529930ae6f None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:11:39.399760 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-0569833f-797a-416d-82f4-9f529930ae6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:11:39.410992 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079beb56-bc3b-4bf2-ad4c-2a6765a4a110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:39.411597 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079beb56-bc3b-4bf2-ad4c-2a6765a4a110 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:39.411876 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079beb56-bc3b-4bf2-ad4c-2a6765a4a110 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:39.412146 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079beb56-bc3b-4bf2-ad4c-2a6765a4a110 None admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:39.412809 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079beb56-bc3b-4bf2-ad4c-2a6765a4a110 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:39.413081 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079beb56-bc3b-4bf2-ad4c-2a6765a4a110 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:39.414484 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079beb56-bc3b-4bf2-ad4c-2a6765a4a110 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:39.414987 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:39.428544 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 395/791] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Aug 9 10:11:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:39.429366 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079beb56-bc3b-4bf2-ad4c-2a6765a4a110 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:39.477960 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 397/792] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:11:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 10:11:39.478887 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0569833f-797a-416d-82f4-9f529930ae6f None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:39.482323 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:39.553430 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079beb56-bc3b-4bf2-ad4c-2a6765a4a110 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:39.597137 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da0bf42-ad27-4fb1-984b-c4e93eb84f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:39.598646 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da0bf42-ad27-4fb1-984b-c4e93eb84f25 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:39.599110 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da0bf42-ad27-4fb1-984b-c4e93eb84f25 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:39.599573 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da0bf42-ad27-4fb1-984b-c4e93eb84f25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:39.607152 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0569833f-797a-416d-82f4-9f529930ae6f None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:39.613385 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da0bf42-ad27-4fb1-984b-c4e93eb84f25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:39.615087 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da0bf42-ad27-4fb1-984b-c4e93eb84f25 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:39.633241 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-1da0bf42-ad27-4fb1-984b-c4e93eb84f25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:39.633241 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:39.633241 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:39.633241 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:39.633241 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:39.633241 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:39.633241 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:39.633241 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:39.633241 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:39.633241 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:39.633241 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:39.633241 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:39.633241 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 10:11:39.633241 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 10:11:39.633241 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 10:11:39.633241 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 10:11:39.634233 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:39.634233 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:39.634233 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:39.634233 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:39.634233 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:39.634233 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:39.634233 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:39.634233 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:39.634233 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:39.634233 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:39.634233 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:39.634233 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:39.634233 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:39.634233 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:39.634233 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:39.634233 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:39.634233 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 10:11:39.635151 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 10:11:39.635151 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:39.635151 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:11:39.640780 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 396/793] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:11:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:39.640780 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da0bf42-ad27-4fb1-984b-c4e93eb84f25 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:39.653709 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb861b2a-2ef8-4d46-98ff-11ed1b19e88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:39.654667 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb861b2a-2ef8-4d46-98ff-11ed1b19e88c None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:39.655112 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb861b2a-2ef8-4d46-98ff-11ed1b19e88c None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:39.655921 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb861b2a-2ef8-4d46-98ff-11ed1b19e88c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:39.664952 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb861b2a-2ef8-4d46-98ff-11ed1b19e88c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:39.667100 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb861b2a-2ef8-4d46-98ff-11ed1b19e88c None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:39.682706 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-eb861b2a-2ef8-4d46-98ff-11ed1b19e88c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 09 10:11:39.682706 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:39.682706 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:39.682706 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:39.682706 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:39.682706 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:39.682706 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:39.682706 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:39.682706 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:39.682706 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:39.682706 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:39.682706 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:39.682706 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 10:11:39.682706 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 10:11:39.682706 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 10:11:39.682706 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 10:11:39.683714 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:39.683714 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:39.683714 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 10:11:39.683714 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 10:11:39.683714 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 10:11:39.683714 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 10:11:39.683714 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:39.683714 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:39.683714 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:39.683714 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:39.683714 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:39.683714 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:39.683714 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:39.683714 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:39.683714 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:39.683714 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:39.683714 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:39.683714 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:39.684693 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:39.684693 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:39.684693 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 10:11:39.684693 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 10:11:39.684693 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 10:11:39.684693 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 10:11:39.684693 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 10:11:39.684693 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 10:11:39.684693 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 09 10:11:39.684693 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:39.689147 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 398/794] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Aug 9 10:11:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:39.690200 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb861b2a-2ef8-4d46-98ff-11ed1b19e88c None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:39.694790 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:39.769589 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:39.777117 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da0bf42-ad27-4fb1-984b-c4e93eb84f25 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:39.824083 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231d5495-dd72-4898-ab8d-ad93af286603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:39.824866 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d5495-dd72-4898-ab8d-ad93af286603 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:39.825276 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d5495-dd72-4898-ab8d-ad93af286603 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:39.825601 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d5495-dd72-4898-ab8d-ad93af286603 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:39.826326 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231d5495-dd72-4898-ab8d-ad93af286603 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:39.827773 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231d5495-dd72-4898-ab8d-ad93af286603 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:39.832420 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb861b2a-2ef8-4d46-98ff-11ed1b19e88c None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:39.837132 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-231d5495-dd72-4898-ab8d-ad93af286603 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 09 10:11:39.837132 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:39.837132 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 10:11:39.837132 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 10:11:39.837132 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 10:11:39.837132 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 10:11:39.837132 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 10:11:39.837132 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 10:11:39.837132 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 09 10:11:39.837132 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:11:39.837132 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 10:11:39.837132 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:11:39.837132 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:39.837132 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:39.837132 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:39.837132 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:39.837132 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:39.838342 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:39.838342 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:39.838342 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:39.838342 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:39.838342 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:39.838342 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:39.838342 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 10:11:39.838342 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 10:11:39.838342 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 10:11:39.838342 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 10:11:39.838342 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:39.838342 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:39.838342 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:39.838342 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:39.838342 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:39.838342 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:39.840132 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:39.840132 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:39.840132 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:39.840132 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:39.840132 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:39.840132 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:39.840132 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:39.840132 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:39.840132 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:39.840132 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:39.840132 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 10:11:39.840132 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 10:11:39.840132 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 09 10:11:39.840132 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:11:39.842015 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 397/795] 10.222.0.36 () {56 vars in 1129 bytes} [Tue Aug 9 10:11:39 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:39.843021 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231d5495-dd72-4898-ab8d-ad93af286603 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:39.879574 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f354cf-629e-4187-b2aa-e74682def6e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:39.880670 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f354cf-629e-4187-b2aa-e74682def6e1 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:39.881096 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f354cf-629e-4187-b2aa-e74682def6e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:39.881734 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f354cf-629e-4187-b2aa-e74682def6e1 None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:39.882955 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f354cf-629e-4187-b2aa-e74682def6e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:39.883674 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f354cf-629e-4187-b2aa-e74682def6e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:39.885185 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f354cf-629e-4187-b2aa-e74682def6e1 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:39.910205 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 399/796] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Aug 9 10:11:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:39.910205 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f354cf-629e-4187-b2aa-e74682def6e1 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:39.967713 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231d5495-dd72-4898-ab8d-ad93af286603 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:39.985384 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:40.016022 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a7bd95-ff6b-4a7a-b027-cb67a28d9503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:40.017243 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a7bd95-ff6b-4a7a-b027-cb67a28d9503 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:40.018070 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a7bd95-ff6b-4a7a-b027-cb67a28d9503 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:40.018363 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a7bd95-ff6b-4a7a-b027-cb67a28d9503 None admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:40.019129 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a7bd95-ff6b-4a7a-b027-cb67a28d9503 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:40.019435 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a7bd95-ff6b-4a7a-b027-cb67a28d9503 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:40.021547 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a7bd95-ff6b-4a7a-b027-cb67a28d9503 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:40.036607 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f354cf-629e-4187-b2aa-e74682def6e1 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:40.044554 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 398/797] 10.222.0.36 () {56 vars in 1135 bytes} [Tue Aug 9 10:11:39 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:40.045637 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a7bd95-ff6b-4a7a-b027-cb67a28d9503 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:40.068667 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:40.080421 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff622eee-ef73-4e84-a314-c897a652dd1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:40.081189 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff622eee-ef73-4e84-a314-c897a652dd1b None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:40.081580 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff622eee-ef73-4e84-a314-c897a652dd1b None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:40.081980 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff622eee-ef73-4e84-a314-c897a652dd1b None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:40.082698 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff622eee-ef73-4e84-a314-c897a652dd1b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:40.083182 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff622eee-ef73-4e84-a314-c897a652dd1b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:40.084847 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff622eee-ef73-4e84-a314-c897a652dd1b None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:40.095177 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 400/798] 10.222.0.36 () {56 vars in 1124 bytes} [Tue Aug 9 10:11:39 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:40.096160 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff622eee-ef73-4e84-a314-c897a652dd1b None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:40.176087 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a7bd95-ff6b-4a7a-b027-cb67a28d9503 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:40.220495 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff622eee-ef73-4e84-a314-c897a652dd1b None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:40.224295 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c93207b-b144-435e-9064-a2277b61bc28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:40.225055 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c93207b-b144-435e-9064-a2277b61bc28 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:40.225436 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c93207b-b144-435e-9064-a2277b61bc28 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:40.225805 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c93207b-b144-435e-9064-a2277b61bc28 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:40.235087 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c93207b-b144-435e-9064-a2277b61bc28 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:40.236660 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c93207b-b144-435e-9064-a2277b61bc28 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:40.249227 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-0c93207b-b144-435e-9064-a2277b61bc28 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 09 10:11:40.249227 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:40.249227 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:40.249227 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:40.249227 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:40.249227 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:40.249227 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:40.249227 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:40.249227 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:40.249227 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:40.249227 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:40.249227 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:40.249227 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 10:11:40.249227 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 10:11:40.249227 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 10:11:40.249227 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 10:11:40.250334 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:40.250334 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:40.250334 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 10:11:40.250334 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 10:11:40.250334 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 10:11:40.250334 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 10:11:40.250334 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:40.250334 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:40.250334 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:40.250334 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:40.250334 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:40.250334 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:40.250334 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:40.250334 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:40.250334 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:40.250334 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:40.250334 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:40.250334 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:40.251288 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:40.251288 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:40.251288 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 10:11:40.251288 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 10:11:40.251288 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 10:11:40.251288 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 10:11:40.251288 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 10:11:40.251288 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 10:11:40.251288 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 09 10:11:40.251288 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:11:40.253137 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:40.256095 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 399/799] 10.222.0.36 () {56 vars in 1093 bytes} [Tue Aug 9 10:11:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:40.257157 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c93207b-b144-435e-9064-a2277b61bc28 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:40.270869 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08299a6a-642d-4fe0-b053-749ab1e60392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:40.271512 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08299a6a-642d-4fe0-b053-749ab1e60392 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:40.271789 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08299a6a-642d-4fe0-b053-749ab1e60392 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:40.272109 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08299a6a-642d-4fe0-b053-749ab1e60392 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:40.286670 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08299a6a-642d-4fe0-b053-749ab1e60392 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:40.288658 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08299a6a-642d-4fe0-b053-749ab1e60392 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:40.310294 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-08299a6a-642d-4fe0-b053-749ab1e60392 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:40.310294 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:40.310294 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:40.310294 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:40.310294 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:40.310294 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:40.310294 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:40.310294 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:40.310294 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:40.310294 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:40.310294 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:40.310294 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:40.310294 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 10:11:40.310294 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 10:11:40.310294 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 10:11:40.310294 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 10:11:40.311303 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:40.311303 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:40.311303 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:40.311303 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:40.311303 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:40.311303 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:40.311303 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:40.311303 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:40.311303 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:40.311303 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:40.311303 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:40.311303 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:40.311303 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:40.311303 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:40.311303 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:40.311303 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:40.311303 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 10:11:40.312188 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 10:11:40.312188 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:40.312188 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:40.313920 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 401/800] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:11:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:40.314977 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08299a6a-642d-4fe0-b053-749ab1e60392 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:40.361048 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:40.390253 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c93207b-b144-435e-9064-a2277b61bc28 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:40.434798 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf26a758-0410-41fe-af3c-2ac535adf831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:40.435977 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf26a758-0410-41fe-af3c-2ac535adf831 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:40.436461 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf26a758-0410-41fe-af3c-2ac535adf831 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:40.437021 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf26a758-0410-41fe-af3c-2ac535adf831 None admin] PATH_INFO: `/v3/services` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:40.438276 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf26a758-0410-41fe-af3c-2ac535adf831 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:40.438807 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf26a758-0410-41fe-af3c-2ac535adf831 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:40.440807 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf26a758-0410-41fe-af3c-2ac535adf831 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:40.447700 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 400/801] 10.222.0.36 () {56 vars in 1124 bytes} [Tue Aug 9 10:11:40 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:40.449053 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf26a758-0410-41fe-af3c-2ac535adf831 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:40.453006 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08299a6a-642d-4fe0-b053-749ab1e60392 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:40.499241 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f4408c-8ac8-407c-a3b8-bcdfb9a5a4bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:40.499852 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f4408c-8ac8-407c-a3b8-bcdfb9a5a4bd None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:40.500129 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f4408c-8ac8-407c-a3b8-bcdfb9a5a4bd None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:40.500396 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f4408c-8ac8-407c-a3b8-bcdfb9a5a4bd None admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:40.501127 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f4408c-8ac8-407c-a3b8-bcdfb9a5a4bd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:40.501429 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f4408c-8ac8-407c-a3b8-bcdfb9a5a4bd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:40.502879 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f4408c-8ac8-407c-a3b8-bcdfb9a5a4bd None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:40.533718 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 402/802] 10.222.0.36 () {56 vars in 1133 bytes} [Tue Aug 9 10:11:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:40.534850 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f4408c-8ac8-407c-a3b8-bcdfb9a5a4bd None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:40.583868 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:40.587953 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf26a758-0410-41fe-af3c-2ac535adf831 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:40.628474 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eabfa0f-f43b-47a7-a77f-dbae0a99adec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:40.629087 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eabfa0f-f43b-47a7-a77f-dbae0a99adec None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:40.629388 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eabfa0f-f43b-47a7-a77f-dbae0a99adec None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:40.629636 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eabfa0f-f43b-47a7-a77f-dbae0a99adec None admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:40.630314 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eabfa0f-f43b-47a7-a77f-dbae0a99adec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:40.630613 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eabfa0f-f43b-47a7-a77f-dbae0a99adec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:40.631955 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eabfa0f-f43b-47a7-a77f-dbae0a99adec None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:40.640677 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:40.648244 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 401/803] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Aug 9 10:11:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:40.648244 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eabfa0f-f43b-47a7-a77f-dbae0a99adec None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:40.676128 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f4408c-8ac8-407c-a3b8-bcdfb9a5a4bd None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:40.712344 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7c6ab2-64ac-4d73-b310-7c1d33d9c2dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:40.712867 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7c6ab2-64ac-4d73-b310-7c1d33d9c2dd None admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:40.713144 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7c6ab2-64ac-4d73-b310-7c1d33d9c2dd None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:40.713413 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7c6ab2-64ac-4d73-b310-7c1d33d9c2dd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:40.714132 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7c6ab2-64ac-4d73-b310-7c1d33d9c2dd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:40.715625 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7c6ab2-64ac-4d73-b310-7c1d33d9c2dd None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:40.746259 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 403/804] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:11:40 2022] POST /identity/v3/endpoints => generated 346 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:11:40.746259 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e789d7-0af5-4dcd-88b1-4d8ec0bf618a None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:40.746259 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e789d7-0af5-4dcd-88b1-4d8ec0bf618a None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:40.746259 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e789d7-0af5-4dcd-88b1-4d8ec0bf618a None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:40.746259 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 404/805] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:11:40 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:11:40.746259 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e789d7-0af5-4dcd-88b1-4d8ec0bf618a None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:40.758470 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eabfa0f-f43b-47a7-a77f-dbae0a99adec None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:40.808671 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fb8a6b-53ec-4d84-a38f-e6971df88c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:40.809111 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fb8a6b-53ec-4d84-a38f-e6971df88c2e None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:40.809683 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fb8a6b-53ec-4d84-a38f-e6971df88c2e None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:40.810009 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fb8a6b-53ec-4d84-a38f-e6971df88c2e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:40.865711 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:40.879871 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e789d7-0af5-4dcd-88b1-4d8ec0bf618a None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:40.904908 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:40.915344 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fb8a6b-53ec-4d84-a38f-e6971df88c2e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:40.918051 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fb8a6b-53ec-4d84-a38f-e6971df88c2e None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:40.922138 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1e8cbf-b192-4dd1-b427-6146bc678dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:40.922708 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e8cbf-b192-4dd1-b427-6146bc678dc3 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:40.923045 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e8cbf-b192-4dd1-b427-6146bc678dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:40.923412 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e8cbf-b192-4dd1-b427-6146bc678dc3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:40.930980 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1e8cbf-b192-4dd1-b427-6146bc678dc3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:40.932500 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1e8cbf-b192-4dd1-b427-6146bc678dc3 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:40.947180 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-5d1e8cbf-b192-4dd1-b427-6146bc678dc3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 10:11:40.947180 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:40.947180 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:40.947180 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:40.947180 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:40.947180 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:40.947180 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:40.947180 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:40.947180 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:40.947180 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:40.947180 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:40.947180 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:40.947180 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 10:11:40.947180 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 10:11:40.947180 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 10:11:40.948191 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 10:11:40.948191 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:40.948191 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:40.948191 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:40.948191 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:40.948191 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:40.948191 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:40.948191 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:40.948191 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:40.948191 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:40.948191 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:40.948191 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:40.948191 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:40.948191 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:40.948191 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:40.948191 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:40.948191 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:40.949664 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 10:11:40.949664 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 10:11:40.949664 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 10:11:40.949664 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 10:11:40.949664 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 10:11:40.949664 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 10:11:40.949664 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 10:11:40.949664 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:40.949664 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 405/806] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Aug 9 10:11:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:40.951074 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9c830-3085-45cf-835f-b1f3dbf551c1 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:40.951355 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9c830-3085-45cf-835f-b1f3dbf551c1 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:40.951623 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9c830-3085-45cf-835f-b1f3dbf551c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:40.978371 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-44f9c830-3085-45cf-835f-b1f3dbf551c1 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:11:40.979476 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-44f9c830-3085-45cf-835f-b1f3dbf551c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:11:41.053943 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 402/807] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Aug 9 10:11:40 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 10:11:41.055337 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fb8a6b-53ec-4d84-a38f-e6971df88c2e None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:41.069961 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 406/808] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:11:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 10:11:41.070861 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f9c830-3085-45cf-835f-b1f3dbf551c1 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:41.164954 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:41.173421 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fb8a6b-53ec-4d84-a38f-e6971df88c2e None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:41.176705 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:41.196536 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f9c830-3085-45cf-835f-b1f3dbf551c1 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:41.210659 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e59251-4151-423f-8eff-c880f416b2ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:41.211607 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e59251-4151-423f-8eff-c880f416b2ed None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:41.211607 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e59251-4151-423f-8eff-c880f416b2ed None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:41.211808 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e59251-4151-423f-8eff-c880f416b2ed None admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:41.212494 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e59251-4151-423f-8eff-c880f416b2ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:41.212803 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e59251-4151-423f-8eff-c880f416b2ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:41.215102 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e59251-4151-423f-8eff-c880f416b2ed None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:41.230440 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 403/809] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Aug 9 10:11:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:41.231210 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e59251-4151-423f-8eff-c880f416b2ed None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:41.240156 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76395e33-90bc-4d70-aec5-c35dd44f9dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:41.241017 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76395e33-90bc-4d70-aec5-c35dd44f9dbf None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:41.241297 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76395e33-90bc-4d70-aec5-c35dd44f9dbf None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:41.241565 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76395e33-90bc-4d70-aec5-c35dd44f9dbf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:41.253076 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76395e33-90bc-4d70-aec5-c35dd44f9dbf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:41.254556 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76395e33-90bc-4d70-aec5-c35dd44f9dbf None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:41.269485 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-76395e33-90bc-4d70-aec5-c35dd44f9dbf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:41.269485 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:41.269485 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:41.269485 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:41.269485 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:41.269485 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:41.269485 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:41.269485 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:41.269485 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:41.269485 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:41.269485 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:41.269485 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:41.269485 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 10:11:41.269485 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 10:11:41.269485 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 10:11:41.269485 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 10:11:41.270508 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:41.270508 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:41.270508 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:41.270508 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:41.270508 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:41.270508 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:41.270508 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:41.270508 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:41.270508 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:41.270508 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:41.270508 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:41.270508 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:41.270508 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:41.270508 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:41.270508 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:41.270508 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:41.270508 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 10:11:41.271388 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 10:11:41.271388 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:41.271388 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:41.271388 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 407/810] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:11:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:41.272105 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ea2b8-381a-4526-9182-0c03079fbb6f None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:41.272383 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ea2b8-381a-4526-9182-0c03079fbb6f None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:41.272683 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ea2b8-381a-4526-9182-0c03079fbb6f None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:41.274098 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 408/811] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:11:41 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:11:41.278906 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92ea2b8-381a-4526-9182-0c03079fbb6f None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:41.345035 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e59251-4151-423f-8eff-c880f416b2ed None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:41.380670 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b978ae2-8bdf-41fd-8d33-3dec5fdd20da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:41.381290 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b978ae2-8bdf-41fd-8d33-3dec5fdd20da None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:41.381565 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b978ae2-8bdf-41fd-8d33-3dec5fdd20da None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:41.381832 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b978ae2-8bdf-41fd-8d33-3dec5fdd20da None admin] PATH_INFO: `/v3/services/network` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:41.382435 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b978ae2-8bdf-41fd-8d33-3dec5fdd20da None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:41.383769 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b978ae2-8bdf-41fd-8d33-3dec5fdd20da None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:41.393246 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-2b978ae2-8bdf-41fd-8d33-3dec5fdd20da None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 09 10:11:41.393246 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:41.393246 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 10:11:41.393246 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 10:11:41.393246 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 10:11:41.393246 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 10:11:41.393246 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 10:11:41.393246 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 10:11:41.393246 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 09 10:11:41.393246 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:11:41.393246 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 10:11:41.393246 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:11:41.393246 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:41.393246 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:41.393246 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:41.393246 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:41.393246 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:41.394271 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:41.394271 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:41.394271 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:41.394271 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:41.394271 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:41.394271 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:41.394271 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 10:11:41.394271 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 10:11:41.394271 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 10:11:41.394271 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 10:11:41.394271 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:41.394271 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:41.394271 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:41.394271 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:41.394271 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:41.394271 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:41.395132 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:41.395132 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:41.395132 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:41.395132 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:41.395132 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:41.395132 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:41.395132 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:41.395132 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:41.395132 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:41.395132 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:41.395132 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 10:11:41.395132 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 10:11:41.395132 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 09 10:11:41.395132 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:11:41.395132 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 404/812] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Aug 9 10:11:41 2022] GET /identity/v3/services/network => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:41.395958 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b978ae2-8bdf-41fd-8d33-3dec5fdd20da None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:41.403440 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92ea2b8-381a-4526-9182-0c03079fbb6f None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:41.420578 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:41.439304 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1148b391-cbf7-4d3d-93dd-841e05235346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:41.440004 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1148b391-cbf7-4d3d-93dd-841e05235346 None admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:41.440280 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1148b391-cbf7-4d3d-93dd-841e05235346 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:41.440547 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1148b391-cbf7-4d3d-93dd-841e05235346 None admin] PATH_INFO: `/v3/projects/28891cf6239a43469326a864fb0d216c/users/841c5dbaae774944b637c533ebd75b29/roles/89ca30cbbb634be8a96e9921aa56626b` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:41.442441 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1148b391-cbf7-4d3d-93dd-841e05235346 None admin] RBAC: Authorizing `identity:create_grant(project_id=28891cf6239a43469326a864fb0d216c, user_id=841c5dbaae774944b637c533ebd75b29, role_id=89ca30cbbb634be8a96e9921aa56626b)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:41.443850 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1148b391-cbf7-4d3d-93dd-841e05235346 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:41.446197 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:41.469944 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 409/813] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Aug 9 10:11:41 2022] PUT /identity/v3/projects/28891cf6239a43469326a864fb0d216c/users/841c5dbaae774944b637c533ebd75b29/roles/89ca30cbbb634be8a96e9921aa56626b => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:11:41.471446 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce75b882-0bf4-420a-b9d1-282aa631649e None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:41.471728 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce75b882-0bf4-420a-b9d1-282aa631649e None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:41.472000 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce75b882-0bf4-420a-b9d1-282aa631649e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:41.504191 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-ce75b882-0bf4-420a-b9d1-282aa631649e None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:11:41.505482 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-ce75b882-0bf4-420a-b9d1-282aa631649e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:11:41.523844 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b978ae2-8bdf-41fd-8d33-3dec5fdd20da None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:41.575914 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8898c02b-d7a5-4986-8cf6-925a255c7fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:41.576579 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8898c02b-d7a5-4986-8cf6-925a255c7fc6 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:41.576854 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8898c02b-d7a5-4986-8cf6-925a255c7fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:41.577160 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8898c02b-d7a5-4986-8cf6-925a255c7fc6 None admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:41.578041 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8898c02b-d7a5-4986-8cf6-925a255c7fc6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:41.578485 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8898c02b-d7a5-4986-8cf6-925a255c7fc6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:41.580801 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8898c02b-d7a5-4986-8cf6-925a255c7fc6 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:41.591979 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 410/814] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:11:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 10:11:41.593350 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce75b882-0bf4-420a-b9d1-282aa631649e None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:41.600172 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 405/815] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Aug 9 10:11:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:41.602862 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8898c02b-d7a5-4986-8cf6-925a255c7fc6 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:41.716909 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:41.720474 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce75b882-0bf4-420a-b9d1-282aa631649e None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:41.738583 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8898c02b-d7a5-4986-8cf6-925a255c7fc6 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:41.746745 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:41.758108 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8d71f2-3827-4d47-9342-d7c9e051d7f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:41.758740 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8d71f2-3827-4d47-9342-d7c9e051d7f5 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:41.759089 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8d71f2-3827-4d47-9342-d7c9e051d7f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:41.759507 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8d71f2-3827-4d47-9342-d7c9e051d7f5 None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:41.760193 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8d71f2-3827-4d47-9342-d7c9e051d7f5 None admin] RBAC: Adding query filter params (name=network) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:41.760573 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8d71f2-3827-4d47-9342-d7c9e051d7f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:41.763065 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8d71f2-3827-4d47-9342-d7c9e051d7f5 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:41.772217 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 411/816] 10.222.0.36 () {56 vars in 1112 bytes} [Tue Aug 9 10:11:41 2022] GET /identity/v3/services?name=network => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:41.773167 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8d71f2-3827-4d47-9342-d7c9e051d7f5 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:41.778674 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29640a14-b5b3-41e6-bd10-1925c56a5014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:41.779482 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29640a14-b5b3-41e6-bd10-1925c56a5014 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:41.779910 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29640a14-b5b3-41e6-bd10-1925c56a5014 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:41.780332 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29640a14-b5b3-41e6-bd10-1925c56a5014 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:41.787614 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29640a14-b5b3-41e6-bd10-1925c56a5014 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:41.789300 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29640a14-b5b3-41e6-bd10-1925c56a5014 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:41.801191 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-29640a14-b5b3-41e6-bd10-1925c56a5014 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 10:11:41.801191 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:41.801191 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:41.801191 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:41.801191 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:41.801191 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:41.801191 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:41.801191 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:41.801191 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:41.801191 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:41.801191 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:41.801191 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:41.801191 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 10:11:41.801191 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 10:11:41.801191 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 10:11:41.802273 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 10:11:41.802273 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:41.802273 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:41.802273 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:41.802273 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:41.802273 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:41.802273 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:41.802273 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:41.802273 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:41.802273 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:41.802273 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:41.802273 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:41.802273 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:41.802273 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:41.802273 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:41.802273 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:41.802273 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:41.803387 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 10:11:41.803387 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 10:11:41.803387 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 10:11:41.803387 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 10:11:41.803387 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 10:11:41.803387 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 10:11:41.803387 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 10:11:41.803387 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:11:41.805372 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 406/817] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Aug 9 10:11:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:41.806380 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29640a14-b5b3-41e6-bd10-1925c56a5014 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:41.890276 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8d71f2-3827-4d47-9342-d7c9e051d7f5 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:41.911414 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29640a14-b5b3-41e6-bd10-1925c56a5014 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:41.928322 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5afe25-ca50-454f-b4d5-aa803b08d6ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:41.928953 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5afe25-ca50-454f-b4d5-aa803b08d6ee None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:41.929232 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5afe25-ca50-454f-b4d5-aa803b08d6ee None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:41.929502 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5afe25-ca50-454f-b4d5-aa803b08d6ee None admin] PATH_INFO: `/v3/roles/service` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:41.946415 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5afe25-ca50-454f-b4d5-aa803b08d6ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 10:11:41.950792 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a98575-68dd-4e4e-a0ad-2710d232fd7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:41.951573 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a98575-68dd-4e4e-a0ad-2710d232fd7a None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:41.951998 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a98575-68dd-4e4e-a0ad-2710d232fd7a None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:41.952403 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-ae5afe25-ca50-454f-b4d5-aa803b08d6ee None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 10:11:41.952403 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:41.952403 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:41.952403 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:41.952403 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:41.952403 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:41.952403 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:41.952403 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:41.952403 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:41.952403 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:41.952403 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:41.952403 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:41.952403 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 10:11:41.952403 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 10:11:41.952403 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 10:11:41.952403 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 10:11:41.953515 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 10:11:41.953515 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 10:11:41.953515 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 10:11:41.953515 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 10:11:41.953515 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:41.953515 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:41.953515 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:41.953515 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:41.953515 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:41.953515 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:41.953515 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:41.953515 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:41.953515 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:41.953515 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:41.953515 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:41.953515 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:41.954533 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:41.954533 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:41.954533 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:41.954533 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:41.954533 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 10:11:41.954533 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 10:11:41.954533 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 10:11:41.954533 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 10:11:41.954533 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 10:11:41.954533 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 10:11:41.954533 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 10:11:41.954533 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:41.955461 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a98575-68dd-4e4e-a0ad-2710d232fd7a None admin] PATH_INFO: `/v3/services` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:41.956315 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a98575-68dd-4e4e-a0ad-2710d232fd7a None admin] RBAC: Adding query filter params (type=network) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:41.956824 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a98575-68dd-4e4e-a0ad-2710d232fd7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:41.958444 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a98575-68dd-4e4e-a0ad-2710d232fd7a None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:41.962455 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 412/818] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Aug 9 10:11:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:41.963380 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5afe25-ca50-454f-b4d5-aa803b08d6ee None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:41.965390 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 407/819] 10.222.0.36 () {56 vars in 1112 bytes} [Tue Aug 9 10:11:41 2022] GET /identity/v3/services?type=network => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:41.966520 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a98575-68dd-4e4e-a0ad-2710d232fd7a None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:41.970375 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:42.038313 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:42.075432 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a98575-68dd-4e4e-a0ad-2710d232fd7a None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:42.093883 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5afe25-ca50-454f-b4d5-aa803b08d6ee None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:42.112044 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b6824f-dc53-4c59-bd6e-6e8f24f0abf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:42.112777 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b6824f-dc53-4c59-bd6e-6e8f24f0abf0 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:42.113162 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b6824f-dc53-4c59-bd6e-6e8f24f0abf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:42.113536 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b6824f-dc53-4c59-bd6e-6e8f24f0abf0 None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:42.114327 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b6824f-dc53-4c59-bd6e-6e8f24f0abf0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:42.114752 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b6824f-dc53-4c59-bd6e-6e8f24f0abf0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:42.116211 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b6824f-dc53-4c59-bd6e-6e8f24f0abf0 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:42.129113 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 408/820] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Aug 9 10:11:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:42.130370 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b6824f-dc53-4c59-bd6e-6e8f24f0abf0 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:42.132589 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfff5d6a-300d-4f15-ba3b-9099d065cf60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:42.133193 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff5d6a-300d-4f15-ba3b-9099d065cf60 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:42.133619 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff5d6a-300d-4f15-ba3b-9099d065cf60 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:42.133933 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff5d6a-300d-4f15-ba3b-9099d065cf60 None admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:42.135425 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfff5d6a-300d-4f15-ba3b-9099d065cf60 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:42.135734 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfff5d6a-300d-4f15-ba3b-9099d065cf60 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:42.137738 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfff5d6a-300d-4f15-ba3b-9099d065cf60 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:42.157788 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 413/821] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Aug 9 10:11:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:42.158728 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfff5d6a-300d-4f15-ba3b-9099d065cf60 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:42.242950 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b6824f-dc53-4c59-bd6e-6e8f24f0abf0 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:42.270217 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:42.282500 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66106ac-9fd9-4841-b7e2-fb04fcd05bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:42.283132 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66106ac-9fd9-4841-b7e2-fb04fcd05bf9 None admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:42.283400 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66106ac-9fd9-4841-b7e2-fb04fcd05bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:42.283672 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66106ac-9fd9-4841-b7e2-fb04fcd05bf9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:42.284299 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66106ac-9fd9-4841-b7e2-fb04fcd05bf9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:42.285759 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66106ac-9fd9-4841-b7e2-fb04fcd05bf9 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:42.298083 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfff5d6a-300d-4f15-ba3b-9099d065cf60 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:42.310289 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:42.326014 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 409/822] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:11:42 2022] POST /identity/v3/endpoints => generated 337 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:11:42.327008 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66106ac-9fd9-4841-b7e2-fb04fcd05bf9 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:42.353973 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ab4603-11cb-432d-ac75-aa15ea84133b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:42.355662 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab4603-11cb-432d-ac75-aa15ea84133b None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:42.356172 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab4603-11cb-432d-ac75-aa15ea84133b None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:42.357408 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab4603-11cb-432d-ac75-aa15ea84133b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:42.371477 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ab4603-11cb-432d-ac75-aa15ea84133b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:42.373416 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ab4603-11cb-432d-ac75-aa15ea84133b None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:42.392812 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-a5ab4603-11cb-432d-ac75-aa15ea84133b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:42.392812 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:42.392812 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:42.392812 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:42.392812 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:42.392812 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:42.392812 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:42.392812 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:42.392812 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:42.392812 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:42.392812 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:42.392812 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:42.392812 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 10:11:42.392812 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 10:11:42.392812 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 10:11:42.392812 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 10:11:42.393867 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:42.393867 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:42.393867 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:42.393867 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:42.393867 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:42.393867 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:42.393867 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:42.393867 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:42.393867 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:42.393867 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:42.393867 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:42.393867 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:42.393867 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:42.393867 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:42.393867 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:42.393867 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:42.393867 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 10:11:42.394796 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 10:11:42.394796 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:42.394796 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:42.397598 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 414/823] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:11:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:42.406139 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ab4603-11cb-432d-ac75-aa15ea84133b None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:42.530616 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ab4603-11cb-432d-ac75-aa15ea84133b None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:42.572807 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388f0587-5a1e-417a-92e5-c4846f7d8413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:42.574988 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f0587-5a1e-417a-92e5-c4846f7d8413 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:42.575490 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f0587-5a1e-417a-92e5-c4846f7d8413 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:42.576066 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f0587-5a1e-417a-92e5-c4846f7d8413 None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:42.576927 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388f0587-5a1e-417a-92e5-c4846f7d8413 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:42.577568 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388f0587-5a1e-417a-92e5-c4846f7d8413 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:42.579398 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388f0587-5a1e-417a-92e5-c4846f7d8413 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:42.595447 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 415/824] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Aug 9 10:11:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:42.601458 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388f0587-5a1e-417a-92e5-c4846f7d8413 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:42.603258 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66106ac-9fd9-4841-b7e2-fb04fcd05bf9 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:42.623845 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:42.632617 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:42.647276 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c922ff1e-1f9c-4746-bf03-53955d422f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:42.647878 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c922ff1e-1f9c-4746-bf03-53955d422f32 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:42.648262 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c922ff1e-1f9c-4746-bf03-53955d422f32 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:42.648450 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c922ff1e-1f9c-4746-bf03-53955d422f32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:42.649140 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c922ff1e-1f9c-4746-bf03-53955d422f32 None admin] RBAC: Adding query filter params (role.id=89ca30cbbb634be8a96e9921aa56626b, scope.project.id=28891cf6239a43469326a864fb0d216c, user.id=eb863beaaa9f495c8b64655996c061f2) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:42.649453 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c922ff1e-1f9c-4746-bf03-53955d422f32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:42.652896 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c922ff1e-1f9c-4746-bf03-53955d422f32 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:42.665918 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 410/825] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Aug 9 10:11:42 2022] GET /identity/v3/role_assignments?user.id=eb863beaaa9f495c8b64655996c061f2&scope.project.id=28891cf6239a43469326a864fb0d216c&role.id=89ca30cbbb634be8a96e9921aa56626b => generated 608 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:42.729461 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388f0587-5a1e-417a-92e5-c4846f7d8413 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:42.769934 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfe0e6e-dbc1-46cf-b437-af58abdd7eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:42.771075 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe0e6e-dbc1-46cf-b437-af58abdd7eb0 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:42.771562 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe0e6e-dbc1-46cf-b437-af58abdd7eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:42.772034 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe0e6e-dbc1-46cf-b437-af58abdd7eb0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:42.781787 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfe0e6e-dbc1-46cf-b437-af58abdd7eb0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:42.783615 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfe0e6e-dbc1-46cf-b437-af58abdd7eb0 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:42.798323 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-dbfe0e6e-dbc1-46cf-b437-af58abdd7eb0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 09 10:11:42.798323 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:42.798323 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:42.798323 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:42.798323 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:42.798323 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:42.798323 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:42.798323 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:42.798323 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:42.798323 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:42.798323 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:42.798323 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:42.798323 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 10:11:42.798323 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 10:11:42.798323 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 10:11:42.798323 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 10:11:42.799321 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:42.799321 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:42.799321 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 10:11:42.799321 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 10:11:42.799321 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 10:11:42.799321 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 10:11:42.799321 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:42.799321 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:42.799321 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:42.799321 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:42.799321 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:42.799321 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:42.799321 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:42.799321 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:42.799321 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:42.799321 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:42.799321 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:42.799321 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:42.800274 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:42.800274 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:42.800274 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 10:11:42.800274 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 10:11:42.800274 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 10:11:42.800274 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 10:11:42.800274 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 10:11:42.800274 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 10:11:42.800274 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 09 10:11:42.800274 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:42.802971 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 416/826] 10.222.0.36 () {56 vars in 1117 bytes} [Tue Aug 9 10:11:42 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 10:11:42.809232 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c922ff1e-1f9c-4746-bf03-53955d422f32 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:42.939268 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c922ff1e-1f9c-4746-bf03-53955d422f32 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:42.952425 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdb38f1-34de-4dc0-96d5-09e5ca479045 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:42.952703 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdb38f1-34de-4dc0-96d5-09e5ca479045 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:42.952977 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdb38f1-34de-4dc0-96d5-09e5ca479045 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:42.957222 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 417/827] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:11:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:11:42.959374 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60787835-e7b1-447b-96b3-b959bb7bdcfc None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:42.959641 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60787835-e7b1-447b-96b3-b959bb7bdcfc None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:42.959910 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60787835-e7b1-447b-96b3-b959bb7bdcfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:42.981961 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b02b967-b88e-4533-8feb-02e93058effc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:42.982570 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02b967-b88e-4533-8feb-02e93058effc None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:42.982848 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02b967-b88e-4533-8feb-02e93058effc None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:42.983113 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02b967-b88e-4533-8feb-02e93058effc None admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:42.983836 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b02b967-b88e-4533-8feb-02e93058effc None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:42.984138 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b02b967-b88e-4533-8feb-02e93058effc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:42.985561 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b02b967-b88e-4533-8feb-02e93058effc None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:42.986448 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-60787835-e7b1-447b-96b3-b959bb7bdcfc None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:11:42.987852 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-60787835-e7b1-447b-96b3-b959bb7bdcfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:11:43.005214 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 411/828] 10.222.0.36 () {56 vars in 1149 bytes} [Tue Aug 9 10:11:42 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:11:43.010389 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b02b967-b88e-4533-8feb-02e93058effc None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:43.068923 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:43.081230 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 418/829] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:11:42 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (3 switches on core 0) Aug 09 10:11:43.102673 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60787835-e7b1-447b-96b3-b959bb7bdcfc None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:43.110905 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:43.135591 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b02b967-b88e-4533-8feb-02e93058effc None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:43.172371 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b4b0f5-ac99-46ae-abb5-1ad75a329852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:43.173011 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b4b0f5-ac99-46ae-abb5-1ad75a329852 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:43.173287 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b4b0f5-ac99-46ae-abb5-1ad75a329852 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:43.173554 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b4b0f5-ac99-46ae-abb5-1ad75a329852 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:43.184389 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b4b0f5-ac99-46ae-abb5-1ad75a329852 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:43.185825 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b4b0f5-ac99-46ae-abb5-1ad75a329852 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:43.201770 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-e7b4b0f5-ac99-46ae-abb5-1ad75a329852 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:43.201770 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:43.201770 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:43.201770 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:43.201770 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:43.201770 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:43.201770 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:43.201770 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:43.201770 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:43.201770 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:43.201770 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:43.201770 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:43.201770 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 10:11:43.201770 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 10:11:43.201770 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 10:11:43.201770 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 10:11:43.202761 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:43.202761 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:43.202761 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:43.202761 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:43.202761 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:43.202761 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:43.202761 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:43.202761 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:43.202761 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:43.202761 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:43.202761 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:43.202761 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:43.202761 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:43.202761 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:43.202761 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:43.202761 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:43.202761 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 10:11:43.203658 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 10:11:43.203658 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:43.203658 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:11:43.207603 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 412/830] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:11:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:43.208599 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b4b0f5-ac99-46ae-abb5-1ad75a329852 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:43.216762 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60787835-e7b1-447b-96b3-b959bb7bdcfc None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:43.253325 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d68ad8-eef2-40e5-b4e7-3a307234d17d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:43.254393 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d68ad8-eef2-40e5-b4e7-3a307234d17d None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:43.254893 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d68ad8-eef2-40e5-b4e7-3a307234d17d None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:43.255368 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d68ad8-eef2-40e5-b4e7-3a307234d17d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:43.256156 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d68ad8-eef2-40e5-b4e7-3a307234d17d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:43.257743 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d68ad8-eef2-40e5-b4e7-3a307234d17d None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:43.267440 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-75d68ad8-eef2-40e5-b4e7-3a307234d17d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 09 10:11:43.267440 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:43.267440 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 10:11:43.267440 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 10:11:43.267440 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 10:11:43.267440 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 10:11:43.267440 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 10:11:43.267440 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 10:11:43.267440 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 09 10:11:43.267440 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:43.267440 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 10:11:43.267440 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:43.267440 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:43.267440 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:43.267440 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:43.267440 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:43.267440 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:43.268459 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:43.268459 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:43.268459 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:43.268459 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:43.268459 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:43.268459 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:43.268459 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 10:11:43.268459 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 10:11:43.268459 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 10:11:43.268459 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 10:11:43.268459 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:43.268459 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:43.268459 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:43.268459 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:43.268459 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:43.268459 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:43.269371 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:43.269371 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:43.269371 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:43.269371 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:43.269371 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:43.269371 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:43.269371 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:43.269371 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:43.269371 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:43.269371 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:43.269371 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 10:11:43.269371 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 10:11:43.269371 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 09 10:11:43.269371 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:43.271980 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 419/831] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Aug 9 10:11:43 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 10:11:43.278917 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d68ad8-eef2-40e5-b4e7-3a307234d17d None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:43.309446 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:43.315829 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b4b0f5-ac99-46ae-abb5-1ad75a329852 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:43.353642 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30a0b01-609c-40cf-a25d-8e2e2d438584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:43.354270 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a0b01-609c-40cf-a25d-8e2e2d438584 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:43.355182 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a0b01-609c-40cf-a25d-8e2e2d438584 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:43.355546 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a0b01-609c-40cf-a25d-8e2e2d438584 None admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:43.356361 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30a0b01-609c-40cf-a25d-8e2e2d438584 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:43.356663 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30a0b01-609c-40cf-a25d-8e2e2d438584 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:43.358057 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30a0b01-609c-40cf-a25d-8e2e2d438584 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:43.375630 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 413/832] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Aug 9 10:11:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:11:43.376482 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30a0b01-609c-40cf-a25d-8e2e2d438584 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:43.387629 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:43.440158 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d68ad8-eef2-40e5-b4e7-3a307234d17d None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:43.490670 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e90ee76-6e1c-41b2-9650-b86e33cbde0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:43.491193 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e90ee76-6e1c-41b2-9650-b86e33cbde0a None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:43.491471 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e90ee76-6e1c-41b2-9650-b86e33cbde0a None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:43.491744 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e90ee76-6e1c-41b2-9650-b86e33cbde0a None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:43.491937 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30a0b01-609c-40cf-a25d-8e2e2d438584 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:43.492382 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e90ee76-6e1c-41b2-9650-b86e33cbde0a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:43.492683 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e90ee76-6e1c-41b2-9650-b86e33cbde0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:43.494350 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e90ee76-6e1c-41b2-9650-b86e33cbde0a None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:43.505927 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 420/833] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Aug 9 10:11:43 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:43.506769 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e90ee76-6e1c-41b2-9650-b86e33cbde0a None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:43.533945 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db70aede-a8ea-43ab-b691-846bc633627c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:43.534568 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70aede-a8ea-43ab-b691-846bc633627c None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:43.534890 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70aede-a8ea-43ab-b691-846bc633627c None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:43.535240 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70aede-a8ea-43ab-b691-846bc633627c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:43.543153 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db70aede-a8ea-43ab-b691-846bc633627c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:43.544620 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db70aede-a8ea-43ab-b691-846bc633627c None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:43.556549 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-db70aede-a8ea-43ab-b691-846bc633627c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 10:11:43.556549 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:43.556549 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:43.556549 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:43.556549 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:43.556549 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:43.556549 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:43.556549 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:43.556549 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:43.556549 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:43.556549 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:43.556549 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:43.556549 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 10:11:43.556549 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 10:11:43.556549 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 10:11:43.557477 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 10:11:43.557477 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:43.557477 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:43.557477 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:43.557477 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:43.557477 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:43.557477 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:43.557477 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:43.557477 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:43.557477 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:43.557477 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:43.557477 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:43.557477 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:43.557477 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:43.557477 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:43.557477 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:43.557477 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:43.559605 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 10:11:43.559605 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 10:11:43.559605 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 10:11:43.559605 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 10:11:43.559605 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 10:11:43.559605 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 10:11:43.559605 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 10:11:43.559605 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:11:43.562462 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 414/834] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Aug 9 10:11:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:43.563452 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db70aede-a8ea-43ab-b691-846bc633627c None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:43.583365 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:43.644217 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e90ee76-6e1c-41b2-9650-b86e33cbde0a None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:43.683060 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013d17ad-31b0-44c6-9825-12dc1d56ed16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:43.683850 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013d17ad-31b0-44c6-9825-12dc1d56ed16 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:43.684135 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013d17ad-31b0-44c6-9825-12dc1d56ed16 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:43.684423 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013d17ad-31b0-44c6-9825-12dc1d56ed16 None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:43.685028 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013d17ad-31b0-44c6-9825-12dc1d56ed16 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:43.685324 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013d17ad-31b0-44c6-9825-12dc1d56ed16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:43.686700 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013d17ad-31b0-44c6-9825-12dc1d56ed16 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:43.687993 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:43.689995 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db70aede-a8ea-43ab-b691-846bc633627c None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:43.702311 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 421/835] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Aug 9 10:11:43 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:43.704095 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c110aa-8893-4cab-9ef9-6058016eb6c2 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:43.704652 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c110aa-8893-4cab-9ef9-6058016eb6c2 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:43.704933 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c110aa-8893-4cab-9ef9-6058016eb6c2 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:43.707485 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 422/836] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:11:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:11:43.714000 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa849e2d-8a8b-45d4-b31f-96deea4ae2a0 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:43.714440 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa849e2d-8a8b-45d4-b31f-96deea4ae2a0 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:43.714716 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa849e2d-8a8b-45d4-b31f-96deea4ae2a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:43.739430 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-aa849e2d-8a8b-45d4-b31f-96deea4ae2a0 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:11:43.740647 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-aa849e2d-8a8b-45d4-b31f-96deea4ae2a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:11:43.746028 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da866ec3-49f5-4f25-8f9c-d7a3efcbf011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:43.746761 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da866ec3-49f5-4f25-8f9c-d7a3efcbf011 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:43.747036 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da866ec3-49f5-4f25-8f9c-d7a3efcbf011 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:43.747303 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da866ec3-49f5-4f25-8f9c-d7a3efcbf011 None admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:43.748015 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da866ec3-49f5-4f25-8f9c-d7a3efcbf011 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:43.748318 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da866ec3-49f5-4f25-8f9c-d7a3efcbf011 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:43.749943 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da866ec3-49f5-4f25-8f9c-d7a3efcbf011 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:43.768988 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 415/837] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Aug 9 10:11:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:11:43.770092 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da866ec3-49f5-4f25-8f9c-d7a3efcbf011 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:43.845868 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 423/838] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:11:43 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 10:11:43.865235 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa849e2d-8a8b-45d4-b31f-96deea4ae2a0 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:43.879447 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:43.912242 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da866ec3-49f5-4f25-8f9c-d7a3efcbf011 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:43.965479 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3800522-9167-47e3-8ffd-76662c48bea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:43.967398 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3800522-9167-47e3-8ffd-76662c48bea6 None admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:43.967913 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3800522-9167-47e3-8ffd-76662c48bea6 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:43.968420 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3800522-9167-47e3-8ffd-76662c48bea6 None admin] PATH_INFO: `/v3/projects/28891cf6239a43469326a864fb0d216c/users/cedc4d6c59c44c6d8fb7179070db5e91/roles/1252647548644b48900ef09f1df438fd` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:43.988889 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3800522-9167-47e3-8ffd-76662c48bea6 None admin] RBAC: Authorizing `identity:create_grant(project_id=28891cf6239a43469326a864fb0d216c, user_id=cedc4d6c59c44c6d8fb7179070db5e91, role_id=1252647548644b48900ef09f1df438fd)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:43.989478 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa849e2d-8a8b-45d4-b31f-96deea4ae2a0 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:43.991135 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3800522-9167-47e3-8ffd-76662c48bea6 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:44.008388 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 416/839] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Aug 9 10:11:43 2022] PUT /identity/v3/projects/28891cf6239a43469326a864fb0d216c/users/cedc4d6c59c44c6d8fb7179070db5e91/roles/1252647548644b48900ef09f1df438fd => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:11:44.022470 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:44.033244 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778d052c-d45b-4c15-8b97-e3e254f15938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:44.034152 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d052c-d45b-4c15-8b97-e3e254f15938 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:44.034574 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d052c-d45b-4c15-8b97-e3e254f15938 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:44.034946 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d052c-d45b-4c15-8b97-e3e254f15938 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:44.048332 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778d052c-d45b-4c15-8b97-e3e254f15938 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 10:11:44.053625 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-778d052c-d45b-4c15-8b97-e3e254f15938 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 10:11:44.053625 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:44.053625 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:44.053625 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:44.053625 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:44.053625 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:44.053625 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:44.053625 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:44.053625 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:44.053625 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:44.053625 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:44.053625 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:44.053625 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 10:11:44.053625 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 10:11:44.053625 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 10:11:44.053625 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 10:11:44.054700 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 10:11:44.054700 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 10:11:44.054700 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 10:11:44.054700 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 10:11:44.054700 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:44.054700 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:44.054700 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:44.054700 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:44.054700 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:44.054700 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:44.054700 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:44.054700 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:44.054700 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:44.054700 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:44.054700 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:44.054700 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:44.055554 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:44.055554 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:44.055554 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:44.055554 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:44.055554 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 10:11:44.055554 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 10:11:44.055554 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 10:11:44.055554 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 10:11:44.055554 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 10:11:44.055554 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 10:11:44.055554 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 10:11:44.055554 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:44.061076 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 424/840] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Aug 9 10:11:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:44.062575 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3800522-9167-47e3-8ffd-76662c48bea6 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:44.181083 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3800522-9167-47e3-8ffd-76662c48bea6 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:44.212702 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:44.224083 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8870af-2c0f-4f86-9e33-4e6de42e8edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:44.224933 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8870af-2c0f-4f86-9e33-4e6de42e8edc None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:44.225207 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8870af-2c0f-4f86-9e33-4e6de42e8edc None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:44.225476 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8870af-2c0f-4f86-9e33-4e6de42e8edc None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:44.226181 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8870af-2c0f-4f86-9e33-4e6de42e8edc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:44.226536 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8870af-2c0f-4f86-9e33-4e6de42e8edc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:44.227999 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8870af-2c0f-4f86-9e33-4e6de42e8edc None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:44.241965 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 417/841] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Aug 9 10:11:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:44.243897 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778d052c-d45b-4c15-8b97-e3e254f15938 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:44.349567 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778d052c-d45b-4c15-8b97-e3e254f15938 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:44.384716 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462fe5c9-23bd-4c90-bda6-b9f46ca91e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:44.385669 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462fe5c9-23bd-4c90-bda6-b9f46ca91e79 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:44.386831 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462fe5c9-23bd-4c90-bda6-b9f46ca91e79 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:44.387276 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462fe5c9-23bd-4c90-bda6-b9f46ca91e79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:44.398073 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462fe5c9-23bd-4c90-bda6-b9f46ca91e79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:44.400273 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462fe5c9-23bd-4c90-bda6-b9f46ca91e79 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:44.416221 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-462fe5c9-23bd-4c90-bda6-b9f46ca91e79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:44.416221 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:44.416221 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:44.416221 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:44.416221 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:44.416221 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:44.416221 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:44.416221 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:44.416221 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:44.416221 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:44.416221 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:44.416221 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:44.416221 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 10:11:44.416221 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 10:11:44.416221 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 10:11:44.416221 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 10:11:44.417740 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:44.417740 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:44.417740 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:44.417740 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:44.417740 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:44.417740 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:44.417740 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:44.417740 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:44.417740 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:44.417740 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:44.417740 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:44.417740 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:44.417740 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:44.417740 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:44.417740 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:44.417740 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:44.417740 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 10:11:44.418763 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 10:11:44.418763 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:44.418763 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:44.425042 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 425/842] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:11:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 10:11:44.426569 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8870af-2c0f-4f86-9e33-4e6de42e8edc None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:44.537785 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8870af-2c0f-4f86-9e33-4e6de42e8edc None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:44.578645 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f574b111-a481-431c-bc0f-51cf5d7851a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:44.579634 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f574b111-a481-431c-bc0f-51cf5d7851a2 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:44.580112 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f574b111-a481-431c-bc0f-51cf5d7851a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:44.580597 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f574b111-a481-431c-bc0f-51cf5d7851a2 None admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:44.581489 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f574b111-a481-431c-bc0f-51cf5d7851a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:44.582038 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f574b111-a481-431c-bc0f-51cf5d7851a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:44.583766 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f574b111-a481-431c-bc0f-51cf5d7851a2 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:44.601374 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 418/843] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Aug 9 10:11:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:44.602981 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462fe5c9-23bd-4c90-bda6-b9f46ca91e79 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:44.646811 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:44.706600 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462fe5c9-23bd-4c90-bda6-b9f46ca91e79 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:44.740425 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c6edab-5231-483b-8863-d66804bdb2c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:44.741044 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c6edab-5231-483b-8863-d66804bdb2c9 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:44.741320 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c6edab-5231-483b-8863-d66804bdb2c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:44.741590 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c6edab-5231-483b-8863-d66804bdb2c9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:44.750333 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c6edab-5231-483b-8863-d66804bdb2c9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:44.751772 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c6edab-5231-483b-8863-d66804bdb2c9 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:44.763052 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-c7c6edab-5231-483b-8863-d66804bdb2c9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 09 10:11:44.763052 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:44.763052 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:44.763052 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:44.763052 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:44.763052 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:44.763052 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:44.763052 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:44.763052 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:44.763052 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:44.763052 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:44.763052 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:44.763052 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 10:11:44.763052 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 10:11:44.763052 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 10:11:44.763052 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 10:11:44.763980 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:44.763980 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:44.763980 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 10:11:44.763980 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 10:11:44.763980 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 10:11:44.763980 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 10:11:44.763980 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:44.763980 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:44.763980 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:44.763980 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:44.763980 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:44.763980 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:44.763980 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:44.763980 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:44.763980 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:44.763980 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:44.763980 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:44.763980 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:44.764924 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:44.764924 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:44.764924 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 10:11:44.764924 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 10:11:44.764924 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 10:11:44.764924 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 10:11:44.764924 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 10:11:44.764924 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 10:11:44.764924 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 09 10:11:44.764924 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:44.768791 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 426/844] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Aug 9 10:11:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:44.770164 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f574b111-a481-431c-bc0f-51cf5d7851a2 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:44.822872 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:44.876917 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f574b111-a481-431c-bc0f-51cf5d7851a2 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:44.896198 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8f840b-5439-4c0b-a274-62985907cf54 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:44.896510 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8f840b-5439-4c0b-a274-62985907cf54 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:44.896751 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8f840b-5439-4c0b-a274-62985907cf54 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:44.898612 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 427/845] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:11:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:11:44.906037 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccb55ef-4aa5-4de9-8f8e-40a566961c33 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:44.906576 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccb55ef-4aa5-4de9-8f8e-40a566961c33 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:44.907054 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccb55ef-4aa5-4de9-8f8e-40a566961c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:44.921399 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03254827-5be8-4c7b-9047-9fe343058faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:44.922053 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03254827-5be8-4c7b-9047-9fe343058faa None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:44.922332 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03254827-5be8-4c7b-9047-9fe343058faa None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:44.922603 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03254827-5be8-4c7b-9047-9fe343058faa None admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:44.923320 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03254827-5be8-4c7b-9047-9fe343058faa None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:44.923767 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03254827-5be8-4c7b-9047-9fe343058faa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:44.925665 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03254827-5be8-4c7b-9047-9fe343058faa None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:44.930258 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-2ccb55ef-4aa5-4de9-8f8e-40a566961c33 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:11:44.931691 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-2ccb55ef-4aa5-4de9-8f8e-40a566961c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:11:44.949955 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 419/846] 10.222.0.36 () {56 vars in 1135 bytes} [Tue Aug 9 10:11:44 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:44.954657 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03254827-5be8-4c7b-9047-9fe343058faa None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:45.038002 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 428/847] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:11:44 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 10:11:45.063826 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccb55ef-4aa5-4de9-8f8e-40a566961c33 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:45.074222 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03254827-5be8-4c7b-9047-9fe343058faa None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:45.082210 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:45.101151 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:45.115437 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6689d9f6-391e-41e1-a954-6812352dc4c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:45.116289 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6689d9f6-391e-41e1-a954-6812352dc4c4 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:45.116400 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6689d9f6-391e-41e1-a954-6812352dc4c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:45.116619 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6689d9f6-391e-41e1-a954-6812352dc4c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:45.194358 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccb55ef-4aa5-4de9-8f8e-40a566961c33 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:45.204249 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6689d9f6-391e-41e1-a954-6812352dc4c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:45.206807 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6689d9f6-391e-41e1-a954-6812352dc4c4 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:45.233712 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2facb912-2a0c-4040-84e8-156e35f99836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:45.234421 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2facb912-2a0c-4040-84e8-156e35f99836 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:45.234701 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2facb912-2a0c-4040-84e8-156e35f99836 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:45.235015 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2facb912-2a0c-4040-84e8-156e35f99836 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:45.235619 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2facb912-2a0c-4040-84e8-156e35f99836 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:45.236998 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2facb912-2a0c-4040-84e8-156e35f99836 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:45.246257 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-2facb912-2a0c-4040-84e8-156e35f99836 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 09 10:11:45.246257 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:45.246257 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 10:11:45.246257 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 10:11:45.246257 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 10:11:45.246257 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 10:11:45.246257 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 10:11:45.246257 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 10:11:45.246257 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 09 10:11:45.246257 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:45.246257 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 10:11:45.246257 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:45.246257 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:45.246257 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:45.246257 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:45.246257 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:45.247202 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:45.247202 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:45.247202 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:45.247202 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:45.247202 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:45.247202 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:45.247202 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:45.247202 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 10:11:45.247202 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 10:11:45.247202 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 10:11:45.247202 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 10:11:45.247202 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:45.247202 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:45.247202 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:45.247202 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:45.247202 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:45.247202 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:45.248491 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:45.248491 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:45.248491 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:45.248491 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:45.248491 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:45.248491 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:45.248491 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:45.248491 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:45.248491 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:45.248491 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:45.248491 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 10:11:45.248491 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 10:11:45.248491 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 09 10:11:45.248491 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:45.252315 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 429/848] 10.222.0.36 () {56 vars in 1132 bytes} [Tue Aug 9 10:11:45 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 10:11:45.253338 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2facb912-2a0c-4040-84e8-156e35f99836 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:45.347270 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 420/849] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Aug 9 10:11:44 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 10:11:45.351387 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6689d9f6-391e-41e1-a954-6812352dc4c4 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:45.359425 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:45.360926 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:45.370653 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2facb912-2a0c-4040-84e8-156e35f99836 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:45.408422 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e9c721-86fa-41b9-bfe5-a637836d8539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:45.409526 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e9c721-86fa-41b9-bfe5-a637836d8539 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:45.410055 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e9c721-86fa-41b9-bfe5-a637836d8539 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:45.410534 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e9c721-86fa-41b9-bfe5-a637836d8539 None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:45.411453 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e9c721-86fa-41b9-bfe5-a637836d8539 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:45.411960 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e9c721-86fa-41b9-bfe5-a637836d8539 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:45.413799 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e9c721-86fa-41b9-bfe5-a637836d8539 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:45.424382 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 430/850] 10.222.0.36 () {56 vars in 1126 bytes} [Tue Aug 9 10:11:45 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:11:45.425546 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e9c721-86fa-41b9-bfe5-a637836d8539 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:45.459668 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6689d9f6-391e-41e1-a954-6812352dc4c4 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:45.496043 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2fe8df-ada1-4380-bc42-5565778d0023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:45.496751 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2fe8df-ada1-4380-bc42-5565778d0023 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:45.497024 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2fe8df-ada1-4380-bc42-5565778d0023 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:45.497293 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2fe8df-ada1-4380-bc42-5565778d0023 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:45.508231 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2fe8df-ada1-4380-bc42-5565778d0023 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:45.509773 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2fe8df-ada1-4380-bc42-5565778d0023 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:45.525286 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-4b2fe8df-ada1-4380-bc42-5565778d0023 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:45.525286 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:45.525286 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:45.525286 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:45.525286 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:45.525286 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:45.525286 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:45.525286 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:45.525286 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:45.525286 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:45.525286 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:45.525286 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:45.525286 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 10:11:45.525286 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 10:11:45.525286 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 10:11:45.525286 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 10:11:45.526270 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:45.526270 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:45.526270 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:45.526270 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:45.526270 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:45.526270 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:45.526270 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:45.526270 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:45.526270 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:45.526270 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:45.526270 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:45.526270 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:45.526270 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:45.526270 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:45.526270 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:45.526270 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:45.526270 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 10:11:45.527336 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 10:11:45.527336 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:45.527336 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:11:45.531325 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 421/851] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:11:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:45.532546 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2fe8df-ada1-4380-bc42-5565778d0023 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:45.540069 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e9c721-86fa-41b9-bfe5-a637836d8539 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:45.581146 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a457a218-9cf5-43e3-bc30-b6e92da064f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:45.582187 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a457a218-9cf5-43e3-bc30-b6e92da064f8 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:45.582693 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a457a218-9cf5-43e3-bc30-b6e92da064f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:45.583229 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a457a218-9cf5-43e3-bc30-b6e92da064f8 None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:45.584147 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a457a218-9cf5-43e3-bc30-b6e92da064f8 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:45.584659 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a457a218-9cf5-43e3-bc30-b6e92da064f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:45.586551 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a457a218-9cf5-43e3-bc30-b6e92da064f8 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:45.598194 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 431/852] 10.222.0.36 () {56 vars in 1126 bytes} [Tue Aug 9 10:11:45 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:45.598839 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:45.644579 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2fe8df-ada1-4380-bc42-5565778d0023 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:45.684026 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af68cd-8436-4995-ac1a-9e82105503a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:45.684637 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af68cd-8436-4995-ac1a-9e82105503a1 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:45.684912 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af68cd-8436-4995-ac1a-9e82105503a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:45.685186 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af68cd-8436-4995-ac1a-9e82105503a1 None admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:45.685837 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7af68cd-8436-4995-ac1a-9e82105503a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:45.686192 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7af68cd-8436-4995-ac1a-9e82105503a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:45.687691 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7af68cd-8436-4995-ac1a-9e82105503a1 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:45.706912 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 422/853] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Aug 9 10:11:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:11:45.708315 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a457a218-9cf5-43e3-bc30-b6e92da064f8 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:45.736877 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:45.796386 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1f1611-7074-4522-ab23-bd2de0d42622 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:45.796735 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1f1611-7074-4522-ab23-bd2de0d42622 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:45.796934 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1f1611-7074-4522-ab23-bd2de0d42622 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:45.798568 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 423/854] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:11:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 10:11:45.804057 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb17a96-ebe9-4499-813d-7933d40b3e66 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:45.804412 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb17a96-ebe9-4499-813d-7933d40b3e66 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:45.804757 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb17a96-ebe9-4499-813d-7933d40b3e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:45.826088 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-aeb17a96-ebe9-4499-813d-7933d40b3e66 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:11:45.827232 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a457a218-9cf5-43e3-bc30-b6e92da064f8 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:45.827342 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-aeb17a96-ebe9-4499-813d-7933d40b3e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:11:45.873211 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7252c8b9-bae7-43cb-9abd-f76eeabd70fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:45.873873 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7252c8b9-bae7-43cb-9abd-f76eeabd70fd None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:45.874163 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7252c8b9-bae7-43cb-9abd-f76eeabd70fd None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:45.874440 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7252c8b9-bae7-43cb-9abd-f76eeabd70fd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:45.881496 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7252c8b9-bae7-43cb-9abd-f76eeabd70fd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:45.883067 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7252c8b9-bae7-43cb-9abd-f76eeabd70fd None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:45.898217 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-7252c8b9-bae7-43cb-9abd-f76eeabd70fd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 10:11:45.898217 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:45.898217 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:45.898217 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:45.898217 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:45.898217 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:45.898217 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:45.898217 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:45.898217 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:45.898217 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:45.898217 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:45.898217 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:45.898217 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 10:11:45.898217 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 10:11:45.898217 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 10:11:45.899161 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 10:11:45.899161 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:45.899161 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:45.899161 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:45.899161 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:45.899161 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:45.899161 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:45.899161 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:45.899161 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:45.899161 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:45.899161 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:45.899161 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:45.899161 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:45.899161 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:45.899161 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:45.899161 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:45.899161 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:45.900046 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 10:11:45.900046 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 10:11:45.900046 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 10:11:45.900046 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 10:11:45.900046 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 10:11:45.900046 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 10:11:45.900046 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 10:11:45.900046 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:45.907547 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 432/855] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Aug 9 10:11:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:45.909094 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7252c8b9-bae7-43cb-9abd-f76eeabd70fd None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:45.915167 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 424/856] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:11:45 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 10:11:45.938806 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb17a96-ebe9-4499-813d-7933d40b3e66 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:45.997576 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:46.023211 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:46.046957 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7252c8b9-bae7-43cb-9abd-f76eeabd70fd None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:46.054515 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb17a96-ebe9-4499-813d-7933d40b3e66 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:46.089452 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb53656-2fcc-4ad6-bccc-fc484555a76a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:46.090364 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb53656-2fcc-4ad6-bccc-fc484555a76a None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:46.090885 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb53656-2fcc-4ad6-bccc-fc484555a76a None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:46.091367 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb53656-2fcc-4ad6-bccc-fc484555a76a None admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:46.092193 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb53656-2fcc-4ad6-bccc-fc484555a76a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:46.092307 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0d25b3-522b-4e33-8a4a-5c6432c7cc1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:46.092755 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb53656-2fcc-4ad6-bccc-fc484555a76a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:46.093087 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d25b3-522b-4e33-8a4a-5c6432c7cc1c None admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:46.093433 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d25b3-522b-4e33-8a4a-5c6432c7cc1c None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:46.093774 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d25b3-522b-4e33-8a4a-5c6432c7cc1c None admin] PATH_INFO: `/v3/services` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:46.094522 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0d25b3-522b-4e33-8a4a-5c6432c7cc1c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:46.094948 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb53656-2fcc-4ad6-bccc-fc484555a76a None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:46.096108 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0d25b3-522b-4e33-8a4a-5c6432c7cc1c None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:46.115907 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 433/857] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Aug 9 10:11:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:11:46.118014 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 425/858] 10.222.0.36 () {60 vars in 1141 bytes} [Tue Aug 9 10:11:45 2022] POST /identity/v3/services => generated 251 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 10:11:46.118750 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb53656-2fcc-4ad6-bccc-fc484555a76a None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:46.154169 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5bc866-b4b0-47b8-9439-70054e751040 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:46.154462 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5bc866-b4b0-47b8-9439-70054e751040 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:46.154792 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5bc866-b4b0-47b8-9439-70054e751040 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:46.156502 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 426/859] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:11:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 10:11:46.163634 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1103a-1127-432c-9706-ad7eb005b915 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:46.164011 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1103a-1127-432c-9706-ad7eb005b915 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:46.164363 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1103a-1127-432c-9706-ad7eb005b915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:46.185191 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-5dc1103a-1127-432c-9706-ad7eb005b915 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:11:46.186634 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-5dc1103a-1127-432c-9706-ad7eb005b915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:11:46.254873 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb53656-2fcc-4ad6-bccc-fc484555a76a None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:46.287101 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 427/860] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:11:46 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 10:11:46.302048 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd42f2f-f7b3-4f12-af69-358119be886b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:46.302658 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd42f2f-f7b3-4f12-af69-358119be886b None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:46.302938 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd42f2f-f7b3-4f12-af69-358119be886b None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:46.303211 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd42f2f-f7b3-4f12-af69-358119be886b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:46.303942 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd42f2f-f7b3-4f12-af69-358119be886b None admin] RBAC: Adding query filter params (role.id=89ca30cbbb634be8a96e9921aa56626b, scope.project.id=28891cf6239a43469326a864fb0d216c, user.id=841c5dbaae774944b637c533ebd75b29) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:46.304253 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd42f2f-f7b3-4f12-af69-358119be886b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:46.305703 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd42f2f-f7b3-4f12-af69-358119be886b None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:46.312051 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 434/861] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Aug 9 10:11:46 2022] GET /identity/v3/role_assignments?user.id=841c5dbaae774944b637c533ebd75b29&scope.project.id=28891cf6239a43469326a864fb0d216c&role.id=89ca30cbbb634be8a96e9921aa56626b => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:46.313555 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc1103a-1127-432c-9706-ad7eb005b915 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:46.353908 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:46.439938 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc1103a-1127-432c-9706-ad7eb005b915 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:46.480523 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec82615-a45c-4db1-a3e8-9bb9b3bb3414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:46.481583 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec82615-a45c-4db1-a3e8-9bb9b3bb3414 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:46.481877 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec82615-a45c-4db1-a3e8-9bb9b3bb3414 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:46.482163 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec82615-a45c-4db1-a3e8-9bb9b3bb3414 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:46.492910 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec82615-a45c-4db1-a3e8-9bb9b3bb3414 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 10:11:46.497737 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-cec82615-a45c-4db1-a3e8-9bb9b3bb3414 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 10:11:46.497737 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:46.497737 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:46.497737 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:46.497737 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:46.497737 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:46.497737 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:46.497737 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:46.497737 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:46.497737 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:46.497737 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:46.497737 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:46.497737 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 10:11:46.497737 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 10:11:46.497737 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 10:11:46.497737 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 10:11:46.498690 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 10:11:46.498690 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 10:11:46.498690 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 10:11:46.498690 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 10:11:46.498690 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:46.498690 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:46.498690 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:46.498690 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:46.498690 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:46.498690 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:46.498690 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:46.498690 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:46.498690 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:46.498690 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:46.498690 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:46.498690 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:46.499528 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:46.499528 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:46.499528 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:46.499528 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:46.499528 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 10:11:46.499528 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 10:11:46.499528 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 10:11:46.499528 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 10:11:46.499528 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 10:11:46.499528 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 10:11:46.499528 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 10:11:46.499528 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:11:46.499528 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 428/862] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Aug 9 10:11:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:46.504871 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd42f2f-f7b3-4f12-af69-358119be886b None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:46.513909 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:46.617637 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd42f2f-f7b3-4f12-af69-358119be886b None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:46.656156 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2468cc-2252-4373-8418-92c0f8624d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:46.656808 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2468cc-2252-4373-8418-92c0f8624d35 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:46.657089 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2468cc-2252-4373-8418-92c0f8624d35 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:46.657409 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2468cc-2252-4373-8418-92c0f8624d35 None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:46.658148 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2468cc-2252-4373-8418-92c0f8624d35 None admin] RBAC: Adding query filter params (name=service) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:46.658453 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2468cc-2252-4373-8418-92c0f8624d35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:46.659820 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2468cc-2252-4373-8418-92c0f8624d35 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:46.669676 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 435/863] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Aug 9 10:11:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:46.678925 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec82615-a45c-4db1-a3e8-9bb9b3bb3414 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:46.777898 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:46.784576 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec82615-a45c-4db1-a3e8-9bb9b3bb3414 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:46.823853 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a072b68-3508-4275-98fb-b3f7d22ebe28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:46.824612 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a072b68-3508-4275-98fb-b3f7d22ebe28 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:46.824728 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a072b68-3508-4275-98fb-b3f7d22ebe28 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:46.824985 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a072b68-3508-4275-98fb-b3f7d22ebe28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:46.835526 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a072b68-3508-4275-98fb-b3f7d22ebe28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:46.836969 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a072b68-3508-4275-98fb-b3f7d22ebe28 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:46.851897 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-2a072b68-3508-4275-98fb-b3f7d22ebe28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:46.851897 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:46.851897 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:46.851897 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:46.851897 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:46.851897 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:46.851897 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:46.851897 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:46.851897 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:46.851897 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:46.851897 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:46.851897 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:46.851897 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 10:11:46.851897 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 10:11:46.851897 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 10:11:46.851897 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 10:11:46.852872 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:46.852872 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:46.852872 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:46.852872 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:46.852872 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:46.852872 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:46.852872 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:46.852872 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:46.852872 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:46.852872 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:46.852872 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:46.852872 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:46.852872 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:46.852872 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:46.852872 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:46.852872 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:46.852872 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 10:11:46.853838 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 10:11:46.853838 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:46.853838 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:11:46.857953 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 429/864] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:11:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:46.859810 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2468cc-2252-4373-8418-92c0f8624d35 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:46.929977 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:46.974990 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2468cc-2252-4373-8418-92c0f8624d35 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:47.009223 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55747a84-5dae-4928-93ba-65de8565cc06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:47.009813 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55747a84-5dae-4928-93ba-65de8565cc06 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:47.010113 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55747a84-5dae-4928-93ba-65de8565cc06 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:47.010379 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55747a84-5dae-4928-93ba-65de8565cc06 None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:47.011230 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55747a84-5dae-4928-93ba-65de8565cc06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:47.011408 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55747a84-5dae-4928-93ba-65de8565cc06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:47.012793 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55747a84-5dae-4928-93ba-65de8565cc06 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:47.029526 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 436/865] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Aug 9 10:11:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:47.030843 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a072b68-3508-4275-98fb-b3f7d22ebe28 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:47.136658 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a072b68-3508-4275-98fb-b3f7d22ebe28 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:47.173638 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33931fbd-764d-40f7-98cc-705f66d791e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:47.174653 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33931fbd-764d-40f7-98cc-705f66d791e6 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:47.175142 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33931fbd-764d-40f7-98cc-705f66d791e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:47.175613 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33931fbd-764d-40f7-98cc-705f66d791e6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:47.184637 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33931fbd-764d-40f7-98cc-705f66d791e6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:47.186359 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33931fbd-764d-40f7-98cc-705f66d791e6 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:47.197783 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-33931fbd-764d-40f7-98cc-705f66d791e6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 09 10:11:47.197783 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:47.197783 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:47.197783 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:47.197783 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:47.197783 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:47.197783 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:47.197783 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:47.197783 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:47.197783 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:47.197783 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:47.197783 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:47.197783 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 10:11:47.197783 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 10:11:47.197783 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 10:11:47.197783 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 10:11:47.199861 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:47.199861 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:47.199861 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 10:11:47.199861 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 10:11:47.199861 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 10:11:47.199861 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 10:11:47.199861 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:47.199861 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:47.199861 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:47.199861 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:47.199861 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:47.199861 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:47.199861 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:47.199861 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:47.199861 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:47.199861 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:47.199861 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:47.199861 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:47.200800 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:47.200800 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:47.200800 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 10:11:47.200800 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 10:11:47.200800 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 10:11:47.200800 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 10:11:47.200800 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 10:11:47.200800 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 10:11:47.200800 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 09 10:11:47.200800 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:11:47.203294 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 430/866] 10.222.0.36 () {56 vars in 1117 bytes} [Tue Aug 9 10:11:47 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:47.208893 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55747a84-5dae-4928-93ba-65de8565cc06 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:47.318866 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55747a84-5dae-4928-93ba-65de8565cc06 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:47.346645 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:47.355344 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144ae276-1a31-452e-8c11-bbc2c1e150ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:47.355987 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144ae276-1a31-452e-8c11-bbc2c1e150ab None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:47.356195 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144ae276-1a31-452e-8c11-bbc2c1e150ab None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:47.356470 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144ae276-1a31-452e-8c11-bbc2c1e150ab None admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:47.357203 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144ae276-1a31-452e-8c11-bbc2c1e150ab None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:47.357506 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144ae276-1a31-452e-8c11-bbc2c1e150ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:47.358980 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144ae276-1a31-452e-8c11-bbc2c1e150ab None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:47.378069 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 437/867] 10.222.0.36 () {56 vars in 1149 bytes} [Tue Aug 9 10:11:47 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:47.383454 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33931fbd-764d-40f7-98cc-705f66d791e6 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:47.394505 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:47.497048 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33931fbd-764d-40f7-98cc-705f66d791e6 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:47.532834 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397069b7-e3df-4e78-8315-fbf4840954e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:47.533772 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397069b7-e3df-4e78-8315-fbf4840954e8 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:47.534309 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397069b7-e3df-4e78-8315-fbf4840954e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:47.534779 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397069b7-e3df-4e78-8315-fbf4840954e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:47.607733 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397069b7-e3df-4e78-8315-fbf4840954e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:47.609109 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397069b7-e3df-4e78-8315-fbf4840954e8 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:47.617314 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:47.714242 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 431/868] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Aug 9 10:11:47 2022] GET /identity/v3/auth/tokens => generated 1262 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 10:11:47.719659 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144ae276-1a31-452e-8c11-bbc2c1e150ab None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:47.766313 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee73d09-4ddd-4987-ba7e-0bf85fcd7af2 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:47.766636 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee73d09-4ddd-4987-ba7e-0bf85fcd7af2 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:47.766896 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee73d09-4ddd-4987-ba7e-0bf85fcd7af2 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:47.768480 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 432/869] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:11:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 10:11:47.773124 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119d6daa-f816-42e7-b7e0-5336bd18bb7f None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:47.773407 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119d6daa-f816-42e7-b7e0-5336bd18bb7f None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:47.773686 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119d6daa-f816-42e7-b7e0-5336bd18bb7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:47.795547 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-119d6daa-f816-42e7-b7e0-5336bd18bb7f None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:11:47.796718 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-119d6daa-f816-42e7-b7e0-5336bd18bb7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:11:47.830726 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144ae276-1a31-452e-8c11-bbc2c1e150ab None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:47.866435 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0ab5b1-f13b-4a43-87c8-7247a90b700a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:47.867054 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ab5b1-f13b-4a43-87c8-7247a90b700a None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:47.867277 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ab5b1-f13b-4a43-87c8-7247a90b700a None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:47.867540 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ab5b1-f13b-4a43-87c8-7247a90b700a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:47.876010 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 433/870] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:11:47 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 10:11:47.884116 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0ab5b1-f13b-4a43-87c8-7247a90b700a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:47.884116 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0ab5b1-f13b-4a43-87c8-7247a90b700a None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:47.898267 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119d6daa-f816-42e7-b7e0-5336bd18bb7f None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:47.899133 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-6a0ab5b1-f13b-4a43-87c8-7247a90b700a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:47.899133 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:47.899133 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:47.899133 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:47.899133 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:47.899133 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:47.899133 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:47.899133 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:47.899133 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:47.899133 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:47.899133 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:47.899133 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:47.899133 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 10:11:47.899133 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 10:11:47.899133 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 10:11:47.899133 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 10:11:47.900045 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:47.900045 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:47.900045 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:47.900045 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:47.900045 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:47.900045 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:47.900045 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:47.900045 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:47.900045 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:47.900045 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:47.900045 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:47.900045 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:47.900045 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:47.900045 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:47.900045 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:47.900045 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:47.900045 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 10:11:47.900943 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 10:11:47.900943 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:47.900943 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:47.904609 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 438/871] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:11:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:47.906702 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0ab5b1-f13b-4a43-87c8-7247a90b700a None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:47.950576 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:47.961030 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:48.035134 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0ab5b1-f13b-4a43-87c8-7247a90b700a None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:48.042662 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119d6daa-f816-42e7-b7e0-5336bd18bb7f None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:48.075265 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d831d9d0-4816-43df-82e1-6b1998123e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:48.076355 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831d9d0-4816-43df-82e1-6b1998123e35 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:48.076875 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831d9d0-4816-43df-82e1-6b1998123e35 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:48.077346 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831d9d0-4816-43df-82e1-6b1998123e35 None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:48.078450 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d831d9d0-4816-43df-82e1-6b1998123e35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:48.079050 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d831d9d0-4816-43df-82e1-6b1998123e35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:48.080639 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d831d9d0-4816-43df-82e1-6b1998123e35 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:48.087372 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6d184e-f325-48e7-be38-e109b895afb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:48.087978 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d184e-f325-48e7-be38-e109b895afb3 None admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:48.088251 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d184e-f325-48e7-be38-e109b895afb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:48.088516 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d184e-f325-48e7-be38-e109b895afb3 None admin] PATH_INFO: `/v3/services` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:48.089874 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6d184e-f325-48e7-be38-e109b895afb3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:48.091943 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6d184e-f325-48e7-be38-e109b895afb3 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:48.102105 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 439/872] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Aug 9 10:11:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:11:48.103332 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d831d9d0-4816-43df-82e1-6b1998123e35 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:48.111866 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 434/873] 10.222.0.36 () {60 vars in 1141 bytes} [Tue Aug 9 10:11:47 2022] POST /identity/v3/services => generated 269 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 10:11:48.239501 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:48.244183 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d831d9d0-4816-43df-82e1-6b1998123e35 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:48.289269 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a40798d-f922-4b7b-8746-261586a0a3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:48.289950 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a40798d-f922-4b7b-8746-261586a0a3c5 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:48.290191 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a40798d-f922-4b7b-8746-261586a0a3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:48.290709 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a40798d-f922-4b7b-8746-261586a0a3c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:48.297536 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a40798d-f922-4b7b-8746-261586a0a3c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:48.299126 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a40798d-f922-4b7b-8746-261586a0a3c5 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:48.310760 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-1a40798d-f922-4b7b-8746-261586a0a3c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 10:11:48.310760 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:48.310760 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:48.310760 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:48.310760 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:48.310760 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:48.310760 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:48.310760 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:48.310760 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:48.310760 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:48.310760 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:48.310760 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:48.310760 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 10:11:48.310760 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 10:11:48.310760 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 10:11:48.311656 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 10:11:48.311656 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:48.311656 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:48.311656 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:48.311656 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:48.311656 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:48.311656 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:48.311656 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:48.311656 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:48.311656 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:48.311656 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:48.311656 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:48.311656 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:48.311656 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:48.311656 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:48.311656 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:48.311656 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:48.312557 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 10:11:48.312557 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 10:11:48.312557 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 10:11:48.312557 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 10:11:48.312557 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 10:11:48.312557 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 10:11:48.312557 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 10:11:48.312557 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:48.312557 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 440/874] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Aug 9 10:11:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:48.317802 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6d184e-f325-48e7-be38-e109b895afb3 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:48.335631 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90f1858-754a-4ff1-ab72-25f8abc44b85 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:48.335959 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90f1858-754a-4ff1-ab72-25f8abc44b85 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:48.336178 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90f1858-754a-4ff1-ab72-25f8abc44b85 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:48.337785 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 441/875] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:11:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:11:48.342891 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d292366-1078-45b3-aef2-c8f36bb11a9d None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:48.343172 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d292366-1078-45b3-aef2-c8f36bb11a9d None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:48.343443 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d292366-1078-45b3-aef2-c8f36bb11a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:48.361834 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-8d292366-1078-45b3-aef2-c8f36bb11a9d None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:11:48.363144 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-8d292366-1078-45b3-aef2-c8f36bb11a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:11:48.433905 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 442/876] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:11:48 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 10:11:48.447633 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6d184e-f325-48e7-be38-e109b895afb3 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:48.460384 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:48.460960 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d292366-1078-45b3-aef2-c8f36bb11a9d None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:48.492195 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721747ee-fa81-4f82-8eec-ba35c59d3273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:48.493507 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721747ee-fa81-4f82-8eec-ba35c59d3273 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:48.493969 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721747ee-fa81-4f82-8eec-ba35c59d3273 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:48.494644 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721747ee-fa81-4f82-8eec-ba35c59d3273 None admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:48.495801 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721747ee-fa81-4f82-8eec-ba35c59d3273 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:48.496449 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721747ee-fa81-4f82-8eec-ba35c59d3273 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:48.498767 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721747ee-fa81-4f82-8eec-ba35c59d3273 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:48.515148 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 435/877] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Aug 9 10:11:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:48.521115 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721747ee-fa81-4f82-8eec-ba35c59d3273 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:48.567400 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:48.585898 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d292366-1078-45b3-aef2-c8f36bb11a9d None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:48.627427 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c68013-8425-4d52-8b4c-d441ab923681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:48.628064 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c68013-8425-4d52-8b4c-d441ab923681 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:48.628344 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c68013-8425-4d52-8b4c-d441ab923681 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:48.628612 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c68013-8425-4d52-8b4c-d441ab923681 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:48.629200 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c68013-8425-4d52-8b4c-d441ab923681 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:48.630838 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c68013-8425-4d52-8b4c-d441ab923681 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:48.639260 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721747ee-fa81-4f82-8eec-ba35c59d3273 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:48.640542 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-38c68013-8425-4d52-8b4c-d441ab923681 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 09 10:11:48.640542 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:48.640542 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 10:11:48.640542 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 10:11:48.640542 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 10:11:48.640542 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 10:11:48.640542 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 10:11:48.640542 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 10:11:48.640542 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 09 10:11:48.640542 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:48.640542 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 10:11:48.640542 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:48.640542 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:48.640542 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:48.640542 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:48.640542 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:48.640542 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:48.641507 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:48.641507 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:48.641507 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:48.641507 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:48.641507 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:48.641507 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:48.641507 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 10:11:48.641507 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 10:11:48.641507 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 10:11:48.641507 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 10:11:48.641507 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:48.641507 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:48.641507 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:48.641507 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:48.641507 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:48.641507 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:48.642928 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:48.642928 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:48.642928 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:48.642928 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:48.642928 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:48.642928 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:48.642928 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:48.642928 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:48.642928 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:48.642928 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:48.642928 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 10:11:48.642928 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 10:11:48.642928 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 09 10:11:48.642928 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:48.642928 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 443/878] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Aug 9 10:11:48 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 10:11:48.643717 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41e7524-2613-4ef2-8537-dd135489754a None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:48.643717 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41e7524-2613-4ef2-8537-dd135489754a None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:48.643717 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41e7524-2613-4ef2-8537-dd135489754a None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:48.644728 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 444/879] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:11:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:11:48.649262 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41e7524-2613-4ef2-8537-dd135489754a None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:48.681555 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b63b10-6f45-4136-a4c8-aae16456a49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:48.682187 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b63b10-6f45-4136-a4c8-aae16456a49d None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:48.682498 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b63b10-6f45-4136-a4c8-aae16456a49d None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:48.682960 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b63b10-6f45-4136-a4c8-aae16456a49d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:48.683697 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b63b10-6f45-4136-a4c8-aae16456a49d None admin] RBAC: Adding query filter params (role.id=1252647548644b48900ef09f1df438fd, scope.project.id=28891cf6239a43469326a864fb0d216c, user.id=cedc4d6c59c44c6d8fb7179070db5e91) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:48.684009 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b63b10-6f45-4136-a4c8-aae16456a49d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:48.685430 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b63b10-6f45-4136-a4c8-aae16456a49d None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:48.691537 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 436/880] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Aug 9 10:11:48 2022] GET /identity/v3/role_assignments?user.id=cedc4d6c59c44c6d8fb7179070db5e91&scope.project.id=28891cf6239a43469326a864fb0d216c&role.id=1252647548644b48900ef09f1df438fd => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:48.693652 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da3a9c-538f-47ab-babf-7a36eebda379 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:48.694184 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da3a9c-538f-47ab-babf-7a36eebda379 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:48.695202 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da3a9c-538f-47ab-babf-7a36eebda379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:48.724284 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-c2da3a9c-538f-47ab-babf-7a36eebda379 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:11:48.727056 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-c2da3a9c-538f-47ab-babf-7a36eebda379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:11:48.753084 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:48.766268 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41e7524-2613-4ef2-8537-dd135489754a None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:48.809833 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f518e0-5b32-4e02-85a3-2cfc0159eb1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:48.810907 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f518e0-5b32-4e02-85a3-2cfc0159eb1f None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:48.811462 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f518e0-5b32-4e02-85a3-2cfc0159eb1f None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:48.811965 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f518e0-5b32-4e02-85a3-2cfc0159eb1f None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:48.812950 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f518e0-5b32-4e02-85a3-2cfc0159eb1f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:48.813445 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f518e0-5b32-4e02-85a3-2cfc0159eb1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:48.815067 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f518e0-5b32-4e02-85a3-2cfc0159eb1f None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:48.825861 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 445/881] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Aug 9 10:11:48 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:48.827277 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f518e0-5b32-4e02-85a3-2cfc0159eb1f None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:48.829796 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 437/882] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:11:48 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 10:11:48.844653 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:48.852109 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2da3a9c-538f-47ab-babf-7a36eebda379 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:48.975856 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2da3a9c-538f-47ab-babf-7a36eebda379 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:48.977061 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f518e0-5b32-4e02-85a3-2cfc0159eb1f None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:49.019474 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60a895f-dac0-42d7-a05f-90fd0086469b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:49.020026 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a895f-dac0-42d7-a05f-90fd0086469b None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:49.020305 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a895f-dac0-42d7-a05f-90fd0086469b None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:49.020568 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a895f-dac0-42d7-a05f-90fd0086469b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:49.021147 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60a895f-dac0-42d7-a05f-90fd0086469b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:49.021726 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfbe03f-33af-4c6f-a8bf-98a67daea7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:49.022366 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfbe03f-33af-4c6f-a8bf-98a67daea7d7 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:49.022530 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60a895f-dac0-42d7-a05f-90fd0086469b None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:49.022632 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfbe03f-33af-4c6f-a8bf-98a67daea7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:49.022908 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfbe03f-33af-4c6f-a8bf-98a67daea7d7 None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:49.023541 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfbe03f-33af-4c6f-a8bf-98a67daea7d7 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:49.023850 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfbe03f-33af-4c6f-a8bf-98a67daea7d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:49.025193 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfbe03f-33af-4c6f-a8bf-98a67daea7d7 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:49.032090 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 446/883] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Aug 9 10:11:48 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:49.034299 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-b60a895f-dac0-42d7-a05f-90fd0086469b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 10:11:49.034299 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:49.034299 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 10:11:49.034299 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 10:11:49.034299 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 10:11:49.034299 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 10:11:49.034299 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 10:11:49.034299 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 10:11:49.034299 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 10:11:49.034299 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:11:49.034299 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 10:11:49.034299 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:11:49.034299 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:49.034299 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:49.034299 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:49.034299 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:49.034299 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:49.035306 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:49.035306 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:49.035306 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:49.035306 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:49.035306 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:49.035306 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:49.035306 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 10:11:49.035306 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 10:11:49.035306 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 10:11:49.035306 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 10:11:49.035306 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:49.035306 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:49.035306 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:49.035306 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:49.035306 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:49.035306 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:49.036399 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:49.036399 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:49.036399 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:49.036399 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:49.036399 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:49.036399 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:49.036399 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:49.036399 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:49.036399 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:49.036399 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:49.036399 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 10:11:49.036399 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 10:11:49.036399 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 10:11:49.036399 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:11:49.038074 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfbe03f-33af-4c6f-a8bf-98a67daea7d7 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:49.038955 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 438/884] 10.222.0.36 () {56 vars in 1126 bytes} [Tue Aug 9 10:11:48 2022] GET /identity/v3/services/object-store => generated 93 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 10:11:49.044705 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60a895f-dac0-42d7-a05f-90fd0086469b None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:49.066193 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:49.127570 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:49.152869 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfbe03f-33af-4c6f-a8bf-98a67daea7d7 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:49.173885 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60a895f-dac0-42d7-a05f-90fd0086469b None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:49.188190 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208e5ec6-e845-43a2-aa5a-3470e5105202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:49.188912 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e5ec6-e845-43a2-aa5a-3470e5105202 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:49.189265 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e5ec6-e845-43a2-aa5a-3470e5105202 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:49.189609 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e5ec6-e845-43a2-aa5a-3470e5105202 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:49.190414 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208e5ec6-e845-43a2-aa5a-3470e5105202 None admin] RBAC: Adding query filter params (interface=public, service_id=9360fd542fe244119d087fda81018270, region_id=RegionOne) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:49.190792 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208e5ec6-e845-43a2-aa5a-3470e5105202 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:49.192229 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208e5ec6-e845-43a2-aa5a-3470e5105202 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:49.197755 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 447/885] 10.222.0.36 () {56 vars in 1251 bytes} [Tue Aug 9 10:11:49 2022] GET /identity/v3/endpoints?service_id=9360fd542fe244119d087fda81018270&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:49.204818 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208e5ec6-e845-43a2-aa5a-3470e5105202 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:49.222125 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4128e706-dec3-4deb-a113-0eea0d9f0899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:49.223025 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4128e706-dec3-4deb-a113-0eea0d9f0899 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:49.223779 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4128e706-dec3-4deb-a113-0eea0d9f0899 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:49.224159 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4128e706-dec3-4deb-a113-0eea0d9f0899 None admin] PATH_INFO: `/v3/services` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:49.225149 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4128e706-dec3-4deb-a113-0eea0d9f0899 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:49.225554 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4128e706-dec3-4deb-a113-0eea0d9f0899 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:49.227517 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4128e706-dec3-4deb-a113-0eea0d9f0899 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:49.233937 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 439/886] 10.222.0.36 () {56 vars in 1122 bytes} [Tue Aug 9 10:11:49 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:11:49.241031 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4128e706-dec3-4deb-a113-0eea0d9f0899 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:49.338313 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208e5ec6-e845-43a2-aa5a-3470e5105202 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:49.342408 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:49.365576 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4128e706-dec3-4deb-a113-0eea0d9f0899 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:49.384196 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19eb6a8-340e-4b2d-a7b8-104e4e43acb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:49.385089 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19eb6a8-340e-4b2d-a7b8-104e4e43acb4 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:49.385380 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19eb6a8-340e-4b2d-a7b8-104e4e43acb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:49.386222 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19eb6a8-340e-4b2d-a7b8-104e4e43acb4 None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:49.386835 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19eb6a8-340e-4b2d-a7b8-104e4e43acb4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:49.388209 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19eb6a8-340e-4b2d-a7b8-104e4e43acb4 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:49.402082 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 448/887] 10.222.0.36 () {56 vars in 1087 bytes} [Tue Aug 9 10:11:49 2022] GET /identity/v3/services => generated 1268 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:11:49.408470 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba052c6-b4f3-4814-a7b1-60c0d811054a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:49.409175 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba052c6-b4f3-4814-a7b1-60c0d811054a None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:49.409469 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba052c6-b4f3-4814-a7b1-60c0d811054a None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:49.409717 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba052c6-b4f3-4814-a7b1-60c0d811054a None admin] PATH_INFO: `/v3/services` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:49.410380 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba052c6-b4f3-4814-a7b1-60c0d811054a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:49.410681 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba052c6-b4f3-4814-a7b1-60c0d811054a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:49.412087 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba052c6-b4f3-4814-a7b1-60c0d811054a None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:49.418922 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 440/888] 10.222.0.36 () {56 vars in 1122 bytes} [Tue Aug 9 10:11:49 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:50.208517 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5396cde-733a-4ef0-8cff-8c5776b2fdb6 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:50.209210 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5396cde-733a-4ef0-8cff-8c5776b2fdb6 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:50.209210 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5396cde-733a-4ef0-8cff-8c5776b2fdb6 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:50.210533 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 449/889] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:11:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:11:50.216279 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208bbb06-06f5-4a76-bef9-2d1b64b00402 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:50.216750 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208bbb06-06f5-4a76-bef9-2d1b64b00402 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:50.216904 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208bbb06-06f5-4a76-bef9-2d1b64b00402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:50.234656 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-208bbb06-06f5-4a76-bef9-2d1b64b00402 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:11:50.235824 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-208bbb06-06f5-4a76-bef9-2d1b64b00402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:11:50.305611 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 441/890] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:11:50 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 10:11:50.328655 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5396cde-733a-4ef0-8cff-8c5776b2fdb6 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:50.333514 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:50.440392 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5396cde-733a-4ef0-8cff-8c5776b2fdb6 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:50.475934 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b97ccb1-9859-4e2b-85c1-25d3984a0576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:50.476482 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b97ccb1-9859-4e2b-85c1-25d3984a0576 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:50.476764 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b97ccb1-9859-4e2b-85c1-25d3984a0576 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:50.477036 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b97ccb1-9859-4e2b-85c1-25d3984a0576 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:50.477617 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b97ccb1-9859-4e2b-85c1-25d3984a0576 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:50.479025 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b97ccb1-9859-4e2b-85c1-25d3984a0576 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:50.488530 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-9b97ccb1-9859-4e2b-85c1-25d3984a0576 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 09 10:11:50.488530 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:50.488530 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 10:11:50.488530 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 10:11:50.488530 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 10:11:50.488530 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 10:11:50.488530 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 10:11:50.488530 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 10:11:50.488530 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 09 10:11:50.488530 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:50.488530 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 10:11:50.488530 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:50.488530 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:50.488530 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:50.488530 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:50.488530 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:50.490782 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:50.490782 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:50.490782 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:50.490782 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:50.490782 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:50.490782 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:50.490782 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:50.490782 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 10:11:50.490782 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 10:11:50.490782 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 10:11:50.490782 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 10:11:50.490782 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:50.490782 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:50.490782 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:50.490782 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:50.490782 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:50.490782 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:50.492818 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:50.492818 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:50.492818 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:50.492818 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:50.492818 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:50.492818 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:50.492818 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:50.492818 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:50.492818 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:50.492818 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:50.492818 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 10:11:50.492818 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 10:11:50.492818 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 09 10:11:50.492818 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:50.492818 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 450/891] 10.222.0.36 () {56 vars in 1132 bytes} [Tue Aug 9 10:11:50 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:50.498427 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208bbb06-06f5-4a76-bef9-2d1b64b00402 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:50.574090 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:50.616880 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208bbb06-06f5-4a76-bef9-2d1b64b00402 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:50.653233 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc33d77-7005-4e70-94d6-8831b97a919c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:50.653841 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc33d77-7005-4e70-94d6-8831b97a919c None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:50.654142 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc33d77-7005-4e70-94d6-8831b97a919c None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:50.654413 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc33d77-7005-4e70-94d6-8831b97a919c None admin] PATH_INFO: `/v3/services` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:50.655050 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc33d77-7005-4e70-94d6-8831b97a919c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:50.655354 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc33d77-7005-4e70-94d6-8831b97a919c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:50.656712 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc33d77-7005-4e70-94d6-8831b97a919c None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:50.661956 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 442/892] 10.222.0.36 () {56 vars in 1126 bytes} [Tue Aug 9 10:11:50 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:50.668356 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b97ccb1-9859-4e2b-85c1-25d3984a0576 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:50.736691 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:50.772199 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b97ccb1-9859-4e2b-85c1-25d3984a0576 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:50.807041 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabed9e9-32a2-4761-8f2a-d356f077b3dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:50.808232 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabed9e9-32a2-4761-8f2a-d356f077b3dd None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:50.808526 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabed9e9-32a2-4761-8f2a-d356f077b3dd None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:50.808861 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabed9e9-32a2-4761-8f2a-d356f077b3dd None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:50.809484 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabed9e9-32a2-4761-8f2a-d356f077b3dd None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:50.809784 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabed9e9-32a2-4761-8f2a-d356f077b3dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:50.811157 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabed9e9-32a2-4761-8f2a-d356f077b3dd None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:50.816250 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 451/893] 10.222.0.36 () {56 vars in 1126 bytes} [Tue Aug 9 10:11:50 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:50.821999 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc33d77-7005-4e70-94d6-8831b97a919c None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:50.926496 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b476764-ffc3-4af0-ac37-87bdc6ba6a8f None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:50.926820 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b476764-ffc3-4af0-ac37-87bdc6ba6a8f None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:50.927029 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b476764-ffc3-4af0-ac37-87bdc6ba6a8f None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:50.928607 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 452/894] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:11:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:11:50.938513 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc33d77-7005-4e70-94d6-8831b97a919c None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:50.938800 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e896ecfc-a3ea-4d49-8bd0-59ad0c23579d None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:50.938800 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e896ecfc-a3ea-4d49-8bd0-59ad0c23579d None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:50.938800 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e896ecfc-a3ea-4d49-8bd0-59ad0c23579d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:50.967092 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-e896ecfc-a3ea-4d49-8bd0-59ad0c23579d None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:11:50.968815 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-e896ecfc-a3ea-4d49-8bd0-59ad0c23579d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:11:50.977269 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e84e1-2530-42eb-a69c-9f5486f26cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:50.978202 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e84e1-2530-42eb-a69c-9f5486f26cfe None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:50.978479 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e84e1-2530-42eb-a69c-9f5486f26cfe None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:50.978748 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e84e1-2530-42eb-a69c-9f5486f26cfe None admin] PATH_INFO: `/v3/endpoints` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:50.979985 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964e84e1-2530-42eb-a69c-9f5486f26cfe None admin] RBAC: Adding query filter params (interface=public, service_id=bf6a8b7c092846c6b373f7f02f267856, region_id=RegionOne) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:50.980507 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964e84e1-2530-42eb-a69c-9f5486f26cfe None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:50.983759 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964e84e1-2530-42eb-a69c-9f5486f26cfe None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:50.987086 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:50.992082 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 443/895] 10.222.0.36 () {56 vars in 1251 bytes} [Tue Aug 9 10:11:50 2022] GET /identity/v3/endpoints?service_id=bf6a8b7c092846c6b373f7f02f267856&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:50.998384 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e84e1-2530-42eb-a69c-9f5486f26cfe None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:51.066974 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 453/896] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:11:50 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 10:11:51.089137 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e896ecfc-a3ea-4d49-8bd0-59ad0c23579d None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:51.118513 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e84e1-2530-42eb-a69c-9f5486f26cfe None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:51.152768 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:51.157683 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd26a34-71ae-47f8-874e-dc3d23f5b1bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:51.158760 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd26a34-71ae-47f8-874e-dc3d23f5b1bf None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:51.159451 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd26a34-71ae-47f8-874e-dc3d23f5b1bf None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:51.159723 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd26a34-71ae-47f8-874e-dc3d23f5b1bf None admin] PATH_INFO: `/v3/services` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:51.160326 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd26a34-71ae-47f8-874e-dc3d23f5b1bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:51.161814 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd26a34-71ae-47f8-874e-dc3d23f5b1bf None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:51.168672 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 444/897] 10.222.0.36 () {56 vars in 1087 bytes} [Tue Aug 9 10:11:50 2022] GET /identity/v3/services => generated 1268 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 10:11:51.206489 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e896ecfc-a3ea-4d49-8bd0-59ad0c23579d None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:51.244314 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2171e41a-0585-4fdc-88ca-7616fadbd884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:51.245475 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2171e41a-0585-4fdc-88ca-7616fadbd884 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:51.245712 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2171e41a-0585-4fdc-88ca-7616fadbd884 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:51.249875 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2171e41a-0585-4fdc-88ca-7616fadbd884 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:51.258709 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2171e41a-0585-4fdc-88ca-7616fadbd884 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 10:11:51.264661 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-2171e41a-0585-4fdc-88ca-7616fadbd884 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 09 10:11:51.264661 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:51.264661 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:51.264661 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:51.264661 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:51.264661 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:51.264661 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:51.264661 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:51.264661 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:51.264661 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:51.264661 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:51.264661 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:51.264661 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 10:11:51.264661 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 10:11:51.264661 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 10:11:51.264661 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 10:11:51.265643 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 10:11:51.265643 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 10:11:51.265643 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 10:11:51.265643 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 10:11:51.265643 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:51.265643 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:51.265643 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:51.265643 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:51.265643 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:51.265643 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:51.265643 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:51.265643 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:51.265643 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:51.265643 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:51.265643 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:51.265643 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:51.267426 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:51.267426 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:51.267426 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:51.267426 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:51.267426 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 10:11:51.267426 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 10:11:51.267426 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 10:11:51.267426 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 10:11:51.267426 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 10:11:51.267426 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 10:11:51.267426 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 09 10:11:51.267426 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:51.267426 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 454/898] 10.222.0.36 () {56 vars in 1120 bytes} [Tue Aug 9 10:11:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 10:11:51.275483 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd26a34-71ae-47f8-874e-dc3d23f5b1bf None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:51.349483 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:51.389776 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd26a34-71ae-47f8-874e-dc3d23f5b1bf None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:51.426904 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67969dd9-45b3-4a64-b290-90793b89a2ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:51.427501 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67969dd9-45b3-4a64-b290-90793b89a2ff None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:51.427775 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67969dd9-45b3-4a64-b290-90793b89a2ff None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:51.428043 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67969dd9-45b3-4a64-b290-90793b89a2ff None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:51.428694 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67969dd9-45b3-4a64-b290-90793b89a2ff None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:51.428996 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67969dd9-45b3-4a64-b290-90793b89a2ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:51.430379 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67969dd9-45b3-4a64-b290-90793b89a2ff None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:51.439028 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 445/899] 10.222.0.36 () {56 vars in 1115 bytes} [Tue Aug 9 10:11:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:51.444648 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2171e41a-0585-4fdc-88ca-7616fadbd884 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:51.554149 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2171e41a-0585-4fdc-88ca-7616fadbd884 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:51.555466 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32ba947-4297-41f9-b680-45b4426eac8f None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:51.555758 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32ba947-4297-41f9-b680-45b4426eac8f None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:51.556032 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32ba947-4297-41f9-b680-45b4426eac8f None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:51.557547 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 446/900] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:11:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:11:51.562813 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0b3662-bcb1-4b4f-a766-1e63fbedc703 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:51.563100 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0b3662-bcb1-4b4f-a766-1e63fbedc703 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:51.563384 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0b3662-bcb1-4b4f-a766-1e63fbedc703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:51.582230 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:51.583614 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-fc0b3662-bcb1-4b4f-a766-1e63fbedc703 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:11:51.584914 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-fc0b3662-bcb1-4b4f-a766-1e63fbedc703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:11:51.596668 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc817a4b-fcbb-4169-a6cc-fd85758c7b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:51.597628 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc817a4b-fcbb-4169-a6cc-fd85758c7b4c None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:51.598115 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc817a4b-fcbb-4169-a6cc-fd85758c7b4c None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:51.598569 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc817a4b-fcbb-4169-a6cc-fd85758c7b4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:51.610462 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc817a4b-fcbb-4169-a6cc-fd85758c7b4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:51.611916 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc817a4b-fcbb-4169-a6cc-fd85758c7b4c None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:51.627079 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-cc817a4b-fcbb-4169-a6cc-fd85758c7b4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:51.627079 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:51.627079 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:51.627079 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:51.627079 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:51.627079 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:51.627079 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:51.627079 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:51.627079 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:51.627079 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:51.627079 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:51.627079 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:51.627079 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 10:11:51.627079 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 10:11:51.627079 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 10:11:51.627079 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 10:11:51.628125 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:51.628125 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:51.628125 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:51.628125 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:51.628125 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:51.628125 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:51.628125 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:51.628125 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:51.628125 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:51.628125 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:51.628125 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:51.628125 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:51.628125 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:51.628125 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:51.628125 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:51.628125 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:51.628125 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 10:11:51.633569 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 10:11:51.633569 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:51.633569 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:51.633569 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 455/901] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:11:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:51.633569 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b595f9-1749-43a0-9e05-8319f63b851a None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:51.633569 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b595f9-1749-43a0-9e05-8319f63b851a None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:51.633569 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b595f9-1749-43a0-9e05-8319f63b851a None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:51.633569 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 456/902] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:11:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:11:51.637497 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d7830b-5151-475c-a0c4-4a9da2805bce None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:51.637788 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d7830b-5151-475c-a0c4-4a9da2805bce None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:51.638104 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d7830b-5151-475c-a0c4-4a9da2805bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:51.656506 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-a2d7830b-5151-475c-a0c4-4a9da2805bce None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:11:51.657679 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-a2d7830b-5151-475c-a0c4-4a9da2805bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:11:51.669891 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 447/903] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:11:51 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 10:11:51.669891 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0b3662-bcb1-4b4f-a766-1e63fbedc703 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:51.729901 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 457/904] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:11:51 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 10:11:51.729901 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d7830b-5151-475c-a0c4-4a9da2805bce None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:51.743185 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:51.794509 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0b3662-bcb1-4b4f-a766-1e63fbedc703 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:51.830962 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d7830b-5151-475c-a0c4-4a9da2805bce None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:51.833225 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:51.834768 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d417dd-b0a4-436b-b41e-c8d0f2132335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:51.835617 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d417dd-b0a4-436b-b41e-c8d0f2132335 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:51.835926 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d417dd-b0a4-436b-b41e-c8d0f2132335 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:51.836283 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d417dd-b0a4-436b-b41e-c8d0f2132335 None admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:51.836996 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d417dd-b0a4-436b-b41e-c8d0f2132335 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:51.837302 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d417dd-b0a4-436b-b41e-c8d0f2132335 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:51.838928 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d417dd-b0a4-436b-b41e-c8d0f2132335 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:51.850537 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 448/905] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Aug 9 10:11:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:51.851376 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d417dd-b0a4-436b-b41e-c8d0f2132335 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:51.874243 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4567a4-6f91-4d67-b772-e662ae31482b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:51.874881 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4567a4-6f91-4d67-b772-e662ae31482b None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:51.875162 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4567a4-6f91-4d67-b772-e662ae31482b None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:51.875435 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4567a4-6f91-4d67-b772-e662ae31482b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:51.876026 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4567a4-6f91-4d67-b772-e662ae31482b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:51.877399 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4567a4-6f91-4d67-b772-e662ae31482b None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:51.886501 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-8b4567a4-6f91-4d67-b772-e662ae31482b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 09 10:11:51.886501 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:51.886501 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 10:11:51.886501 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 10:11:51.886501 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 10:11:51.886501 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 10:11:51.886501 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 10:11:51.886501 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 10:11:51.886501 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 09 10:11:51.886501 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:51.886501 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 10:11:51.886501 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:51.886501 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:51.886501 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:51.886501 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:51.886501 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:51.886501 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:51.887693 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:51.887693 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:51.887693 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:51.887693 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:51.887693 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:51.887693 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:51.887693 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 10:11:51.887693 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 10:11:51.887693 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 10:11:51.887693 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 10:11:51.887693 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:51.887693 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:51.887693 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:51.887693 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:51.887693 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:51.887693 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:51.888809 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:51.888809 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:51.888809 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:51.888809 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:51.888809 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:51.888809 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:51.888809 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:51.888809 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:51.888809 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:51.888809 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:51.888809 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 10:11:51.888809 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 10:11:51.888809 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 09 10:11:51.888809 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:51.892348 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 458/906] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Aug 9 10:11:51 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:51.893171 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4567a4-6f91-4d67-b772-e662ae31482b None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:51.973543 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d417dd-b0a4-436b-b41e-c8d0f2132335 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:51.992301 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:52.007898 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4567a4-6f91-4d67-b772-e662ae31482b None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:52.013131 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618d01ac-f6a4-4fcc-8539-da60a787d860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:52.013736 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d01ac-f6a4-4fcc-8539-da60a787d860 None admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:52.014042 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d01ac-f6a4-4fcc-8539-da60a787d860 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:52.014312 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d01ac-f6a4-4fcc-8539-da60a787d860 None admin] PATH_INFO: `/v3/services` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:52.015096 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618d01ac-f6a4-4fcc-8539-da60a787d860 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:52.016539 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618d01ac-f6a4-4fcc-8539-da60a787d860 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:52.037905 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 449/907] 10.222.0.36 () {60 vars in 1141 bytes} [Tue Aug 9 10:11:51 2022] POST /identity/v3/services => generated 241 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:11:52.037905 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618d01ac-f6a4-4fcc-8539-da60a787d860 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:52.070433 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4612a3-6ce9-4beb-8083-b08306f1e19c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:52.071429 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4612a3-6ce9-4beb-8083-b08306f1e19c None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:52.071886 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4612a3-6ce9-4beb-8083-b08306f1e19c None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:52.072358 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4612a3-6ce9-4beb-8083-b08306f1e19c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:52.081528 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4612a3-6ce9-4beb-8083-b08306f1e19c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:52.083349 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4612a3-6ce9-4beb-8083-b08306f1e19c None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:52.096759 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-fd4612a3-6ce9-4beb-8083-b08306f1e19c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 09 10:11:52.096759 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:52.096759 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:52.096759 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:52.096759 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:52.096759 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:52.096759 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:52.096759 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:52.096759 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:52.096759 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:52.096759 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:52.096759 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:52.096759 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 10:11:52.096759 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 10:11:52.096759 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 10:11:52.096759 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 10:11:52.097816 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:52.097816 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:52.097816 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 10:11:52.097816 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 10:11:52.097816 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 10:11:52.097816 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 10:11:52.097816 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:52.097816 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:52.097816 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:52.097816 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:52.097816 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:52.097816 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:52.097816 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:52.097816 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:52.097816 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:52.097816 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:52.097816 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:52.097816 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:52.098784 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:52.098784 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:52.098784 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 10:11:52.098784 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 10:11:52.098784 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 10:11:52.098784 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 10:11:52.098784 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 10:11:52.098784 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 10:11:52.098784 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 09 10:11:52.098784 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:52.101517 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 459/908] 10.222.0.36 () {56 vars in 1117 bytes} [Tue Aug 9 10:11:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:52.111794 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4612a3-6ce9-4beb-8083-b08306f1e19c None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:52.146486 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:52.188750 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618d01ac-f6a4-4fcc-8539-da60a787d860 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:52.243623 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac2a794-78bb-4d34-b0b4-3f3650f8dffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:52.244557 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac2a794-78bb-4d34-b0b4-3f3650f8dffc None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:52.245056 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac2a794-78bb-4d34-b0b4-3f3650f8dffc None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:52.245481 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac2a794-78bb-4d34-b0b4-3f3650f8dffc None admin] PATH_INFO: `/v3/services` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:52.246142 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac2a794-78bb-4d34-b0b4-3f3650f8dffc None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:52.247099 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac2a794-78bb-4d34-b0b4-3f3650f8dffc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:52.247790 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac2a794-78bb-4d34-b0b4-3f3650f8dffc None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:52.256579 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 450/909] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Aug 9 10:11:52 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:52.258816 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4612a3-6ce9-4beb-8083-b08306f1e19c None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:52.264093 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac2a794-78bb-4d34-b0b4-3f3650f8dffc None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:52.298148 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a500d12-1ca8-47e0-afcb-fd4b8c7d57a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:52.298756 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a500d12-1ca8-47e0-afcb-fd4b8c7d57a6 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:52.299074 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a500d12-1ca8-47e0-afcb-fd4b8c7d57a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:52.299339 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a500d12-1ca8-47e0-afcb-fd4b8c7d57a6 None admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:52.300118 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a500d12-1ca8-47e0-afcb-fd4b8c7d57a6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:52.300417 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a500d12-1ca8-47e0-afcb-fd4b8c7d57a6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:52.301984 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a500d12-1ca8-47e0-afcb-fd4b8c7d57a6 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:52.321722 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 460/910] 10.222.0.36 () {56 vars in 1149 bytes} [Tue Aug 9 10:11:52 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:11:52.327169 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:52.327891 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a500d12-1ca8-47e0-afcb-fd4b8c7d57a6 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:52.391685 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac2a794-78bb-4d34-b0b4-3f3650f8dffc None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:52.415301 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:52.431993 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4338dac1-4a95-4a0c-8994-2fc452905e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:52.433398 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4338dac1-4a95-4a0c-8994-2fc452905e35 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:52.434160 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4338dac1-4a95-4a0c-8994-2fc452905e35 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:52.434644 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4338dac1-4a95-4a0c-8994-2fc452905e35 None admin] PATH_INFO: `/v3/services` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:52.435481 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4338dac1-4a95-4a0c-8994-2fc452905e35 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:52.435963 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a500d12-1ca8-47e0-afcb-fd4b8c7d57a6 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:52.436277 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4338dac1-4a95-4a0c-8994-2fc452905e35 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:52.438166 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4338dac1-4a95-4a0c-8994-2fc452905e35 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:52.450200 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 451/911] 10.222.0.36 () {56 vars in 1114 bytes} [Tue Aug 9 10:11:52 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:52.452075 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4338dac1-4a95-4a0c-8994-2fc452905e35 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:52.478332 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900da206-c14c-4f09-ab2e-96e29ef3c00e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:52.479297 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900da206-c14c-4f09-ab2e-96e29ef3c00e None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:52.479297 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900da206-c14c-4f09-ab2e-96e29ef3c00e None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:52.479814 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900da206-c14c-4f09-ab2e-96e29ef3c00e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:52.550558 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900da206-c14c-4f09-ab2e-96e29ef3c00e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:52.552092 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900da206-c14c-4f09-ab2e-96e29ef3c00e None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:52.566550 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4338dac1-4a95-4a0c-8994-2fc452905e35 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:52.569240 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:52.607490 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba11cc34-e80a-497f-8006-6535280ce888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:52.608444 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba11cc34-e80a-497f-8006-6535280ce888 None admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:52.608961 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba11cc34-e80a-497f-8006-6535280ce888 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:52.609436 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba11cc34-e80a-497f-8006-6535280ce888 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:52.610436 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba11cc34-e80a-497f-8006-6535280ce888 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:52.612107 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba11cc34-e80a-497f-8006-6535280ce888 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:52.642483 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 452/912] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:11:52 2022] POST /identity/v3/endpoints => generated 346 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:11:52.643584 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:52.662645 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 461/913] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Aug 9 10:11:52 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 09 10:11:52.668902 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba11cc34-e80a-497f-8006-6535280ce888 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:52.793351 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba11cc34-e80a-497f-8006-6535280ce888 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:52.831841 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13578c7d-ac3e-4776-9641-c0e0e728c4f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:52.832483 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13578c7d-ac3e-4776-9641-c0e0e728c4f1 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:52.832761 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13578c7d-ac3e-4776-9641-c0e0e728c4f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:52.833033 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13578c7d-ac3e-4776-9641-c0e0e728c4f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:52.844700 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13578c7d-ac3e-4776-9641-c0e0e728c4f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:52.846182 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13578c7d-ac3e-4776-9641-c0e0e728c4f1 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:52.862514 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-13578c7d-ac3e-4776-9641-c0e0e728c4f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:52.862514 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:52.862514 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:52.862514 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:52.862514 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:52.862514 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:52.862514 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:52.862514 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:52.862514 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:52.862514 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:52.862514 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:52.862514 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:52.862514 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 10:11:52.862514 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 10:11:52.862514 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 10:11:52.862514 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 10:11:52.863503 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:52.863503 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:52.863503 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:52.863503 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:52.863503 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:52.863503 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:52.863503 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:52.863503 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:52.863503 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:52.863503 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:52.863503 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:52.863503 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:52.863503 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:52.863503 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:52.863503 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:52.863503 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:52.863503 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 10:11:52.864397 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 10:11:52.864397 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:52.864397 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:11:52.864397 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 453/914] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:11:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:52.869485 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900da206-c14c-4f09-ab2e-96e29ef3c00e None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:52.986739 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900da206-c14c-4f09-ab2e-96e29ef3c00e None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:53.022508 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b596bd3-ac29-4e5f-8ba9-0caf0a96a6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:53.023107 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b596bd3-ac29-4e5f-8ba9-0caf0a96a6da None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:53.023386 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b596bd3-ac29-4e5f-8ba9-0caf0a96a6da None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:53.023655 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b596bd3-ac29-4e5f-8ba9-0caf0a96a6da None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:53.024302 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b596bd3-ac29-4e5f-8ba9-0caf0a96a6da None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:53.024603 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b596bd3-ac29-4e5f-8ba9-0caf0a96a6da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:53.025986 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b596bd3-ac29-4e5f-8ba9-0caf0a96a6da None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:53.039111 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 462/915] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Aug 9 10:11:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:53.046940 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13578c7d-ac3e-4776-9641-c0e0e728c4f1 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:53.059346 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:53.156116 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13578c7d-ac3e-4776-9641-c0e0e728c4f1 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:53.190764 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eee7fd-9b3f-42ec-9796-b9bcaef8a2a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:53.191388 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eee7fd-9b3f-42ec-9796-b9bcaef8a2a0 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:53.191657 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eee7fd-9b3f-42ec-9796-b9bcaef8a2a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:53.191920 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eee7fd-9b3f-42ec-9796-b9bcaef8a2a0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:53.199368 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eee7fd-9b3f-42ec-9796-b9bcaef8a2a0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:53.200805 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eee7fd-9b3f-42ec-9796-b9bcaef8a2a0 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:53.212217 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-b8eee7fd-9b3f-42ec-9796-b9bcaef8a2a0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 10:11:53.212217 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:53.212217 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:53.212217 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:53.212217 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:53.212217 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:53.212217 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:53.212217 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:53.212217 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:53.212217 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:53.212217 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:53.212217 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:53.212217 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 10:11:53.212217 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 10:11:53.212217 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 10:11:53.213180 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 10:11:53.213180 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:53.213180 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:53.213180 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:53.213180 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:53.213180 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:53.213180 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:53.213180 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:53.213180 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:53.213180 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:53.213180 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:53.213180 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:53.213180 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:53.213180 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:53.213180 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:53.213180 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:53.213180 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:53.215186 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 10:11:53.215186 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 10:11:53.215186 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 10:11:53.215186 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 10:11:53.215186 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 10:11:53.215186 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 10:11:53.215186 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 10:11:53.215186 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:11:53.215186 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 454/916] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Aug 9 10:11:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:53.222094 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b596bd3-ac29-4e5f-8ba9-0caf0a96a6da None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:53.270244 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:53.287227 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27011f2a-9d8d-40d9-a733-6033a747208c None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:53.287526 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27011f2a-9d8d-40d9-a733-6033a747208c None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:53.287776 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27011f2a-9d8d-40d9-a733-6033a747208c None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:53.293156 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 455/917] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:11:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 10:11:53.294800 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a7b67d-6947-496f-b5d8-7ea5a4a7cbf1 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:53.295154 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a7b67d-6947-496f-b5d8-7ea5a4a7cbf1 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:53.295494 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a7b67d-6947-496f-b5d8-7ea5a4a7cbf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:53.313707 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-b8a7b67d-6947-496f-b5d8-7ea5a4a7cbf1 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:11:53.315010 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-b8a7b67d-6947-496f-b5d8-7ea5a4a7cbf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:11:53.334946 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b596bd3-ac29-4e5f-8ba9-0caf0a96a6da None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:53.375090 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b7ea70-ed3b-42e2-8738-c08f97fc5dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:53.375784 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b7ea70-ed3b-42e2-8738-c08f97fc5dd3 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:53.376126 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b7ea70-ed3b-42e2-8738-c08f97fc5dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:53.376470 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b7ea70-ed3b-42e2-8738-c08f97fc5dd3 None admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:53.377222 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b7ea70-ed3b-42e2-8738-c08f97fc5dd3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:53.377611 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b7ea70-ed3b-42e2-8738-c08f97fc5dd3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:53.379158 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b7ea70-ed3b-42e2-8738-c08f97fc5dd3 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:53.392294 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 463/918] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Aug 9 10:11:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:53.393962 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:53.398887 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b7ea70-ed3b-42e2-8738-c08f97fc5dd3 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:53.404448 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 456/919] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:11:53 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 10:11:53.429129 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a7b67d-6947-496f-b5d8-7ea5a4a7cbf1 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:53.516782 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b7ea70-ed3b-42e2-8738-c08f97fc5dd3 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:53.518652 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:53.538705 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a7b67d-6947-496f-b5d8-7ea5a4a7cbf1 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:53.565440 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cb80df-b2ba-4700-8271-41c30fbc4961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:53.566464 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb80df-b2ba-4700-8271-41c30fbc4961 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:53.567480 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb80df-b2ba-4700-8271-41c30fbc4961 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:53.567958 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb80df-b2ba-4700-8271-41c30fbc4961 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:53.569164 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cb80df-b2ba-4700-8271-41c30fbc4961 None admin] RBAC: Adding query filter params (role.id=285df47e9c4f4da4a33cfc06254dc9ea, scope.project.id=28891cf6239a43469326a864fb0d216c, user.id=cedc4d6c59c44c6d8fb7179070db5e91) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:53.570016 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cb80df-b2ba-4700-8271-41c30fbc4961 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:53.572341 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cb80df-b2ba-4700-8271-41c30fbc4961 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:53.590428 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ec5fc-0f43-4f65-b916-507ea52b69a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:53.590428 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ec5fc-0f43-4f65-b916-507ea52b69a9 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:53.590428 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ec5fc-0f43-4f65-b916-507ea52b69a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:53.590428 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ec5fc-0f43-4f65-b916-507ea52b69a9 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:53.590856 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7ec5fc-0f43-4f65-b916-507ea52b69a9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:53.590856 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7ec5fc-0f43-4f65-b916-507ea52b69a9 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:53.591486 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 464/920] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Aug 9 10:11:53 2022] GET /identity/v3/role_assignments?user.id=cedc4d6c59c44c6d8fb7179070db5e91&scope.project.id=28891cf6239a43469326a864fb0d216c&role.id=285df47e9c4f4da4a33cfc06254dc9ea => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:53.599298 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-7e7ec5fc-0f43-4f65-b916-507ea52b69a9 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 09 10:11:53.599298 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:53.599298 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 10:11:53.599298 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 10:11:53.599298 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 10:11:53.599298 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 10:11:53.599298 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 10:11:53.599298 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 10:11:53.599298 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 09 10:11:53.599298 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:11:53.599298 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 10:11:53.599298 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:11:53.599298 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:53.599298 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:53.599298 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:53.599298 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:53.600333 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:53.600333 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:53.600333 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:53.600333 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:53.600333 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:53.600333 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:53.600333 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:53.600333 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 10:11:53.600333 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 10:11:53.600333 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 10:11:53.600333 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 10:11:53.600333 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:53.600333 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:53.600333 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:53.600333 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:53.600333 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:53.600333 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:53.601254 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:53.601254 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:53.601254 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:53.601254 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:53.601254 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:53.601254 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:53.601254 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:53.601254 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:53.601254 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:53.601254 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:53.601254 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 10:11:53.601254 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 10:11:53.601254 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 09 10:11:53.601254 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:11:53.601254 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 457/921] 10.222.0.36 () {56 vars in 1132 bytes} [Tue Aug 9 10:11:53 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:53.607437 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cb80df-b2ba-4700-8271-41c30fbc4961 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:53.726692 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cb80df-b2ba-4700-8271-41c30fbc4961 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:53.764973 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e7d153-b7df-4b5b-a217-ad8e1c918113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:53.765577 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e7d153-b7df-4b5b-a217-ad8e1c918113 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:53.765870 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e7d153-b7df-4b5b-a217-ad8e1c918113 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:53.766147 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e7d153-b7df-4b5b-a217-ad8e1c918113 None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:53.766780 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e7d153-b7df-4b5b-a217-ad8e1c918113 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:53.767135 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e7d153-b7df-4b5b-a217-ad8e1c918113 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:53.768433 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e7d153-b7df-4b5b-a217-ad8e1c918113 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:53.773645 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 465/922] 10.222.0.36 () {56 vars in 1126 bytes} [Tue Aug 9 10:11:53 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:53.779319 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ec5fc-0f43-4f65-b916-507ea52b69a9 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:53.846802 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:53.893394 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ec5fc-0f43-4f65-b916-507ea52b69a9 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:53.928258 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815604a6-5066-4ad6-a935-33ec3b74c8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:53.928865 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815604a6-5066-4ad6-a935-33ec3b74c8ea None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:53.929141 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815604a6-5066-4ad6-a935-33ec3b74c8ea None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:53.929407 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815604a6-5066-4ad6-a935-33ec3b74c8ea None admin] PATH_INFO: `/v3/services` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:53.930065 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815604a6-5066-4ad6-a935-33ec3b74c8ea None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:53.930364 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815604a6-5066-4ad6-a935-33ec3b74c8ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:53.931769 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815604a6-5066-4ad6-a935-33ec3b74c8ea None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:53.938006 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 458/923] 10.222.0.36 () {56 vars in 1126 bytes} [Tue Aug 9 10:11:53 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:53.948569 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e7d153-b7df-4b5b-a217-ad8e1c918113 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:53.989046 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:54.063605 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e7d153-b7df-4b5b-a217-ad8e1c918113 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:54.100881 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d413ea-00a5-461a-a58c-b18c85ee6263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:54.101482 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d413ea-00a5-461a-a58c-b18c85ee6263 None admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:54.101758 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d413ea-00a5-461a-a58c-b18c85ee6263 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:54.102060 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d413ea-00a5-461a-a58c-b18c85ee6263 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:54.102714 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d413ea-00a5-461a-a58c-b18c85ee6263 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:54.104077 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d413ea-00a5-461a-a58c-b18c85ee6263 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:54.126677 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 466/924] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:11:53 2022] POST /identity/v3/endpoints => generated 347 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:11:54.212732 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d810e75-9d2a-475d-9906-8089962438fe None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:54.213392 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d810e75-9d2a-475d-9906-8089962438fe None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:54.213930 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d810e75-9d2a-475d-9906-8089962438fe None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:54.215864 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 459/925] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:11:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:11:54.221202 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338c1e8e-7b11-4062-b988-0bd254887c02 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:54.221494 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338c1e8e-7b11-4062-b988-0bd254887c02 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:54.221775 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338c1e8e-7b11-4062-b988-0bd254887c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:54.242857 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-338c1e8e-7b11-4062-b988-0bd254887c02 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:11:54.244066 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-338c1e8e-7b11-4062-b988-0bd254887c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:11:54.334942 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 467/926] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:11:54 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 10:11:54.359664 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d810e75-9d2a-475d-9906-8089962438fe None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:54.470637 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d810e75-9d2a-475d-9906-8089962438fe None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:54.497872 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:54.507573 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5e7197-7bee-4b6d-9d1b-b0a011cdb29e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:54.508395 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e7197-7bee-4b6d-9d1b-b0a011cdb29e None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:54.508817 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e7197-7bee-4b6d-9d1b-b0a011cdb29e None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:54.509224 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e7197-7bee-4b6d-9d1b-b0a011cdb29e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:54.509991 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5e7197-7bee-4b6d-9d1b-b0a011cdb29e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:54.512293 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5e7197-7bee-4b6d-9d1b-b0a011cdb29e None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:54.521403 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-fc5e7197-7bee-4b6d-9d1b-b0a011cdb29e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 10:11:54.521403 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:54.521403 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 10:11:54.521403 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 10:11:54.521403 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 10:11:54.521403 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 10:11:54.521403 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 10:11:54.521403 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 10:11:54.521403 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 10:11:54.521403 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:11:54.521403 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 10:11:54.521403 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:11:54.521403 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:54.521403 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:54.521403 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:54.521403 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:54.521403 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:54.522630 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:54.522630 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:54.522630 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:54.522630 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:54.522630 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:54.522630 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:54.522630 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 10:11:54.522630 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 10:11:54.522630 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 10:11:54.522630 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 10:11:54.522630 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:54.522630 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:54.522630 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:54.522630 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:54.522630 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:54.522630 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:54.523699 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:54.523699 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:54.523699 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:54.523699 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:54.523699 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:54.523699 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:54.523699 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:54.523699 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:54.523699 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:54.523699 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:54.523699 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 10:11:54.523699 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 10:11:54.523699 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 10:11:54.523699 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:11:54.529972 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 460/927] 10.222.0.36 () {56 vars in 1126 bytes} [Tue Aug 9 10:11:54 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:54.532535 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338c1e8e-7b11-4062-b988-0bd254887c02 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:54.548574 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:54.642689 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338c1e8e-7b11-4062-b988-0bd254887c02 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:54.684487 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4977dda3-f90d-4466-b587-e6fb04d5cbeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:54.685500 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4977dda3-f90d-4466-b587-e6fb04d5cbeb None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:54.686047 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4977dda3-f90d-4466-b587-e6fb04d5cbeb None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:54.686556 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4977dda3-f90d-4466-b587-e6fb04d5cbeb None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:54.687419 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4977dda3-f90d-4466-b587-e6fb04d5cbeb None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:54.687932 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4977dda3-f90d-4466-b587-e6fb04d5cbeb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:54.689563 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4977dda3-f90d-4466-b587-e6fb04d5cbeb None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:54.695723 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 468/928] 10.222.0.36 () {56 vars in 1122 bytes} [Tue Aug 9 10:11:54 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:54.702135 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5e7197-7bee-4b6d-9d1b-b0a011cdb29e None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:54.808317 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5e7197-7bee-4b6d-9d1b-b0a011cdb29e None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:54.844160 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfd6003-0a4b-46d7-a6c0-b8863e72f1f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:54.845121 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfd6003-0a4b-46d7-a6c0-b8863e72f1f6 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:54.845602 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfd6003-0a4b-46d7-a6c0-b8863e72f1f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:54.846128 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfd6003-0a4b-46d7-a6c0-b8863e72f1f6 None admin] PATH_INFO: `/v3/services` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:54.846955 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfd6003-0a4b-46d7-a6c0-b8863e72f1f6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:54.847457 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfd6003-0a4b-46d7-a6c0-b8863e72f1f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:54.849015 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfd6003-0a4b-46d7-a6c0-b8863e72f1f6 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:54.855274 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 461/929] 10.222.0.36 () {56 vars in 1122 bytes} [Tue Aug 9 10:11:54 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:54.865894 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4977dda3-f90d-4466-b587-e6fb04d5cbeb None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:54.966266 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:54.985442 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4977dda3-f90d-4466-b587-e6fb04d5cbeb None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:54.987948 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6687d1-52a6-4afa-bfbe-e03312f098ab None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:54.988347 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6687d1-52a6-4afa-bfbe-e03312f098ab None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:54.988724 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6687d1-52a6-4afa-bfbe-e03312f098ab None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:54.994240 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 462/930] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:11:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 10:11:54.996125 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3abbb38-3e73-4c24-b0bd-e635cab56046 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:54.996420 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3abbb38-3e73-4c24-b0bd-e635cab56046 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:54.996797 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3abbb38-3e73-4c24-b0bd-e635cab56046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:55.015508 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-a3abbb38-3e73-4c24-b0bd-e635cab56046 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:11:55.016840 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-a3abbb38-3e73-4c24-b0bd-e635cab56046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:11:55.028771 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dd1f9a-6a9e-4850-b7ad-fa01a1050914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:55.029387 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd1f9a-6a9e-4850-b7ad-fa01a1050914 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:55.029672 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd1f9a-6a9e-4850-b7ad-fa01a1050914 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:55.029993 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd1f9a-6a9e-4850-b7ad-fa01a1050914 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:55.030705 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dd1f9a-6a9e-4850-b7ad-fa01a1050914 None admin] RBAC: Adding query filter params (interface=public, service_id=246af8b872554568bcd0509d9367523d, region_id=RegionOne) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:55.031073 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dd1f9a-6a9e-4850-b7ad-fa01a1050914 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:55.032705 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dd1f9a-6a9e-4850-b7ad-fa01a1050914 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:55.038520 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 469/931] 10.222.0.36 () {56 vars in 1251 bytes} [Tue Aug 9 10:11:54 2022] GET /identity/v3/endpoints?service_id=246af8b872554568bcd0509d9367523d&interface=public®ion_id=RegionOne => generated 194 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:55.044261 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dd1f9a-6a9e-4850-b7ad-fa01a1050914 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:55.081010 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:55.103976 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 463/932] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:11:54 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 10:11:55.128815 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3abbb38-3e73-4c24-b0bd-e635cab56046 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:55.164140 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dd1f9a-6a9e-4850-b7ad-fa01a1050914 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:55.209708 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08848af5-ecab-4e3e-8533-f86e09b9426d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:55.210277 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08848af5-ecab-4e3e-8533-f86e09b9426d None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:55.210558 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08848af5-ecab-4e3e-8533-f86e09b9426d None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:55.211013 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08848af5-ecab-4e3e-8533-f86e09b9426d None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:55.211631 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08848af5-ecab-4e3e-8533-f86e09b9426d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:55.214265 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08848af5-ecab-4e3e-8533-f86e09b9426d None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:55.225957 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 470/933] 10.222.0.36 () {56 vars in 1087 bytes} [Tue Aug 9 10:11:55 2022] GET /identity/v3/services => generated 1497 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:11:55.253878 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3abbb38-3e73-4c24-b0bd-e635cab56046 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:55.294125 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2757dc5c-232e-4ab6-a1ed-bc5790ee70f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:55.294759 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2757dc5c-232e-4ab6-a1ed-bc5790ee70f6 None admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:55.295039 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2757dc5c-232e-4ab6-a1ed-bc5790ee70f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:55.295583 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2757dc5c-232e-4ab6-a1ed-bc5790ee70f6 None admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:55.296233 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2757dc5c-232e-4ab6-a1ed-bc5790ee70f6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:55.297690 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2757dc5c-232e-4ab6-a1ed-bc5790ee70f6 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:55.300395 dv-cinder-852364-2-smb devstack@keystone.service[80105]: WARNING keystone.server.flask.common [None req-2757dc5c-232e-4ab6-a1ed-bc5790ee70f6 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 09 10:11:55.322236 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.sql.core [None req-2757dc5c-232e-4ab6-a1ed-bc5790ee70f6 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 09 10:11:55.322236 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 09 10:11:55.322236 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [parameters: {'id': 'fe51f206700242828e85ad750e4ddd75', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 09 10:11:55.322236 dv-cinder-852364-2-smb devstack@keystone.service[80105]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80105) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 09 10:11:55.339992 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-2757dc5c-232e-4ab6-a1ed-bc5790ee70f6 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id fe51f206700242828e85ad750e4ddd75.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id fe51f206700242828e85ad750e4ddd75. Aug 09 10:11:55.339992 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:55.339992 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 09 10:11:55.339992 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 09 10:11:55.339992 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 09 10:11:55.339992 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 09 10:11:55.339992 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 09 10:11:55.339992 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application result = self._query(query) Aug 09 10:11:55.339992 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 09 10:11:55.339992 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application conn.query(q) Aug 09 10:11:55.339992 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 09 10:11:55.339992 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 09 10:11:55.339992 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 09 10:11:55.340880 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application result.read() Aug 09 10:11:55.340880 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 09 10:11:55.340880 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 09 10:11:55.340880 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 09 10:11:55.340880 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 09 10:11:55.340880 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 09 10:11:55.340880 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 09 10:11:55.340880 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 09 10:11:55.340880 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 09 10:11:55.340880 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 09 10:11:55.340880 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:11:55.340880 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 09 10:11:55.340880 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:11:55.340880 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:55.340880 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 09 10:11:55.340880 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 09 10:11:55.340880 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 09 10:11:55.340880 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 09 10:11:55.341834 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 09 10:11:55.341834 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application next(self.gen) Aug 09 10:11:55.341834 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 09 10:11:55.341834 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application yield resource Aug 09 10:11:55.341834 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 09 10:11:55.341834 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application next(self.gen) Aug 09 10:11:55.341834 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 09 10:11:55.341834 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application self.session.rollback() Aug 09 10:11:55.341834 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 10:11:55.341834 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application self.force_reraise() Aug 09 10:11:55.341834 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 10:11:55.341834 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise self.value Aug 09 10:11:55.341834 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 09 10:11:55.341834 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 09 10:11:55.341834 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 09 10:11:55.341834 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application session.commit() Aug 09 10:11:55.341834 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 09 10:11:55.342747 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 09 10:11:55.342747 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 09 10:11:55.342747 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application self._prepare_impl() Aug 09 10:11:55.342747 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 09 10:11:55.342747 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application self.session.flush() Aug 09 10:11:55.342747 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 09 10:11:55.342747 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application self._flush(objects) Aug 09 10:11:55.342747 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 09 10:11:55.342747 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 09 10:11:55.342747 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 09 10:11:55.342747 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application compat.raise_( Aug 09 10:11:55.342747 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 09 10:11:55.342747 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception Aug 09 10:11:55.342747 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 09 10:11:55.342747 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application flush_context.execute() Aug 09 10:11:55.342747 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 09 10:11:55.342747 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rec.execute(self) Aug 09 10:11:55.345439 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 09 10:11:55.345439 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 09 10:11:55.345439 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 09 10:11:55.345439 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 09 10:11:55.345439 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 09 10:11:55.345439 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 09 10:11:55.345439 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 09 10:11:55.345439 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 09 10:11:55.345439 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 09 10:11:55.345439 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 09 10:11:55.345439 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 09 10:11:55.345439 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 09 10:11:55.345439 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 09 10:11:55.345439 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 09 10:11:55.345439 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 09 10:11:55.347882 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 09 10:11:55.347882 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 09 10:11:55.347882 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception Aug 09 10:11:55.347882 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 09 10:11:55.347882 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 09 10:11:55.347882 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 09 10:11:55.347882 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 09 10:11:55.347882 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 09 10:11:55.347882 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application result = self._query(query) Aug 09 10:11:55.347882 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 09 10:11:55.347882 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application conn.query(q) Aug 09 10:11:55.347882 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 09 10:11:55.347882 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 09 10:11:55.347882 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 09 10:11:55.347882 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application result.read() Aug 09 10:11:55.347882 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 09 10:11:55.347882 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 09 10:11:55.350312 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 09 10:11:55.350312 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 09 10:11:55.350312 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 09 10:11:55.350312 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 09 10:11:55.350312 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 09 10:11:55.350312 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 09 10:11:55.350312 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 09 10:11:55.350312 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 09 10:11:55.350312 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [parameters: {'id': 'fe51f206700242828e85ad750e4ddd75', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 09 10:11:55.350312 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 09 10:11:55.350312 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:11:55.350312 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 10:11:55.350312 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:11:55.350312 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:55.350312 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 09 10:11:55.358272 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 09 10:11:55.358272 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 09 10:11:55.358272 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 09 10:11:55.358272 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 09 10:11:55.358272 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:11:55.358272 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 10:11:55.358272 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:11:55.358272 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:55.358272 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:55.358272 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:55.358272 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:55.358272 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:55.358272 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:55.358272 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:55.358272 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:55.358272 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:55.358272 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:55.360442 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:55.360442 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 09 10:11:55.360442 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 09 10:11:55.360442 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:55.360442 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:55.360442 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 09 10:11:55.360442 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 09 10:11:55.360442 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id fe51f206700242828e85ad750e4ddd75. Aug 09 10:11:55.360442 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:11:55.360442 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 464/934] 10.222.0.36 () {60 vars in 1140 bytes} [Tue Aug 9 10:11:55 2022] POST /identity/v3/projects => generated 262 bytes in 219 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 09 10:11:55.361714 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08848af5-ecab-4e3e-8533-f86e09b9426d None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:55.361714 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:55.460253 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08848af5-ecab-4e3e-8533-f86e09b9426d None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:55.497262 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5344c7c0-6e75-4718-9930-f79a613a3e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:55.497970 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5344c7c0-6e75-4718-9930-f79a613a3e8d None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:55.498248 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5344c7c0-6e75-4718-9930-f79a613a3e8d None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:55.498524 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5344c7c0-6e75-4718-9930-f79a613a3e8d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:55.505397 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5344c7c0-6e75-4718-9930-f79a613a3e8d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:55.506914 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5344c7c0-6e75-4718-9930-f79a613a3e8d None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:55.518351 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-5344c7c0-6e75-4718-9930-f79a613a3e8d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 10:11:55.518351 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:55.518351 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:55.518351 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:55.518351 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:55.518351 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:55.518351 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:55.518351 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:55.518351 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:55.518351 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:55.518351 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:55.518351 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:55.518351 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 10:11:55.518351 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 10:11:55.518351 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 10:11:55.520521 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 10:11:55.520521 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:55.520521 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:55.520521 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:55.520521 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:55.520521 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:55.520521 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:55.520521 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:55.520521 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:55.520521 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:55.520521 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:55.520521 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:55.520521 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:55.520521 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:55.520521 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:55.520521 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:55.520521 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:55.522688 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 10:11:55.522688 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 10:11:55.522688 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 10:11:55.522688 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 10:11:55.522688 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 10:11:55.522688 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 10:11:55.522688 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 10:11:55.522688 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:55.522688 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 471/935] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Aug 9 10:11:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 10:11:55.527499 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2757dc5c-232e-4ab6-a1ed-bc5790ee70f6 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:55.573615 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:55.611941 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a87fa8-ebbc-4a58-bb10-1302e8c5f881 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:55.612263 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a87fa8-ebbc-4a58-bb10-1302e8c5f881 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:55.612497 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a87fa8-ebbc-4a58-bb10-1302e8c5f881 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:55.614706 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 472/936] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:11:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 10:11:55.620797 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b55a9-9050-40b6-9f6c-ee33491df7fd None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:55.621374 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b55a9-9050-40b6-9f6c-ee33491df7fd None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:55.621922 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b55a9-9050-40b6-9f6c-ee33491df7fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:55.644239 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-4c3b55a9-9050-40b6-9f6c-ee33491df7fd None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:11:55.645742 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-4c3b55a9-9050-40b6-9f6c-ee33491df7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:11:55.650320 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2757dc5c-232e-4ab6-a1ed-bc5790ee70f6 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:55.689871 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9c2162-48fb-4721-9366-38de2d7fea02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:55.690522 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9c2162-48fb-4721-9366-38de2d7fea02 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:55.690798 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9c2162-48fb-4721-9366-38de2d7fea02 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:55.691116 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9c2162-48fb-4721-9366-38de2d7fea02 None admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:55.691780 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9c2162-48fb-4721-9366-38de2d7fea02 None admin] RBAC: Adding query filter params (name=service) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:55.692082 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9c2162-48fb-4721-9366-38de2d7fea02 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:55.693701 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9c2162-48fb-4721-9366-38de2d7fea02 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:55.714355 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:55.716552 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 465/937] 10.222.0.36 () {56 vars in 1112 bytes} [Tue Aug 9 10:11:55 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:55.726021 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 473/938] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:11:55 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 10:11:55.749598 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9c2162-48fb-4721-9366-38de2d7fea02 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:55.861501 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:55.865464 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9c2162-48fb-4721-9366-38de2d7fea02 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:55.903712 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc04102-2e3c-44b7-bf7a-bd59eca82e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:55.904349 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc04102-2e3c-44b7-bf7a-bd59eca82e58 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:55.904630 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc04102-2e3c-44b7-bf7a-bd59eca82e58 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:55.904903 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc04102-2e3c-44b7-bf7a-bd59eca82e58 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:55.917134 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc04102-2e3c-44b7-bf7a-bd59eca82e58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 10:11:55.922222 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-bcc04102-2e3c-44b7-bf7a-bd59eca82e58 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 09 10:11:55.922222 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:55.922222 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:55.922222 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:55.922222 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:55.922222 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:55.922222 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:55.922222 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:55.922222 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:55.922222 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:55.922222 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:55.922222 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:55.922222 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 10:11:55.922222 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 10:11:55.922222 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 10:11:55.922222 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 10:11:55.923167 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 10:11:55.923167 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 10:11:55.923167 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 10:11:55.923167 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 10:11:55.923167 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:55.923167 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:55.923167 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:55.923167 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:55.923167 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:55.923167 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:55.923167 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:55.923167 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:55.923167 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:55.923167 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:55.923167 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:55.923167 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:55.924011 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:55.924011 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:55.924011 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:55.924011 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:55.924011 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 10:11:55.924011 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 10:11:55.924011 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 10:11:55.924011 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 10:11:55.924011 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 10:11:55.924011 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 10:11:55.924011 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 09 10:11:55.924011 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:11:55.924011 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 466/939] 10.222.0.36 () {56 vars in 1120 bytes} [Tue Aug 9 10:11:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:55.929465 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3b55a9-9050-40b6-9f6c-ee33491df7fd None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:56.037878 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3b55a9-9050-40b6-9f6c-ee33491df7fd None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:56.077837 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f2dccd-b323-4940-a738-e441bf902d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:56.078611 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f2dccd-b323-4940-a738-e441bf902d10 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:56.078894 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f2dccd-b323-4940-a738-e441bf902d10 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:56.079163 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f2dccd-b323-4940-a738-e441bf902d10 None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:56.079828 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f2dccd-b323-4940-a738-e441bf902d10 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:56.080127 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f2dccd-b323-4940-a738-e441bf902d10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:56.081496 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f2dccd-b323-4940-a738-e441bf902d10 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:56.090547 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 474/940] 10.222.0.36 () {56 vars in 1115 bytes} [Tue Aug 9 10:11:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:56.096074 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc04102-2e3c-44b7-bf7a-bd59eca82e58 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:56.206986 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc04102-2e3c-44b7-bf7a-bd59eca82e58 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:56.244029 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c827b21-acab-431e-9a69-a0989883716e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:56.244657 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c827b21-acab-431e-9a69-a0989883716e None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:56.245539 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c827b21-acab-431e-9a69-a0989883716e None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:56.245781 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c827b21-acab-431e-9a69-a0989883716e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:56.256149 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c827b21-acab-431e-9a69-a0989883716e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:56.257598 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c827b21-acab-431e-9a69-a0989883716e None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:56.273138 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-4c827b21-acab-431e-9a69-a0989883716e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:56.273138 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:56.273138 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:56.273138 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:56.273138 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:56.273138 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:56.273138 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:56.273138 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:56.273138 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:56.273138 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:56.273138 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:56.273138 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:56.273138 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 10:11:56.273138 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 10:11:56.273138 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 10:11:56.273138 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 10:11:56.274226 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:56.274226 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:56.274226 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:56.274226 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:56.274226 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:56.274226 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:56.274226 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:56.274226 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:56.274226 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:56.274226 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:56.274226 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:56.274226 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:56.274226 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:56.274226 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:56.274226 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:56.274226 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:56.274226 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 10:11:56.275203 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 10:11:56.275203 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:56.275203 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:11:56.275203 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 467/941] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:11:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:56.282174 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f2dccd-b323-4940-a738-e441bf902d10 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:56.343622 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae02c6bb-80e9-465a-8074-fe1454ee782b None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:56.343805 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae02c6bb-80e9-465a-8074-fe1454ee782b None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:56.344091 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae02c6bb-80e9-465a-8074-fe1454ee782b None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:56.344552 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:56.345754 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 468/942] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:11:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:11:56.355711 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa3787f-bc84-488b-bfcc-30e8dc330f3c None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:56.356124 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa3787f-bc84-488b-bfcc-30e8dc330f3c None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:56.356524 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa3787f-bc84-488b-bfcc-30e8dc330f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:56.375553 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-bfa3787f-bc84-488b-bfcc-30e8dc330f3c None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:11:56.377212 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-bfa3787f-bc84-488b-bfcc-30e8dc330f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:11:56.386114 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:56.401731 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f2dccd-b323-4940-a738-e441bf902d10 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:56.438464 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97ba594-99d2-4325-b36a-13b3f7d63f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:56.439328 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ba594-99d2-4325-b36a-13b3f7d63f46 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:56.439770 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ba594-99d2-4325-b36a-13b3f7d63f46 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:56.440202 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ba594-99d2-4325-b36a-13b3f7d63f46 None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:56.441012 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97ba594-99d2-4325-b36a-13b3f7d63f46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:56.441464 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97ba594-99d2-4325-b36a-13b3f7d63f46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:56.443079 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97ba594-99d2-4325-b36a-13b3f7d63f46 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:56.460638 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 475/943] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Aug 9 10:11:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:11:56.460921 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 469/944] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:11:56 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 10:11:56.461805 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa3787f-bc84-488b-bfcc-30e8dc330f3c None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:56.486032 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97ba594-99d2-4325-b36a-13b3f7d63f46 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:56.568281 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa3787f-bc84-488b-bfcc-30e8dc330f3c None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:56.600955 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97ba594-99d2-4325-b36a-13b3f7d63f46 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:56.608352 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0be193-511c-4da0-8943-3cc3ea1d5037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:56.608994 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0be193-511c-4da0-8943-3cc3ea1d5037 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:56.609276 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0be193-511c-4da0-8943-3cc3ea1d5037 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:56.609546 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0be193-511c-4da0-8943-3cc3ea1d5037 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:56.617048 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0be193-511c-4da0-8943-3cc3ea1d5037 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:56.618565 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0be193-511c-4da0-8943-3cc3ea1d5037 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:56.623094 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:56.632807 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-8f0be193-511c-4da0-8943-3cc3ea1d5037 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 09 10:11:56.632807 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:56.632807 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:56.632807 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:56.632807 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:56.632807 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:56.632807 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:56.632807 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:56.632807 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:56.632807 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:56.632807 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:56.632807 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:56.632807 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 10:11:56.632807 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 10:11:56.632807 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 10:11:56.632807 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 10:11:56.633810 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:56.633810 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:56.633810 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 10:11:56.633810 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 10:11:56.633810 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 10:11:56.633810 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 10:11:56.633810 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:56.633810 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:56.633810 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:56.633810 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:56.633810 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:56.633810 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:56.633810 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:56.633810 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:56.633810 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:56.633810 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:56.633810 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:56.633810 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:56.634855 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:56.634855 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:56.634855 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 10:11:56.634855 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 10:11:56.634855 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 10:11:56.634855 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 10:11:56.634855 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 10:11:56.634855 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 10:11:56.634855 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 09 10:11:56.634855 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:11:56.634855 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 470/945] 10.222.0.36 () {56 vars in 1117 bytes} [Tue Aug 9 10:11:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:56.640194 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0be193-511c-4da0-8943-3cc3ea1d5037 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:56.643192 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:56.648927 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d6d2ce-eda8-4624-a9cf-e08078798390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:56.649836 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d6d2ce-eda8-4624-a9cf-e08078798390 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:56.650367 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d6d2ce-eda8-4624-a9cf-e08078798390 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:56.651977 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d6d2ce-eda8-4624-a9cf-e08078798390 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:56.652837 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d6d2ce-eda8-4624-a9cf-e08078798390 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:56.654580 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d6d2ce-eda8-4624-a9cf-e08078798390 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:56.664330 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-42d6d2ce-eda8-4624-a9cf-e08078798390 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 09 10:11:56.664330 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:56.664330 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 10:11:56.664330 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 10:11:56.664330 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 10:11:56.664330 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 10:11:56.664330 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 10:11:56.664330 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 10:11:56.664330 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 09 10:11:56.664330 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:56.664330 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 10:11:56.664330 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:56.664330 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:56.664330 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:56.664330 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:56.664330 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:56.664330 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:56.665404 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:56.665404 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:56.665404 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:56.665404 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:56.665404 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:56.665404 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:56.665404 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 10:11:56.665404 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 10:11:56.665404 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 10:11:56.665404 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 10:11:56.665404 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:56.665404 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:56.665404 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:56.665404 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:56.665404 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:56.665404 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:56.666550 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:56.666550 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:56.666550 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:56.666550 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:56.666550 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:56.666550 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:56.666550 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:56.666550 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:56.666550 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:56.666550 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:56.666550 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 10:11:56.666550 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 10:11:56.666550 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 09 10:11:56.666550 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:56.669582 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 476/946] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Aug 9 10:11:56 2022] GET /identity/v3/services/compute => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 10:11:56.675014 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d6d2ce-eda8-4624-a9cf-e08078798390 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:56.753374 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0be193-511c-4da0-8943-3cc3ea1d5037 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:56.783214 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d6d2ce-eda8-4624-a9cf-e08078798390 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:56.790073 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da08a1d9-c13d-4f41-a47f-31812aeacd18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:56.790933 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da08a1d9-c13d-4f41-a47f-31812aeacd18 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:56.791212 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da08a1d9-c13d-4f41-a47f-31812aeacd18 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:56.791483 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da08a1d9-c13d-4f41-a47f-31812aeacd18 None admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:56.792478 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da08a1d9-c13d-4f41-a47f-31812aeacd18 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:56.792685 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da08a1d9-c13d-4f41-a47f-31812aeacd18 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:56.794126 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da08a1d9-c13d-4f41-a47f-31812aeacd18 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:56.818016 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 471/947] 10.222.0.36 () {56 vars in 1149 bytes} [Tue Aug 9 10:11:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:11:56.819543 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da08a1d9-c13d-4f41-a47f-31812aeacd18 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:56.824127 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21dac9f-230d-46e9-8e3b-5a94b9fafd68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:56.825445 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21dac9f-230d-46e9-8e3b-5a94b9fafd68 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:56.825445 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21dac9f-230d-46e9-8e3b-5a94b9fafd68 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:56.825445 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21dac9f-230d-46e9-8e3b-5a94b9fafd68 None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:56.826103 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21dac9f-230d-46e9-8e3b-5a94b9fafd68 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:56.826407 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21dac9f-230d-46e9-8e3b-5a94b9fafd68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:56.827778 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21dac9f-230d-46e9-8e3b-5a94b9fafd68 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:56.837812 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 477/948] 10.222.0.36 () {56 vars in 1112 bytes} [Tue Aug 9 10:11:56 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:56.838579 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21dac9f-230d-46e9-8e3b-5a94b9fafd68 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:56.900020 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:56.902203 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:56.952908 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da08a1d9-c13d-4f41-a47f-31812aeacd18 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:56.961480 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21dac9f-230d-46e9-8e3b-5a94b9fafd68 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:56.994050 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46015a56-a281-4de2-ba6d-e6b0c54c5200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:56.994737 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46015a56-a281-4de2-ba6d-e6b0c54c5200 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:56.995027 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46015a56-a281-4de2-ba6d-e6b0c54c5200 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:56.995296 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46015a56-a281-4de2-ba6d-e6b0c54c5200 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:57.003443 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbb1c6a-8150-45be-9fe9-ef29f6dad840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:57.004055 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb1c6a-8150-45be-9fe9-ef29f6dad840 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:57.004339 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb1c6a-8150-45be-9fe9-ef29f6dad840 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:57.004610 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb1c6a-8150-45be-9fe9-ef29f6dad840 None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:57.005249 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbb1c6a-8150-45be-9fe9-ef29f6dad840 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:57.005551 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbb1c6a-8150-45be-9fe9-ef29f6dad840 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:57.006952 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbb1c6a-8150-45be-9fe9-ef29f6dad840 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:57.012760 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 478/949] 10.222.0.36 () {56 vars in 1112 bytes} [Tue Aug 9 10:11:56 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:11:57.023130 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46015a56-a281-4de2-ba6d-e6b0c54c5200 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:57.024640 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46015a56-a281-4de2-ba6d-e6b0c54c5200 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:57.042978 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-46015a56-a281-4de2-ba6d-e6b0c54c5200 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:57.042978 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:57.042978 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:57.042978 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:57.042978 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:57.042978 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:57.042978 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:57.042978 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:57.042978 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:57.042978 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:57.042978 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:57.042978 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:57.042978 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 10:11:57.042978 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 10:11:57.042978 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 10:11:57.042978 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 10:11:57.044076 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:57.044076 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:57.044076 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:57.044076 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:57.044076 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:57.044076 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:57.044076 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:57.044076 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:57.044076 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:57.044076 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:57.044076 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:57.044076 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:57.044076 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:57.044076 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:57.044076 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:57.044076 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:57.044076 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 10:11:57.046423 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 10:11:57.046423 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:11:57.046423 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:11:57.046423 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 472/950] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:11:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:57.052408 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbb1c6a-8150-45be-9fe9-ef29f6dad840 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:57.168143 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbb1c6a-8150-45be-9fe9-ef29f6dad840 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:57.178238 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:57.207638 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57ec023-8b0a-449f-b2d9-fc4af5373644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:57.208561 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ec023-8b0a-449f-b2d9-fc4af5373644 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:57.208846 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ec023-8b0a-449f-b2d9-fc4af5373644 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:57.209117 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ec023-8b0a-449f-b2d9-fc4af5373644 None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:57.209818 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57ec023-8b0a-449f-b2d9-fc4af5373644 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:57.210169 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57ec023-8b0a-449f-b2d9-fc4af5373644 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:57.211539 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57ec023-8b0a-449f-b2d9-fc4af5373644 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:57.226028 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 479/951] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Aug 9 10:11:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:11:57.233385 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46015a56-a281-4de2-ba6d-e6b0c54c5200 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:57.346949 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46015a56-a281-4de2-ba6d-e6b0c54c5200 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:57.361470 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:57.387831 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ea540c-12be-4f4b-b8fb-2ce8b3c45c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:57.388837 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ea540c-12be-4f4b-b8fb-2ce8b3c45c97 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:57.389343 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ea540c-12be-4f4b-b8fb-2ce8b3c45c97 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:57.389827 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ea540c-12be-4f4b-b8fb-2ce8b3c45c97 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:57.397448 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ea540c-12be-4f4b-b8fb-2ce8b3c45c97 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:57.399217 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ea540c-12be-4f4b-b8fb-2ce8b3c45c97 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:57.411560 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-f6ea540c-12be-4f4b-b8fb-2ce8b3c45c97 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 10:11:57.411560 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:57.411560 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:57.411560 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:57.411560 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:57.411560 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:57.411560 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:57.411560 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:57.411560 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:57.411560 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:57.411560 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:57.411560 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:57.411560 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 10:11:57.411560 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 10:11:57.411560 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 10:11:57.412515 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 10:11:57.412515 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:57.412515 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:57.412515 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:57.412515 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:57.412515 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:57.412515 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:57.412515 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:57.412515 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:57.412515 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:57.412515 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:57.412515 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:57.412515 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:57.412515 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:57.412515 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:57.412515 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:57.412515 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:57.413416 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 10:11:57.413416 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 10:11:57.413416 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 10:11:57.413416 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 10:11:57.413416 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 10:11:57.413416 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 10:11:57.413416 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 10:11:57.413416 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:11:57.416173 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 473/952] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Aug 9 10:11:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:57.424544 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57ec023-8b0a-449f-b2d9-fc4af5373644 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:57.431567 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f91713c-8d93-46b7-81ee-bb08e0c742c5 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:57.431979 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f91713c-8d93-46b7-81ee-bb08e0c742c5 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:57.432794 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f91713c-8d93-46b7-81ee-bb08e0c742c5 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:57.437974 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 474/953] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:11:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 10:11:57.439979 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeeb296-15df-451b-95ae-63e2f6a4add4 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:57.440336 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeeb296-15df-451b-95ae-63e2f6a4add4 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:57.440611 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeeb296-15df-451b-95ae-63e2f6a4add4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:57.461054 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-baeeb296-15df-451b-95ae-63e2f6a4add4 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:11:57.462268 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-baeeb296-15df-451b-95ae-63e2f6a4add4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:11:57.545990 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 475/954] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:11:57 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 10:11:57.564163 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeeb296-15df-451b-95ae-63e2f6a4add4 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:57.564736 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57ec023-8b0a-449f-b2d9-fc4af5373644 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:57.614655 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2687e785-3029-411a-aa10-c9ff5ca57587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:57.615271 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2687e785-3029-411a-aa10-c9ff5ca57587 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:57.615546 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2687e785-3029-411a-aa10-c9ff5ca57587 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:57.615814 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2687e785-3029-411a-aa10-c9ff5ca57587 None admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:57.617116 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2687e785-3029-411a-aa10-c9ff5ca57587 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:57.617419 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2687e785-3029-411a-aa10-c9ff5ca57587 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:57.619384 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2687e785-3029-411a-aa10-c9ff5ca57587 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:57.636551 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 480/955] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Aug 9 10:11:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:57.643187 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2687e785-3029-411a-aa10-c9ff5ca57587 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:57.685702 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:57.714097 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeeb296-15df-451b-95ae-63e2f6a4add4 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:57.716899 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:57.772590 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc46e395-494c-4ecf-8fd2-3513f79be2f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:57.773234 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2687e785-3029-411a-aa10-c9ff5ca57587 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:57.774221 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc46e395-494c-4ecf-8fd2-3513f79be2f3 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:57.775257 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc46e395-494c-4ecf-8fd2-3513f79be2f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:57.777820 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc46e395-494c-4ecf-8fd2-3513f79be2f3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:57.778884 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc46e395-494c-4ecf-8fd2-3513f79be2f3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:57.780440 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc46e395-494c-4ecf-8fd2-3513f79be2f3 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:57.792312 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-dc46e395-494c-4ecf-8fd2-3513f79be2f3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 10:11:57.792312 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:57.792312 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 10:11:57.792312 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 10:11:57.792312 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 10:11:57.792312 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 10:11:57.792312 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 10:11:57.792312 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 10:11:57.792312 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 10:11:57.792312 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:11:57.792312 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 10:11:57.792312 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:11:57.792312 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:57.792312 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:57.792312 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:57.792312 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:57.792312 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:57.793708 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:57.793708 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:57.793708 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:57.793708 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:57.793708 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:57.793708 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:57.793708 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 10:11:57.793708 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 10:11:57.793708 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 10:11:57.793708 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 10:11:57.793708 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:57.793708 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:57.793708 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:57.793708 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:57.793708 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:57.793708 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:57.794927 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:57.794927 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:57.794927 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:57.794927 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:57.794927 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:57.794927 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:57.794927 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:57.794927 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:57.794927 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:57.794927 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:57.794927 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 10:11:57.794927 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 10:11:57.794927 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 10:11:57.794927 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:11:57.801627 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 476/956] 10.222.0.36 () {56 vars in 1126 bytes} [Tue Aug 9 10:11:57 2022] GET /identity/v3/services/object-store => generated 93 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 10:11:57.802999 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc46e395-494c-4ecf-8fd2-3513f79be2f3 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:57.827554 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9487202a-2d66-401f-8921-a1e8be327350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:57.829079 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9487202a-2d66-401f-8921-a1e8be327350 None admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:57.829587 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9487202a-2d66-401f-8921-a1e8be327350 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:57.830172 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9487202a-2d66-401f-8921-a1e8be327350 None admin] PATH_INFO: `/v3/projects/28891cf6239a43469326a864fb0d216c/users/cedc4d6c59c44c6d8fb7179070db5e91/roles/285df47e9c4f4da4a33cfc06254dc9ea` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:57.834530 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9487202a-2d66-401f-8921-a1e8be327350 None admin] RBAC: Authorizing `identity:create_grant(project_id=28891cf6239a43469326a864fb0d216c, user_id=cedc4d6c59c44c6d8fb7179070db5e91, role_id=285df47e9c4f4da4a33cfc06254dc9ea)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:57.836006 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9487202a-2d66-401f-8921-a1e8be327350 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:57.861875 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 481/957] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Aug 9 10:11:57 2022] PUT /identity/v3/projects/28891cf6239a43469326a864fb0d216c/users/cedc4d6c59c44c6d8fb7179070db5e91/roles/285df47e9c4f4da4a33cfc06254dc9ea => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 10:11:57.939216 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc46e395-494c-4ecf-8fd2-3513f79be2f3 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:57.992341 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2833ee71-3ceb-4df8-95db-05f631c01c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:57.992956 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2833ee71-3ceb-4df8-95db-05f631c01c19 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:57.993231 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2833ee71-3ceb-4df8-95db-05f631c01c19 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:57.993499 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2833ee71-3ceb-4df8-95db-05f631c01c19 None admin] PATH_INFO: `/v3/services` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:57.994229 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2833ee71-3ceb-4df8-95db-05f631c01c19 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:57.994538 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2833ee71-3ceb-4df8-95db-05f631c01c19 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:57.996527 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2833ee71-3ceb-4df8-95db-05f631c01c19 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:58.002479 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c4cf90-9936-408b-afe3-af8c98b51b5b None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:58.002812 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c4cf90-9936-408b-afe3-af8c98b51b5b None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:58.003027 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c4cf90-9936-408b-afe3-af8c98b51b5b None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:58.004157 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 477/958] 10.222.0.36 () {56 vars in 1122 bytes} [Tue Aug 9 10:11:57 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:58.006523 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 482/959] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:11:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:11:58.010415 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2833ee71-3ceb-4df8-95db-05f631c01c19 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:58.014201 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8792efdd-b3fd-4653-8ed6-07a1f60117f1 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:58.014484 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8792efdd-b3fd-4653-8ed6-07a1f60117f1 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:58.014752 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8792efdd-b3fd-4653-8ed6-07a1f60117f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:58.042532 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-8792efdd-b3fd-4653-8ed6-07a1f60117f1 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:11:58.044026 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-8792efdd-b3fd-4653-8ed6-07a1f60117f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:11:58.053044 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:58.137947 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 483/960] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:11:58 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 10:11:58.152043 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2833ee71-3ceb-4df8-95db-05f631c01c19 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:58.165931 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8792efdd-b3fd-4653-8ed6-07a1f60117f1 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:58.186900 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:58.204554 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036b2b40-6b51-47a9-82f2-5aa38f9914ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:58.205481 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036b2b40-6b51-47a9-82f2-5aa38f9914ef None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:58.205985 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036b2b40-6b51-47a9-82f2-5aa38f9914ef None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:58.206615 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036b2b40-6b51-47a9-82f2-5aa38f9914ef None admin] PATH_INFO: `/v3/services` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:58.208256 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036b2b40-6b51-47a9-82f2-5aa38f9914ef None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:58.208766 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036b2b40-6b51-47a9-82f2-5aa38f9914ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:58.210353 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036b2b40-6b51-47a9-82f2-5aa38f9914ef None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:58.221657 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 478/961] 10.222.0.36 () {56 vars in 1122 bytes} [Tue Aug 9 10:11:58 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:58.224395 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036b2b40-6b51-47a9-82f2-5aa38f9914ef None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:58.289593 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8792efdd-b3fd-4653-8ed6-07a1f60117f1 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:58.336407 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c915315-849e-4136-b44b-0ed4e5f6d3ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:58.337419 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c915315-849e-4136-b44b-0ed4e5f6d3ab None admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:58.337990 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c915315-849e-4136-b44b-0ed4e5f6d3ab None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:58.339945 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c915315-849e-4136-b44b-0ed4e5f6d3ab None admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:58.346950 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c915315-849e-4136-b44b-0ed4e5f6d3ab None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:58.348727 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c915315-849e-4136-b44b-0ed4e5f6d3ab None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:58.351660 dv-cinder-852364-2-smb devstack@keystone.service[80106]: WARNING keystone.server.flask.common [None req-5c915315-849e-4136-b44b-0ed4e5f6d3ab None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 09 10:11:58.359324 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:58.366818 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.sql.core [None req-5c915315-849e-4136-b44b-0ed4e5f6d3ab None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 09 10:11:58.366818 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 09 10:11:58.366818 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [parameters: {'user_id': 'b14a473ea8b1496894505431024f05a7', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 09 10:11:58.366818 dv-cinder-852364-2-smb devstack@keystone.service[80106]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80106) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 09 10:11:58.367677 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036b2b40-6b51-47a9-82f2-5aa38f9914ef None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:58.376273 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-5c915315-849e-4136-b44b-0ed4e5f6d3ab None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 09 10:11:58.376273 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:58.376273 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 09 10:11:58.376273 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 09 10:11:58.376273 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 09 10:11:58.376273 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 09 10:11:58.376273 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 09 10:11:58.376273 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application result = self._query(query) Aug 09 10:11:58.376273 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 09 10:11:58.376273 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application conn.query(q) Aug 09 10:11:58.376273 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 09 10:11:58.376273 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 09 10:11:58.376273 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 09 10:11:58.376273 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application result.read() Aug 09 10:11:58.376273 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 09 10:11:58.377213 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 09 10:11:58.377213 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 09 10:11:58.377213 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 09 10:11:58.377213 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 09 10:11:58.377213 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 09 10:11:58.377213 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 09 10:11:58.377213 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 09 10:11:58.377213 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 09 10:11:58.377213 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:58.377213 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 09 10:11:58.377213 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:58.377213 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:58.377213 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 09 10:11:58.377213 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 09 10:11:58.377213 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 09 10:11:58.377213 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 09 10:11:58.377213 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 09 10:11:58.377213 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application next(self.gen) Aug 09 10:11:58.378236 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 09 10:11:58.378236 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application yield resource Aug 09 10:11:58.378236 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 09 10:11:58.378236 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application next(self.gen) Aug 09 10:11:58.378236 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 09 10:11:58.378236 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self.session.rollback() Aug 09 10:11:58.378236 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 09 10:11:58.378236 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self.force_reraise() Aug 09 10:11:58.378236 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 09 10:11:58.378236 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise self.value Aug 09 10:11:58.378236 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 09 10:11:58.378236 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 09 10:11:58.378236 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 09 10:11:58.378236 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application session.commit() Aug 09 10:11:58.378236 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 09 10:11:58.378236 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 09 10:11:58.378236 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 09 10:11:58.379166 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._prepare_impl() Aug 09 10:11:58.379166 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 09 10:11:58.379166 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self.session.flush() Aug 09 10:11:58.379166 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 09 10:11:58.379166 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._flush(objects) Aug 09 10:11:58.379166 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 09 10:11:58.379166 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 09 10:11:58.379166 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 09 10:11:58.379166 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application compat.raise_( Aug 09 10:11:58.379166 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 09 10:11:58.379166 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception Aug 09 10:11:58.379166 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 09 10:11:58.379166 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application flush_context.execute() Aug 09 10:11:58.379166 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 09 10:11:58.379166 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rec.execute(self) Aug 09 10:11:58.379166 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 09 10:11:58.379166 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 09 10:11:58.386189 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 09 10:11:58.386189 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 09 10:11:58.386189 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 09 10:11:58.386189 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 09 10:11:58.386189 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 09 10:11:58.386189 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 09 10:11:58.386189 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 09 10:11:58.386189 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 09 10:11:58.386189 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 09 10:11:58.386189 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 09 10:11:58.386189 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 09 10:11:58.386189 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 09 10:11:58.386189 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 09 10:11:58.386189 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 09 10:11:58.386189 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 09 10:11:58.386189 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception Aug 09 10:11:58.388446 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 09 10:11:58.388446 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 09 10:11:58.388446 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 09 10:11:58.388446 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 09 10:11:58.388446 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 09 10:11:58.388446 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application result = self._query(query) Aug 09 10:11:58.388446 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 09 10:11:58.388446 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application conn.query(q) Aug 09 10:11:58.388446 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 09 10:11:58.388446 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 09 10:11:58.388446 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 09 10:11:58.388446 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application result.read() Aug 09 10:11:58.388446 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 09 10:11:58.388446 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 09 10:11:58.388446 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 09 10:11:58.388446 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 09 10:11:58.391050 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 09 10:11:58.391050 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 09 10:11:58.391050 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 09 10:11:58.391050 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 09 10:11:58.391050 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 09 10:11:58.391050 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 09 10:11:58.391050 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [parameters: {'user_id': 'b14a473ea8b1496894505431024f05a7', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 09 10:11:58.391050 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 09 10:11:58.391050 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:58.391050 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 10:11:58.391050 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:58.391050 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:58.391050 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:58.391050 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:58.391050 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:58.393584 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:58.393584 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:58.393584 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:58.393584 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:58.393584 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:58.393584 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:58.393584 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:58.393584 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 09 10:11:58.393584 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 09 10:11:58.393584 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:58.393584 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:58.393584 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 10:11:58.393584 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 10:11:58.393584 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 10:11:58.393584 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 10:11:58.393584 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 09 10:11:58.393584 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 09 10:11:58.395885 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 09 10:11:58.395885 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 09 10:11:58.395885 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 09 10:11:58.395885 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 09 10:11:58.395885 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 09 10:11:58.395885 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:58.395885 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 484/962] 10.222.0.36 () {60 vars in 1131 bytes} [Tue Aug 9 10:11:58 2022] POST /identity/v3/users => generated 160 bytes in 214 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 09 10:11:58.395885 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c915315-849e-4136-b44b-0ed4e5f6d3ab None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:58.421610 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0769399-3b9a-4911-a1ea-221ed72b345c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:58.422738 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0769399-3b9a-4911-a1ea-221ed72b345c None admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:58.423277 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0769399-3b9a-4911-a1ea-221ed72b345c None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:58.423745 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0769399-3b9a-4911-a1ea-221ed72b345c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:58.424710 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0769399-3b9a-4911-a1ea-221ed72b345c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:58.426498 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0769399-3b9a-4911-a1ea-221ed72b345c None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:58.458459 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 479/963] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:11:58 2022] POST /identity/v3/endpoints => generated 349 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:11:58.484987 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:58.507143 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c915315-849e-4136-b44b-0ed4e5f6d3ab None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:58.556866 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a8b9cc-9006-4b57-8a8a-10d6cc93f2b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:58.557578 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a8b9cc-9006-4b57-8a8a-10d6cc93f2b4 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:58.557871 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a8b9cc-9006-4b57-8a8a-10d6cc93f2b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:58.558147 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a8b9cc-9006-4b57-8a8a-10d6cc93f2b4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:58.566696 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a8b9cc-9006-4b57-8a8a-10d6cc93f2b4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:58.568336 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a8b9cc-9006-4b57-8a8a-10d6cc93f2b4 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:58.582138 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-83a8b9cc-9006-4b57-8a8a-10d6cc93f2b4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 09 10:11:58.582138 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:11:58.582138 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:11:58.582138 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:11:58.582138 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:11:58.582138 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:11:58.582138 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:11:58.582138 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:11:58.582138 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:11:58.582138 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:11:58.582138 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:11:58.582138 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:11:58.582138 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 10:11:58.582138 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 10:11:58.582138 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 10:11:58.582138 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 10:11:58.583178 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:11:58.583178 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:11:58.583178 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 10:11:58.583178 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 10:11:58.583178 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 10:11:58.583178 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 10:11:58.583178 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:11:58.583178 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:11:58.583178 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:11:58.583178 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:11:58.583178 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:11:58.583178 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:11:58.583178 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:11:58.583178 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:11:58.583178 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:11:58.583178 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:11:58.583178 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:11:58.583178 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:11:58.584766 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:11:58.584766 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:11:58.584766 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 10:11:58.584766 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 10:11:58.584766 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 10:11:58.584766 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 10:11:58.584766 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 10:11:58.584766 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 10:11:58.584766 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 09 10:11:58.584766 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:11:58.584766 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 485/964] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Aug 9 10:11:58 2022] GET /identity/v3/users/cinder => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:11:58.592666 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0769399-3b9a-4911-a1ea-221ed72b345c None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:58.703091 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0769399-3b9a-4911-a1ea-221ed72b345c None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:58.738029 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f66dc0-2c71-407c-9676-8b665b3e026b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:58.739401 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f66dc0-2c71-407c-9676-8b665b3e026b None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:58.739884 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f66dc0-2c71-407c-9676-8b665b3e026b None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:58.740356 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f66dc0-2c71-407c-9676-8b665b3e026b None admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:58.741269 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f66dc0-2c71-407c-9676-8b665b3e026b None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:11:58.741764 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f66dc0-2c71-407c-9676-8b665b3e026b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:58.743404 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f66dc0-2c71-407c-9676-8b665b3e026b None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:58.784874 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 480/965] 10.222.0.36 () {56 vars in 1101 bytes} [Tue Aug 9 10:11:58 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:11:59.215675 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c8e7b-e49d-4a5a-beaf-c827bf5ec8d1 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:59.216051 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c8e7b-e49d-4a5a-beaf-c827bf5ec8d1 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:59.216256 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387c8e7b-e49d-4a5a-beaf-c827bf5ec8d1 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:59.217713 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 486/966] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:11:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:11:59.222622 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102f26d6-192d-45ed-b922-f4f941921a9e None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:59.222912 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102f26d6-192d-45ed-b922-f4f941921a9e None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:59.223188 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102f26d6-192d-45ed-b922-f4f941921a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:59.241742 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-102f26d6-192d-45ed-b922-f4f941921a9e None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:11:59.242955 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-102f26d6-192d-45ed-b922-f4f941921a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:11:59.245122 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:59.313699 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 481/967] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:11:59 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 10:11:59.336529 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387c8e7b-e49d-4a5a-beaf-c827bf5ec8d1 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:11:59.438762 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387c8e7b-e49d-4a5a-beaf-c827bf5ec8d1 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:11:59.473430 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980057fa-655d-4227-ab86-8c2f5fee8b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:11:59.473987 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980057fa-655d-4227-ab86-8c2f5fee8b4d None admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:59.474270 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980057fa-655d-4227-ab86-8c2f5fee8b4d None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:59.474543 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980057fa-655d-4227-ab86-8c2f5fee8b4d None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:59.475192 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980057fa-655d-4227-ab86-8c2f5fee8b4d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:11:59.476616 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980057fa-655d-4227-ab86-8c2f5fee8b4d None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:11:59.481784 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:11:59.501958 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 487/968] 10.222.0.36 () {60 vars in 1141 bytes} [Tue Aug 9 10:11:59 2022] POST /identity/v3/services => generated 242 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:11:59.930722 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044d617-9de0-4943-85e2-353671ceac89 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:59.931242 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044d617-9de0-4943-85e2-353671ceac89 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:59.931242 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044d617-9de0-4943-85e2-353671ceac89 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:59.932818 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 482/969] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:11:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:11:59.937906 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896ddc19-2ee0-4e85-80f9-5d503fd8e9b8 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:11:59.938199 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896ddc19-2ee0-4e85-80f9-5d503fd8e9b8 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:11:59.938469 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896ddc19-2ee0-4e85-80f9-5d503fd8e9b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:11:59.958228 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-896ddc19-2ee0-4e85-80f9-5d503fd8e9b8 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:11:59.959830 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-896ddc19-2ee0-4e85-80f9-5d503fd8e9b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:12:00.035829 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 488/970] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:11:59 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 10:12:00.058539 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0044d617-9de0-4943-85e2-353671ceac89 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:00.161258 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0044d617-9de0-4943-85e2-353671ceac89 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:00.195897 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1cf14d-e9ae-46c7-970b-72a4b5e35248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:00.196443 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1cf14d-e9ae-46c7-970b-72a4b5e35248 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:00.196715 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1cf14d-e9ae-46c7-970b-72a4b5e35248 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:00.196981 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1cf14d-e9ae-46c7-970b-72a4b5e35248 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:00.204817 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:00.209868 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1cf14d-e9ae-46c7-970b-72a4b5e35248 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 10:12:00.214673 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-fa1cf14d-e9ae-46c7-970b-72a4b5e35248 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 09 10:12:00.214673 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:12:00.214673 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:12:00.214673 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:12:00.214673 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:12:00.214673 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:12:00.214673 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:12:00.214673 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:12:00.214673 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:12:00.214673 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:12:00.214673 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:12:00.214673 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:12:00.214673 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 10:12:00.214673 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 10:12:00.214673 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 10:12:00.214673 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 10:12:00.215607 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 10:12:00.215607 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 10:12:00.215607 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 10:12:00.215607 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 10:12:00.215607 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:12:00.215607 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:12:00.215607 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:12:00.215607 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:12:00.215607 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:12:00.215607 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:12:00.215607 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:12:00.215607 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:12:00.215607 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:12:00.215607 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:12:00.215607 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:12:00.215607 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:12:00.216454 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:12:00.216454 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:12:00.216454 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:12:00.216454 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:12:00.216454 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 10:12:00.216454 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 10:12:00.216454 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 10:12:00.216454 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 10:12:00.216454 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 10:12:00.216454 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 10:12:00.216454 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 09 10:12:00.216454 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:12:00.217710 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 483/971] 10.222.0.36 () {56 vars in 1120 bytes} [Tue Aug 9 10:12:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:12:00.223629 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896ddc19-2ee0-4e85-80f9-5d503fd8e9b8 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:00.321075 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896ddc19-2ee0-4e85-80f9-5d503fd8e9b8 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:00.343603 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:00.355782 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54760e48-7df0-42d1-803c-acc842148665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:00.356379 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54760e48-7df0-42d1-803c-acc842148665 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:00.356652 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54760e48-7df0-42d1-803c-acc842148665 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:00.356918 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54760e48-7df0-42d1-803c-acc842148665 None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:00.357571 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54760e48-7df0-42d1-803c-acc842148665 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:12:00.357886 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54760e48-7df0-42d1-803c-acc842148665 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:00.359245 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54760e48-7df0-42d1-803c-acc842148665 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:00.370280 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 489/972] 10.222.0.36 () {56 vars in 1115 bytes} [Tue Aug 9 10:12:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:12:00.373408 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1cf14d-e9ae-46c7-970b-72a4b5e35248 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:00.473030 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1cf14d-e9ae-46c7-970b-72a4b5e35248 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:00.507067 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0977051c-c7dc-4bda-b862-71dcfb20873f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:00.507987 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977051c-c7dc-4bda-b862-71dcfb20873f None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:00.508438 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977051c-c7dc-4bda-b862-71dcfb20873f None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:00.508889 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977051c-c7dc-4bda-b862-71dcfb20873f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:00.519273 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0977051c-c7dc-4bda-b862-71dcfb20873f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:00.519447 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e797e2d-9254-4f77-b3e8-b150657c2938 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:00.519851 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e797e2d-9254-4f77-b3e8-b150657c2938 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:00.519851 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e797e2d-9254-4f77-b3e8-b150657c2938 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:00.520702 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0977051c-c7dc-4bda-b862-71dcfb20873f None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:00.521299 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 490/973] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:12:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 10:12:00.527501 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f00cc-4df2-4d0b-8128-b13c09f34174 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:00.527780 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f00cc-4df2-4d0b-8128-b13c09f34174 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:00.528049 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f00cc-4df2-4d0b-8128-b13c09f34174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:00.536667 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-0977051c-c7dc-4bda-b862-71dcfb20873f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:12:00.536667 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:12:00.536667 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:12:00.536667 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:12:00.536667 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:12:00.536667 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:12:00.536667 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:12:00.536667 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:12:00.536667 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:12:00.536667 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:12:00.536667 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:12:00.536667 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:12:00.536667 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 10:12:00.536667 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 10:12:00.536667 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 10:12:00.536667 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 10:12:00.542897 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:12:00.542897 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:12:00.542897 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:12:00.542897 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:12:00.542897 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:12:00.542897 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:12:00.542897 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:12:00.542897 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:12:00.542897 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:12:00.542897 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:12:00.542897 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:12:00.542897 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:12:00.542897 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:12:00.542897 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:12:00.542897 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:12:00.542897 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:12:00.542897 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 10:12:00.543833 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 10:12:00.543833 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:12:00.543833 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:12:00.543833 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 484/974] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:12:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 10:12:00.543833 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0977051c-c7dc-4bda-b862-71dcfb20873f None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:00.556402 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-1f8f00cc-4df2-4d0b-8128-b13c09f34174 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:12:00.557624 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-1f8f00cc-4df2-4d0b-8128-b13c09f34174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:12:00.600452 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:00.632668 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 491/975] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:12:00 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 10:12:00.654860 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0977051c-c7dc-4bda-b862-71dcfb20873f None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:00.655562 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8f00cc-4df2-4d0b-8128-b13c09f34174 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:00.691456 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f69f22-d4f8-4b29-a88a-bc4c37f7aac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:00.692459 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f69f22-d4f8-4b29-a88a-bc4c37f7aac4 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:00.692914 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f69f22-d4f8-4b29-a88a-bc4c37f7aac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:00.693372 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f69f22-d4f8-4b29-a88a-bc4c37f7aac4 None admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:00.694214 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f69f22-d4f8-4b29-a88a-bc4c37f7aac4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:12:00.694706 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f69f22-d4f8-4b29-a88a-bc4c37f7aac4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:00.696263 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f69f22-d4f8-4b29-a88a-bc4c37f7aac4 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:00.709415 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 485/976] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Aug 9 10:12:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:12:00.714750 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f69f22-d4f8-4b29-a88a-bc4c37f7aac4 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:00.766828 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8f00cc-4df2-4d0b-8128-b13c09f34174 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:00.782030 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:00.805149 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a409c13e-903f-44f3-9bb7-ab0e19b64b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:00.806288 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a409c13e-903f-44f3-9bb7-ab0e19b64b15 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:00.806723 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a409c13e-903f-44f3-9bb7-ab0e19b64b15 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:00.807842 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a409c13e-903f-44f3-9bb7-ab0e19b64b15 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:00.808838 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a409c13e-903f-44f3-9bb7-ab0e19b64b15 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:00.810401 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a409c13e-903f-44f3-9bb7-ab0e19b64b15 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:00.820455 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-a409c13e-903f-44f3-9bb7-ab0e19b64b15 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 10:12:00.820455 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:12:00.820455 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 10:12:00.820455 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 10:12:00.820455 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 10:12:00.820455 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 10:12:00.820455 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 10:12:00.820455 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 10:12:00.820455 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 10:12:00.820455 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:12:00.820455 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 10:12:00.820455 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:12:00.820455 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:12:00.820455 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:12:00.820455 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:12:00.820455 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:12:00.820455 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:12:00.821584 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:12:00.821584 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:12:00.821584 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:12:00.821584 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:12:00.821584 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:12:00.821584 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:12:00.821584 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 10:12:00.821584 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 10:12:00.821584 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 10:12:00.821584 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 10:12:00.821584 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:12:00.821584 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:12:00.821584 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:12:00.821584 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:12:00.821584 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:12:00.821584 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:12:00.822635 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:12:00.822635 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:12:00.822635 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:12:00.822635 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:12:00.822635 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:12:00.822635 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:12:00.822635 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:12:00.822635 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:12:00.822635 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:12:00.822635 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:12:00.822635 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 10:12:00.822635 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 10:12:00.822635 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 10:12:00.822635 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:12:00.824076 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f69f22-d4f8-4b29-a88a-bc4c37f7aac4 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:00.825063 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 492/977] 10.222.0.36 () {56 vars in 1126 bytes} [Tue Aug 9 10:12:00 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 10:12:00.830666 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a409c13e-903f-44f3-9bb7-ab0e19b64b15 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:00.835240 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:00.860150 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aacf197-9360-4c2d-b8a3-741669583337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:00.860769 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aacf197-9360-4c2d-b8a3-741669583337 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:00.861044 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aacf197-9360-4c2d-b8a3-741669583337 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:00.861314 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aacf197-9360-4c2d-b8a3-741669583337 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:00.869346 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aacf197-9360-4c2d-b8a3-741669583337 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:00.871401 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aacf197-9360-4c2d-b8a3-741669583337 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:00.882412 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-8aacf197-9360-4c2d-b8a3-741669583337 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 09 10:12:00.882412 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:12:00.882412 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:12:00.882412 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:12:00.882412 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:12:00.882412 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:12:00.882412 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:12:00.882412 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:12:00.882412 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:12:00.882412 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:12:00.882412 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:12:00.882412 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:12:00.882412 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 10:12:00.882412 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 10:12:00.882412 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 10:12:00.882412 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 10:12:00.883456 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:12:00.883456 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:12:00.883456 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 10:12:00.883456 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 10:12:00.883456 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 10:12:00.883456 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 10:12:00.883456 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:12:00.883456 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:12:00.883456 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:12:00.883456 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:12:00.883456 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:12:00.883456 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:12:00.883456 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:12:00.883456 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:12:00.883456 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:12:00.883456 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:12:00.883456 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:12:00.883456 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:12:00.885061 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:12:00.885061 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:12:00.885061 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 10:12:00.885061 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 10:12:00.885061 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 10:12:00.885061 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 10:12:00.885061 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 10:12:00.885061 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 10:12:00.885061 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 09 10:12:00.885061 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:12:00.885061 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 486/978] 10.222.0.36 () {56 vars in 1117 bytes} [Tue Aug 9 10:12:00 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 10:12:00.889708 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aacf197-9360-4c2d-b8a3-741669583337 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:00.946074 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a409c13e-903f-44f3-9bb7-ab0e19b64b15 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:00.984237 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57618d8a-3398-4b21-a1b0-dfa6f53dc466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:00.984970 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57618d8a-3398-4b21-a1b0-dfa6f53dc466 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:00.985155 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57618d8a-3398-4b21-a1b0-dfa6f53dc466 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:00.985382 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57618d8a-3398-4b21-a1b0-dfa6f53dc466 None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:00.986037 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57618d8a-3398-4b21-a1b0-dfa6f53dc466 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:12:00.986339 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57618d8a-3398-4b21-a1b0-dfa6f53dc466 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:00.987779 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57618d8a-3398-4b21-a1b0-dfa6f53dc466 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:00.998186 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 493/979] 10.222.0.36 () {56 vars in 1122 bytes} [Tue Aug 9 10:12:00 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:12:00.999049 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57618d8a-3398-4b21-a1b0-dfa6f53dc466 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:01.005895 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aacf197-9360-4c2d-b8a3-741669583337 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:01.045307 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b48ef5-0a3c-4d1e-a936-28f0cd38680c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:01.045830 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b48ef5-0a3c-4d1e-a936-28f0cd38680c None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:01.046132 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b48ef5-0a3c-4d1e-a936-28f0cd38680c None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:01.046527 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b48ef5-0a3c-4d1e-a936-28f0cd38680c None admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:01.047248 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b48ef5-0a3c-4d1e-a936-28f0cd38680c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:12:01.047549 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b48ef5-0a3c-4d1e-a936-28f0cd38680c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:01.049080 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b48ef5-0a3c-4d1e-a936-28f0cd38680c None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:01.050072 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:01.072237 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 487/980] 10.222.0.36 () {56 vars in 1149 bytes} [Tue Aug 9 10:12:00 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:12:01.073242 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b48ef5-0a3c-4d1e-a936-28f0cd38680c None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:01.103427 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:01.115800 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57618d8a-3398-4b21-a1b0-dfa6f53dc466 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:01.149548 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9902a414-092d-4638-be00-5751cc9fd298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:01.150234 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9902a414-092d-4638-be00-5751cc9fd298 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:01.150510 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9902a414-092d-4638-be00-5751cc9fd298 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:01.150781 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9902a414-092d-4638-be00-5751cc9fd298 None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:01.152472 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9902a414-092d-4638-be00-5751cc9fd298 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:12:01.152775 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9902a414-092d-4638-be00-5751cc9fd298 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:01.154241 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9902a414-092d-4638-be00-5751cc9fd298 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:01.163963 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 494/981] 10.222.0.36 () {56 vars in 1122 bytes} [Tue Aug 9 10:12:00 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:12:01.165133 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9902a414-092d-4638-be00-5751cc9fd298 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:01.185081 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b48ef5-0a3c-4d1e-a936-28f0cd38680c None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:01.222812 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eed1aac-7223-4fd2-9a42-ba7aad5e484f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:01.224168 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed1aac-7223-4fd2-9a42-ba7aad5e484f None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:01.224919 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed1aac-7223-4fd2-9a42-ba7aad5e484f None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:01.225397 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed1aac-7223-4fd2-9a42-ba7aad5e484f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:01.274139 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9902a414-092d-4638-be00-5751cc9fd298 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:01.284089 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:01.300805 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eed1aac-7223-4fd2-9a42-ba7aad5e484f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:01.302299 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eed1aac-7223-4fd2-9a42-ba7aad5e484f None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:01.313904 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1f6e30-62ab-4059-81d3-27f17b1d5d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:01.314511 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f6e30-62ab-4059-81d3-27f17b1d5d67 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:01.314789 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f6e30-62ab-4059-81d3-27f17b1d5d67 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:01.315063 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f6e30-62ab-4059-81d3-27f17b1d5d67 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:01.315767 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1f6e30-62ab-4059-81d3-27f17b1d5d67 None admin] RBAC: Adding query filter params (interface=admin, service_id=246af8b872554568bcd0509d9367523d, region_id=RegionOne) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:12:01.316081 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1f6e30-62ab-4059-81d3-27f17b1d5d67 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:01.317428 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1f6e30-62ab-4059-81d3-27f17b1d5d67 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:01.328574 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 495/982] 10.222.0.36 () {56 vars in 1249 bytes} [Tue Aug 9 10:12:01 2022] GET /identity/v3/endpoints?service_id=246af8b872554568bcd0509d9367523d&interface=admin®ion_id=RegionOne => generated 193 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:12:01.329569 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1f6e30-62ab-4059-81d3-27f17b1d5d67 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:01.335539 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:01.412058 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 488/983] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Aug 9 10:12:01 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 10:12:01.418116 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eed1aac-7223-4fd2-9a42-ba7aad5e484f None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:01.444439 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1f6e30-62ab-4059-81d3-27f17b1d5d67 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:01.486594 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86490dca-a3c3-473a-8fd2-f22ceef63af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:01.487192 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86490dca-a3c3-473a-8fd2-f22ceef63af8 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:01.487469 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86490dca-a3c3-473a-8fd2-f22ceef63af8 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:01.487739 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86490dca-a3c3-473a-8fd2-f22ceef63af8 None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:01.488344 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86490dca-a3c3-473a-8fd2-f22ceef63af8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:01.489698 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86490dca-a3c3-473a-8fd2-f22ceef63af8 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:01.495971 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 496/984] 10.222.0.36 () {56 vars in 1087 bytes} [Tue Aug 9 10:12:01 2022] GET /identity/v3/services => generated 1727 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:12:01.525495 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eed1aac-7223-4fd2-9a42-ba7aad5e484f None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:01.535864 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d2bca-3eb1-4986-a9c1-611c05cb8255 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:01.536431 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d2bca-3eb1-4986-a9c1-611c05cb8255 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:01.536431 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d2bca-3eb1-4986-a9c1-611c05cb8255 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:01.540913 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 497/985] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:12:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 10:12:01.543429 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53fb6a-4a6e-4748-b1ed-6ced39f19ae7 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:01.543672 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53fb6a-4a6e-4748-b1ed-6ced39f19ae7 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:01.543948 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53fb6a-4a6e-4748-b1ed-6ced39f19ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:01.560334 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:01.564192 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-cc53fb6a-4a6e-4748-b1ed-6ced39f19ae7 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:12:01.565714 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-cc53fb6a-4a6e-4748-b1ed-6ced39f19ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:12:01.568800 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e8c229-7b89-44f9-acbc-87eaf9166b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:01.569433 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e8c229-7b89-44f9-acbc-87eaf9166b67 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:01.569709 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e8c229-7b89-44f9-acbc-87eaf9166b67 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:01.570077 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e8c229-7b89-44f9-acbc-87eaf9166b67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:01.583944 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e8c229-7b89-44f9-acbc-87eaf9166b67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:01.585434 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e8c229-7b89-44f9-acbc-87eaf9166b67 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:01.598095 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:01.603162 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-36e8c229-7b89-44f9-acbc-87eaf9166b67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:12:01.603162 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:12:01.603162 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:12:01.603162 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:12:01.603162 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:12:01.603162 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:12:01.603162 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:12:01.603162 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:12:01.603162 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:12:01.603162 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:12:01.603162 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:12:01.603162 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:12:01.603162 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 10:12:01.603162 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 10:12:01.603162 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 10:12:01.603162 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 10:12:01.604611 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:12:01.604611 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:12:01.604611 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:12:01.604611 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:12:01.604611 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:12:01.604611 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:12:01.604611 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:12:01.604611 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:12:01.604611 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:12:01.604611 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:12:01.604611 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:12:01.604611 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:12:01.604611 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:12:01.604611 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:12:01.604611 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:12:01.604611 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:12:01.604611 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 10:12:01.605515 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 10:12:01.605515 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:12:01.605515 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:12:01.605515 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 489/986] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:12:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 10:12:01.611255 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e8c229-7b89-44f9-acbc-87eaf9166b67 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:01.650027 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 498/987] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:12:01 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 10:12:01.673245 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc53fb6a-4a6e-4748-b1ed-6ced39f19ae7 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:01.725004 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e8c229-7b89-44f9-acbc-87eaf9166b67 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:01.764158 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6d959f-5052-4f07-9e3e-8c29dd2f81bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:01.764765 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d959f-5052-4f07-9e3e-8c29dd2f81bf None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:01.765044 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d959f-5052-4f07-9e3e-8c29dd2f81bf None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:01.765317 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d959f-5052-4f07-9e3e-8c29dd2f81bf None admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:01.766016 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6d959f-5052-4f07-9e3e-8c29dd2f81bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:12:01.766307 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6d959f-5052-4f07-9e3e-8c29dd2f81bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:01.775293 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6d959f-5052-4f07-9e3e-8c29dd2f81bf None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:01.788558 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 490/988] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Aug 9 10:12:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:12:01.794194 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6d959f-5052-4f07-9e3e-8c29dd2f81bf None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:01.802638 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc53fb6a-4a6e-4748-b1ed-6ced39f19ae7 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:01.839232 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b4d9f-b51c-4999-a38d-70edcdcd75c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:01.839687 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b4d9f-b51c-4999-a38d-70edcdcd75c6 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:01.839957 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b4d9f-b51c-4999-a38d-70edcdcd75c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:01.840220 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b4d9f-b51c-4999-a38d-70edcdcd75c6 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:01.840794 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178b4d9f-b51c-4999-a38d-70edcdcd75c6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:01.840913 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:01.842186 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178b4d9f-b51c-4999-a38d-70edcdcd75c6 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:01.851356 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-178b4d9f-b51c-4999-a38d-70edcdcd75c6 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 09 10:12:01.851356 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:12:01.851356 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 10:12:01.851356 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 10:12:01.851356 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 10:12:01.851356 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 10:12:01.851356 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 10:12:01.851356 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 10:12:01.851356 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 09 10:12:01.851356 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:12:01.851356 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 10:12:01.851356 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:12:01.851356 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:12:01.851356 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:12:01.851356 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:12:01.851356 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:12:01.851356 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:12:01.852365 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:12:01.852365 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:12:01.852365 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:12:01.852365 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:12:01.852365 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:12:01.852365 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:12:01.852365 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 10:12:01.852365 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 10:12:01.852365 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 10:12:01.852365 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 10:12:01.852365 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:12:01.852365 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:12:01.852365 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:12:01.852365 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:12:01.852365 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:12:01.852365 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:12:01.853390 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:12:01.853390 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:12:01.853390 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:12:01.853390 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:12:01.853390 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:12:01.853390 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:12:01.853390 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:12:01.853390 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:12:01.853390 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:12:01.853390 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:12:01.853390 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 10:12:01.853390 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 10:12:01.853390 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 09 10:12:01.853390 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:12:01.857431 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 499/989] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Aug 9 10:12:01 2022] GET /identity/v3/services/compute => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:12:01.858279 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b4d9f-b51c-4999-a38d-70edcdcd75c6 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:01.888525 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:01.907004 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6d959f-5052-4f07-9e3e-8c29dd2f81bf None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:01.944547 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789aff38-6098-4ece-8146-65049380c449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:01.945214 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789aff38-6098-4ece-8146-65049380c449 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:01.945514 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789aff38-6098-4ece-8146-65049380c449 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:01.945821 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789aff38-6098-4ece-8146-65049380c449 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:01.954365 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789aff38-6098-4ece-8146-65049380c449 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:01.955977 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789aff38-6098-4ece-8146-65049380c449 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:01.969309 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-789aff38-6098-4ece-8146-65049380c449 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 10:12:01.969309 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:12:01.969309 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:12:01.969309 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:12:01.969309 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:12:01.969309 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:12:01.969309 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:12:01.969309 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:12:01.969309 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:12:01.969309 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:12:01.969309 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:12:01.969309 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:12:01.969309 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 10:12:01.969309 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 10:12:01.969309 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 10:12:01.972147 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 10:12:01.972147 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:12:01.972147 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:12:01.972147 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:12:01.972147 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:12:01.972147 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:12:01.972147 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:12:01.972147 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:12:01.972147 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:12:01.972147 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:12:01.972147 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:12:01.972147 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:12:01.972147 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:12:01.972147 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:12:01.972147 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:12:01.972147 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:12:01.972147 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:12:01.973208 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 10:12:01.973208 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 10:12:01.973208 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 10:12:01.973208 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 10:12:01.973208 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 10:12:01.973208 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 10:12:01.973208 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 10:12:01.973208 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:12:01.973208 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 491/990] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Aug 9 10:12:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 10:12:01.973692 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b4d9f-b51c-4999-a38d-70edcdcd75c6 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:01.976885 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789aff38-6098-4ece-8146-65049380c449 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:02.013407 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfa89a9-5861-4f6c-a2f1-ca287644da89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:02.014343 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa89a9-5861-4f6c-a2f1-ca287644da89 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:02.015537 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa89a9-5861-4f6c-a2f1-ca287644da89 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:02.015849 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa89a9-5861-4f6c-a2f1-ca287644da89 None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:02.016533 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfa89a9-5861-4f6c-a2f1-ca287644da89 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:12:02.016862 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfa89a9-5861-4f6c-a2f1-ca287644da89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:02.018414 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfa89a9-5861-4f6c-a2f1-ca287644da89 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:02.029522 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 500/991] 10.222.0.36 () {56 vars in 1112 bytes} [Tue Aug 9 10:12:01 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:12:02.030795 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfa89a9-5861-4f6c-a2f1-ca287644da89 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:02.078353 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:02.082198 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789aff38-6098-4ece-8146-65049380c449 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:02.120744 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7d6b57-b618-4724-ba0e-4e0eec02c103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:02.121298 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d6b57-b618-4724-ba0e-4e0eec02c103 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:02.121577 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d6b57-b618-4724-ba0e-4e0eec02c103 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:02.122006 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d6b57-b618-4724-ba0e-4e0eec02c103 None admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:02.122893 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7d6b57-b618-4724-ba0e-4e0eec02c103 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:12:02.123242 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7d6b57-b618-4724-ba0e-4e0eec02c103 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:02.124832 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7d6b57-b618-4724-ba0e-4e0eec02c103 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:02.133676 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:02.138707 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 492/992] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Aug 9 10:12:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:12:02.144922 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7d6b57-b618-4724-ba0e-4e0eec02c103 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:02.148214 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfa89a9-5861-4f6c-a2f1-ca287644da89 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:02.186109 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd0f09b-d524-48e1-a92e-caa39b5c6348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:02.186712 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0f09b-d524-48e1-a92e-caa39b5c6348 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:02.186990 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0f09b-d524-48e1-a92e-caa39b5c6348 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:02.187260 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0f09b-d524-48e1-a92e-caa39b5c6348 None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:02.187884 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd0f09b-d524-48e1-a92e-caa39b5c6348 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:12:02.188182 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd0f09b-d524-48e1-a92e-caa39b5c6348 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:02.189543 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd0f09b-d524-48e1-a92e-caa39b5c6348 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:02.200034 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 501/993] 10.222.0.36 () {56 vars in 1112 bytes} [Tue Aug 9 10:12:02 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:12:02.201086 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd0f09b-d524-48e1-a92e-caa39b5c6348 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:02.264625 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7d6b57-b618-4724-ba0e-4e0eec02c103 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:02.300753 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d6e87f-bd6b-4d07-a5f1-2fbf6723a192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:02.301347 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6e87f-bd6b-4d07-a5f1-2fbf6723a192 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:02.301624 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6e87f-bd6b-4d07-a5f1-2fbf6723a192 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:02.301915 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6e87f-bd6b-4d07-a5f1-2fbf6723a192 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:02.302639 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d6e87f-bd6b-4d07-a5f1-2fbf6723a192 None admin] RBAC: Adding query filter params (role.id=285df47e9c4f4da4a33cfc06254dc9ea, scope.project.id=28891cf6239a43469326a864fb0d216c, user.id=cedc4d6c59c44c6d8fb7179070db5e91) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:12:02.302938 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d6e87f-bd6b-4d07-a5f1-2fbf6723a192 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:02.304355 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d6e87f-bd6b-4d07-a5f1-2fbf6723a192 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:02.310510 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 493/994] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Aug 9 10:12:02 2022] GET /identity/v3/role_assignments?user.id=cedc4d6c59c44c6d8fb7179070db5e91&scope.project.id=28891cf6239a43469326a864fb0d216c&role.id=285df47e9c4f4da4a33cfc06254dc9ea => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:12:02.312249 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd0f09b-d524-48e1-a92e-caa39b5c6348 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:02.355565 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac92cf33-fa4e-47af-9190-41bf96fa0c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:02.356180 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac92cf33-fa4e-47af-9190-41bf96fa0c02 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:02.356457 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac92cf33-fa4e-47af-9190-41bf96fa0c02 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:02.356723 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac92cf33-fa4e-47af-9190-41bf96fa0c02 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:02.357428 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac92cf33-fa4e-47af-9190-41bf96fa0c02 None admin] RBAC: Adding query filter params (interface=public, service_id=19bf800a51c14cfeb94a43deaa26889b, region_id=RegionOne) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:12:02.357757 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac92cf33-fa4e-47af-9190-41bf96fa0c02 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:02.359156 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac92cf33-fa4e-47af-9190-41bf96fa0c02 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:02.365114 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 502/995] 10.222.0.36 () {56 vars in 1251 bytes} [Tue Aug 9 10:12:02 2022] GET /identity/v3/endpoints?service_id=19bf800a51c14cfeb94a43deaa26889b&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:12:02.371250 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d6e87f-bd6b-4d07-a5f1-2fbf6723a192 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:02.398951 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:02.482727 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d6e87f-bd6b-4d07-a5f1-2fbf6723a192 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:02.522456 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1694faf-4496-49c5-a533-ee7647068a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:02.523060 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1694faf-4496-49c5-a533-ee7647068a39 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:02.523337 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1694faf-4496-49c5-a533-ee7647068a39 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:02.523603 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1694faf-4496-49c5-a533-ee7647068a39 None admin] PATH_INFO: `/v3/services` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:02.524199 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1694faf-4496-49c5-a533-ee7647068a39 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:02.525531 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1694faf-4496-49c5-a533-ee7647068a39 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:02.532314 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 494/996] 10.222.0.36 () {56 vars in 1087 bytes} [Tue Aug 9 10:12:02 2022] GET /identity/v3/services => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:12:03.565386 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c87eb-1b91-44af-97e3-e4c009022271 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:03.566098 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c87eb-1b91-44af-97e3-e4c009022271 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:03.566098 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c87eb-1b91-44af-97e3-e4c009022271 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:03.567440 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 503/997] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:12:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:12:03.572503 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76681a96-27cc-4195-b1be-414266d02552 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:03.573539 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76681a96-27cc-4195-b1be-414266d02552 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:03.573618 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76681a96-27cc-4195-b1be-414266d02552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:03.592398 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-76681a96-27cc-4195-b1be-414266d02552 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:12:03.593590 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-76681a96-27cc-4195-b1be-414266d02552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:12:03.659365 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 495/998] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:12:03 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 10:12:03.682592 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943c87eb-1b91-44af-97e3-e4c009022271 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:03.705743 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:03.789824 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943c87eb-1b91-44af-97e3-e4c009022271 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:03.830047 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2fd39d-ddf7-4dd1-932a-f839a0cd2757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:03.830871 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2fd39d-ddf7-4dd1-932a-f839a0cd2757 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:03.831290 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2fd39d-ddf7-4dd1-932a-f839a0cd2757 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:03.831697 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2fd39d-ddf7-4dd1-932a-f839a0cd2757 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:03.832658 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2fd39d-ddf7-4dd1-932a-f839a0cd2757 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:03.834738 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2fd39d-ddf7-4dd1-932a-f839a0cd2757 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:03.848261 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-bc2fd39d-ddf7-4dd1-932a-f839a0cd2757 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 10:12:03.848261 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:12:03.848261 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 10:12:03.848261 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 10:12:03.848261 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 10:12:03.848261 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 10:12:03.848261 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 10:12:03.848261 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 10:12:03.848261 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 10:12:03.848261 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:12:03.848261 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 10:12:03.848261 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:12:03.848261 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:12:03.848261 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:12:03.848261 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:12:03.848261 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:12:03.848261 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:12:03.849263 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:12:03.849263 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:12:03.849263 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:12:03.849263 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:12:03.849263 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:12:03.849263 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:12:03.849263 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 10:12:03.849263 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 10:12:03.849263 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 10:12:03.849263 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 10:12:03.849263 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:12:03.849263 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:12:03.849263 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:12:03.849263 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:12:03.849263 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:12:03.849263 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:12:03.850596 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:12:03.850596 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:12:03.850596 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:12:03.850596 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:12:03.850596 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:12:03.850596 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:12:03.850596 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:12:03.850596 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:12:03.850596 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:12:03.850596 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:12:03.850596 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 10:12:03.850596 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 10:12:03.850596 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 09 10:12:03.850596 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:12:03.854687 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 504/999] 10.222.0.36 () {56 vars in 1126 bytes} [Tue Aug 9 10:12:03 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:12:03.857553 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76681a96-27cc-4195-b1be-414266d02552 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:03.876840 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:03.970907 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76681a96-27cc-4195-b1be-414266d02552 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:04.005562 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08227f58-b16a-4137-88bf-d91adbb88b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:04.006193 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08227f58-b16a-4137-88bf-d91adbb88b23 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:04.006470 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08227f58-b16a-4137-88bf-d91adbb88b23 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:04.006739 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08227f58-b16a-4137-88bf-d91adbb88b23 None admin] PATH_INFO: `/v3/services` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:04.007362 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08227f58-b16a-4137-88bf-d91adbb88b23 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:12:04.007662 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08227f58-b16a-4137-88bf-d91adbb88b23 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:04.009008 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08227f58-b16a-4137-88bf-d91adbb88b23 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:04.019788 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 496/1000] 10.222.0.36 () {56 vars in 1122 bytes} [Tue Aug 9 10:12:03 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:12:04.020957 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2fd39d-ddf7-4dd1-932a-f839a0cd2757 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:04.108501 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:04.126656 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2fd39d-ddf7-4dd1-932a-f839a0cd2757 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:04.162780 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51a5c9f-7649-4027-9363-6dfe4047d74b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:04.163382 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51a5c9f-7649-4027-9363-6dfe4047d74b None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:04.163658 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51a5c9f-7649-4027-9363-6dfe4047d74b None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:04.163926 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51a5c9f-7649-4027-9363-6dfe4047d74b None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:04.164581 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51a5c9f-7649-4027-9363-6dfe4047d74b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:12:04.164884 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51a5c9f-7649-4027-9363-6dfe4047d74b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:04.166594 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51a5c9f-7649-4027-9363-6dfe4047d74b None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:04.176891 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 505/1001] 10.222.0.36 () {56 vars in 1122 bytes} [Tue Aug 9 10:12:04 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:12:04.178142 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08227f58-b16a-4137-88bf-d91adbb88b23 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:04.264803 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:04.284814 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08227f58-b16a-4137-88bf-d91adbb88b23 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:04.318415 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67cff65-bf26-4905-9563-32cf62bed248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:04.319022 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67cff65-bf26-4905-9563-32cf62bed248 None admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:04.319302 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67cff65-bf26-4905-9563-32cf62bed248 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:04.319574 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67cff65-bf26-4905-9563-32cf62bed248 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:04.320233 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67cff65-bf26-4905-9563-32cf62bed248 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:04.321594 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67cff65-bf26-4905-9563-32cf62bed248 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:04.345874 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 497/1002] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:12:04 2022] POST /identity/v3/endpoints => generated 325 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:12:04.407028 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52184892-e2b8-4d0e-bb46-106f3eee588d None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:04.407308 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52184892-e2b8-4d0e-bb46-106f3eee588d None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:04.407582 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52184892-e2b8-4d0e-bb46-106f3eee588d None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:04.409107 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 506/1003] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:12:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 10:12:04.414533 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ec246e-a24a-42de-bbf4-4c64e05aea1f None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:04.414851 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ec246e-a24a-42de-bbf4-4c64e05aea1f None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:04.415092 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ec246e-a24a-42de-bbf4-4c64e05aea1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:04.434126 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-92ec246e-a24a-42de-bbf4-4c64e05aea1f None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:12:04.435342 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-92ec246e-a24a-42de-bbf4-4c64e05aea1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:12:04.522904 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 498/1004] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:12:04 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 10:12:04.545942 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52184892-e2b8-4d0e-bb46-106f3eee588d None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:04.598664 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118fd25c-0fa0-44d1-984b-d663f879f453 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:04.599179 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118fd25c-0fa0-44d1-984b-d663f879f453 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:04.599258 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118fd25c-0fa0-44d1-984b-d663f879f453 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:04.600706 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 499/1005] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:12:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 10:12:04.606047 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e519e6-2bea-4164-9543-9d07ce7448b3 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:04.606335 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e519e6-2bea-4164-9543-9d07ce7448b3 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:04.606615 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e519e6-2bea-4164-9543-9d07ce7448b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:04.624622 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-74e519e6-2bea-4164-9543-9d07ce7448b3 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:12:04.625815 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-74e519e6-2bea-4164-9543-9d07ce7448b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:12:04.653893 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52184892-e2b8-4d0e-bb46-106f3eee588d None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:04.690911 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f146bac-2bde-4cd8-9244-3ca920e365ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:04.691455 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f146bac-2bde-4cd8-9244-3ca920e365ee None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:04.691733 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f146bac-2bde-4cd8-9244-3ca920e365ee None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:04.692004 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f146bac-2bde-4cd8-9244-3ca920e365ee None admin] PATH_INFO: `/v3/services/image` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:04.692594 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f146bac-2bde-4cd8-9244-3ca920e365ee None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:04.693991 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f146bac-2bde-4cd8-9244-3ca920e365ee None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:04.694240 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:04.708824 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 500/1006] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:12:04 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 10:12:04.709024 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-8f146bac-2bde-4cd8-9244-3ca920e365ee None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 09 10:12:04.709024 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:12:04.709024 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 10:12:04.709024 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 10:12:04.709024 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 10:12:04.709024 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 10:12:04.709024 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 10:12:04.709024 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 10:12:04.709024 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 09 10:12:04.709024 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:12:04.709024 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 10:12:04.709024 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:12:04.709024 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:12:04.709024 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:12:04.709024 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:12:04.709024 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:12:04.709024 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:12:04.710368 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:12:04.710368 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:12:04.710368 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:12:04.710368 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:12:04.710368 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:12:04.710368 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:12:04.710368 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 10:12:04.710368 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 10:12:04.710368 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 10:12:04.710368 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 10:12:04.710368 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:12:04.710368 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:12:04.710368 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:12:04.710368 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:12:04.710368 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:12:04.710368 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:12:04.711220 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:12:04.711220 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:12:04.711220 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:12:04.711220 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:12:04.711220 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:12:04.711220 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:12:04.711220 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:12:04.711220 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:12:04.711220 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:12:04.711220 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:12:04.711220 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 10:12:04.711220 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 10:12:04.711220 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 09 10:12:04.711220 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:12:04.711220 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 507/1007] 10.222.0.36 () {56 vars in 1105 bytes} [Tue Aug 9 10:12:04 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:12:04.712036 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e519e6-2bea-4164-9543-9d07ce7448b3 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:04.725991 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f146bac-2bde-4cd8-9244-3ca920e365ee None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:04.741485 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:04.822120 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e519e6-2bea-4164-9543-9d07ce7448b3 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:04.836646 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f146bac-2bde-4cd8-9244-3ca920e365ee None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:04.864914 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b046ec9e-e7f9-49a9-8074-b84b1e28921c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:04.865568 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b046ec9e-e7f9-49a9-8074-b84b1e28921c None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:04.865901 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b046ec9e-e7f9-49a9-8074-b84b1e28921c None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:04.866200 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b046ec9e-e7f9-49a9-8074-b84b1e28921c None admin] PATH_INFO: `/v3/services` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:04.866833 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b046ec9e-e7f9-49a9-8074-b84b1e28921c None admin] RBAC: Adding query filter params (name=image) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:12:04.867145 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b046ec9e-e7f9-49a9-8074-b84b1e28921c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:04.868613 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b046ec9e-e7f9-49a9-8074-b84b1e28921c None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:04.873071 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080612ec-9221-4a92-b15d-22585d2b0625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:04.873693 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080612ec-9221-4a92-b15d-22585d2b0625 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:04.874009 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080612ec-9221-4a92-b15d-22585d2b0625 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:04.878854 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080612ec-9221-4a92-b15d-22585d2b0625 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:04.879009 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 501/1008] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:12:04 2022] GET /identity/v3/services?name=image => generated 122 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:12:04.879102 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080612ec-9221-4a92-b15d-22585d2b0625 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:04.879102 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080612ec-9221-4a92-b15d-22585d2b0625 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:04.879840 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b046ec9e-e7f9-49a9-8074-b84b1e28921c None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:04.889560 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-080612ec-9221-4a92-b15d-22585d2b0625 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 09 10:12:04.889560 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:12:04.889560 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 10:12:04.889560 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 10:12:04.889560 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 10:12:04.889560 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 10:12:04.889560 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 10:12:04.889560 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 10:12:04.889560 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 09 10:12:04.889560 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:12:04.889560 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 10:12:04.889560 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:12:04.889560 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:12:04.889560 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:12:04.889560 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:12:04.889560 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:12:04.889560 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:12:04.890782 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:12:04.890782 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:12:04.890782 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:12:04.890782 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:12:04.890782 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:12:04.890782 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:12:04.890782 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 10:12:04.890782 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 10:12:04.890782 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 10:12:04.890782 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 10:12:04.890782 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:12:04.890782 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:12:04.890782 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:12:04.890782 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:12:04.890782 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:12:04.890782 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:12:04.892323 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:12:04.892323 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:12:04.892323 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:12:04.892323 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:12:04.892323 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:12:04.892323 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:12:04.892323 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:12:04.892323 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:12:04.892323 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:12:04.892323 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:12:04.892323 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 10:12:04.892323 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 10:12:04.892323 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 09 10:12:04.892323 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:12:04.892323 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 508/1009] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Aug 9 10:12:04 2022] GET /identity/v3/services/compute => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 10:12:04.896771 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080612ec-9221-4a92-b15d-22585d2b0625 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:04.961683 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:04.986469 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:05.005168 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b046ec9e-e7f9-49a9-8074-b84b1e28921c None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:05.014547 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080612ec-9221-4a92-b15d-22585d2b0625 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:05.041612 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5f4f7c-542f-4f6f-9428-e80554ab5115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:05.042242 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f4f7c-542f-4f6f-9428-e80554ab5115 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:05.042516 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f4f7c-542f-4f6f-9428-e80554ab5115 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:05.042787 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5f4f7c-542f-4f6f-9428-e80554ab5115 None admin] PATH_INFO: `/v3/services` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:05.043406 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5f4f7c-542f-4f6f-9428-e80554ab5115 None admin] RBAC: Adding query filter params (type=image) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:12:05.043702 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5f4f7c-542f-4f6f-9428-e80554ab5115 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:05.045046 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5f4f7c-542f-4f6f-9428-e80554ab5115 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:05.049886 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 502/1010] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:12:04 2022] GET /identity/v3/services?type=image => generated 122 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:12:05.052341 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f853b067-f316-4179-9cf6-4d16cb0f61c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:05.053137 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f853b067-f316-4179-9cf6-4d16cb0f61c5 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:05.053565 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f853b067-f316-4179-9cf6-4d16cb0f61c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:05.054035 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f853b067-f316-4179-9cf6-4d16cb0f61c5 None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:05.054851 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f853b067-f316-4179-9cf6-4d16cb0f61c5 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:12:05.055302 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f853b067-f316-4179-9cf6-4d16cb0f61c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:05.056877 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f853b067-f316-4179-9cf6-4d16cb0f61c5 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:05.067601 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 509/1011] 10.222.0.36 () {56 vars in 1112 bytes} [Tue Aug 9 10:12:04 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:12:05.068860 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5f4f7c-542f-4f6f-9428-e80554ab5115 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:05.185614 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5f4f7c-542f-4f6f-9428-e80554ab5115 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:05.214725 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:05.224498 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee8f5cb-1826-4019-af9b-b368a63debd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:05.225093 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee8f5cb-1826-4019-af9b-b368a63debd3 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:05.225370 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee8f5cb-1826-4019-af9b-b368a63debd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:05.225695 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee8f5cb-1826-4019-af9b-b368a63debd3 None admin] PATH_INFO: `/v3/services` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:05.226368 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee8f5cb-1826-4019-af9b-b368a63debd3 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:12:05.226687 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee8f5cb-1826-4019-af9b-b368a63debd3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:05.228056 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee8f5cb-1826-4019-af9b-b368a63debd3 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:05.234084 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 503/1012] 10.222.0.36 () {56 vars in 1112 bytes} [Tue Aug 9 10:12:05 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:12:05.239916 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f853b067-f316-4179-9cf6-4d16cb0f61c5 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:05.346190 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f853b067-f316-4179-9cf6-4d16cb0f61c5 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:05.381897 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfccd4bb-99f5-4776-82d8-00a26ec92adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:05.382498 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfccd4bb-99f5-4776-82d8-00a26ec92adc None admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:05.382775 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfccd4bb-99f5-4776-82d8-00a26ec92adc None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:05.383044 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfccd4bb-99f5-4776-82d8-00a26ec92adc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:05.383704 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfccd4bb-99f5-4776-82d8-00a26ec92adc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:05.385577 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfccd4bb-99f5-4776-82d8-00a26ec92adc None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:05.395314 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:05.413889 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 510/1013] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:12:05 2022] POST /identity/v3/endpoints => generated 334 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:12:06.414656 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b45b97-1d51-4771-a5e0-9423cb1eb9ad None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:06.415172 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b45b97-1d51-4771-a5e0-9423cb1eb9ad None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:06.415252 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b45b97-1d51-4771-a5e0-9423cb1eb9ad None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:06.417088 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 504/1014] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:12:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:12:06.422141 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb631721-d345-42ad-9aea-1539276e1e90 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:06.422538 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb631721-d345-42ad-9aea-1539276e1e90 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:06.422717 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb631721-d345-42ad-9aea-1539276e1e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:06.441034 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-eb631721-d345-42ad-9aea-1539276e1e90 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:12:06.442245 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-eb631721-d345-42ad-9aea-1539276e1e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:12:06.517414 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 511/1015] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:12:06 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 10:12:06.540776 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b45b97-1d51-4771-a5e0-9423cb1eb9ad None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:06.649759 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b45b97-1d51-4771-a5e0-9423cb1eb9ad None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:06.686490 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a26df5-8481-473d-a108-be75b86e73a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:06.687052 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a26df5-8481-473d-a108-be75b86e73a7 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:06.687334 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a26df5-8481-473d-a108-be75b86e73a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:06.687597 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a26df5-8481-473d-a108-be75b86e73a7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:06.688704 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a26df5-8481-473d-a108-be75b86e73a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:06.690153 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a26df5-8481-473d-a108-be75b86e73a7 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:06.691874 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 505/1016] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:12:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:12:06.697620 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb631721-d345-42ad-9aea-1539276e1e90 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:06.798032 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb631721-d345-42ad-9aea-1539276e1e90 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:06.820048 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:06.833120 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3bcb47-0b52-48ee-b909-0d6f810f9f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:06.833726 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3bcb47-0b52-48ee-b909-0d6f810f9f19 None admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:06.834037 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3bcb47-0b52-48ee-b909-0d6f810f9f19 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:06.834314 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3bcb47-0b52-48ee-b909-0d6f810f9f19 None admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:06.834965 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3bcb47-0b52-48ee-b909-0d6f810f9f19 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:06.836410 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3bcb47-0b52-48ee-b909-0d6f810f9f19 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:06.864162 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 512/1017] 10.222.0.36 () {60 vars in 1141 bytes} [Tue Aug 9 10:12:06 2022] POST /identity/v3/projects => generated 311 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:12:07.061733 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e8981-d52e-4b50-b19e-110fa16343cf None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:07.062188 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e8981-d52e-4b50-b19e-110fa16343cf None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:07.062471 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e8981-d52e-4b50-b19e-110fa16343cf None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:07.063809 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 506/1018] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:12:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:12:07.069149 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be156ab-98ba-415f-bb9d-5f9eba116e13 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:07.069441 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be156ab-98ba-415f-bb9d-5f9eba116e13 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:07.069721 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be156ab-98ba-415f-bb9d-5f9eba116e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:07.089287 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-7be156ab-98ba-415f-bb9d-5f9eba116e13 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:12:07.090501 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-7be156ab-98ba-415f-bb9d-5f9eba116e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:12:07.160468 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 513/1019] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:12:07 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 10:12:07.183660 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6e8981-d52e-4b50-b19e-110fa16343cf None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:07.243855 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:07.287635 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6e8981-d52e-4b50-b19e-110fa16343cf None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:07.322877 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4c9305-31fb-45da-92aa-bebb8747e124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:07.323436 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c9305-31fb-45da-92aa-bebb8747e124 None admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:07.323715 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c9305-31fb-45da-92aa-bebb8747e124 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:07.323983 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c9305-31fb-45da-92aa-bebb8747e124 None admin] PATH_INFO: `/v3/services` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:07.324626 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4c9305-31fb-45da-92aa-bebb8747e124 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:07.326019 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4c9305-31fb-45da-92aa-bebb8747e124 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:07.349885 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 507/1020] 10.222.0.36 () {60 vars in 1141 bytes} [Tue Aug 9 10:12:07 2022] POST /identity/v3/services => generated 242 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:12:07.533976 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fb748c-c116-47eb-b93c-3cf1ea177cba None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:07.534465 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fb748c-c116-47eb-b93c-3cf1ea177cba None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:07.534465 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fb748c-c116-47eb-b93c-3cf1ea177cba None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:07.535904 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 514/1021] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:12:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:12:07.541095 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dded67-0d42-48ff-a3b6-259e37bf1c53 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:07.542433 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dded67-0d42-48ff-a3b6-259e37bf1c53 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:07.542433 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dded67-0d42-48ff-a3b6-259e37bf1c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:07.561483 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-48dded67-0d42-48ff-a3b6-259e37bf1c53 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:12:07.562685 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-48dded67-0d42-48ff-a3b6-259e37bf1c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:12:07.636125 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 508/1022] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:12:07 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 10:12:07.659033 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fb748c-c116-47eb-b93c-3cf1ea177cba None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:07.760112 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fb748c-c116-47eb-b93c-3cf1ea177cba None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:07.762446 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:07.798758 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be57a07b-55f4-4228-8c10-4519e4aaaf9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:07.799318 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be57a07b-55f4-4228-8c10-4519e4aaaf9f None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:07.799593 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be57a07b-55f4-4228-8c10-4519e4aaaf9f None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:07.799862 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be57a07b-55f4-4228-8c10-4519e4aaaf9f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:07.810511 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be57a07b-55f4-4228-8c10-4519e4aaaf9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 10:12:07.815177 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-be57a07b-55f4-4228-8c10-4519e4aaaf9f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 09 10:12:07.815177 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:12:07.815177 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:12:07.815177 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:12:07.815177 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:12:07.815177 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:12:07.815177 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:12:07.815177 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:12:07.815177 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:12:07.815177 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:12:07.815177 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:12:07.815177 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:12:07.815177 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 10:12:07.815177 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 10:12:07.815177 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 10:12:07.815177 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 10:12:07.816102 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 10:12:07.816102 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 10:12:07.816102 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 10:12:07.816102 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 10:12:07.816102 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:12:07.816102 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:12:07.816102 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:12:07.816102 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:12:07.816102 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:12:07.816102 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:12:07.816102 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:12:07.816102 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:12:07.816102 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:12:07.816102 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:12:07.816102 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:12:07.816102 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:12:07.816954 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:12:07.816954 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:12:07.816954 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:12:07.816954 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:12:07.816954 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 10:12:07.816954 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 10:12:07.816954 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 10:12:07.816954 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 10:12:07.816954 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 10:12:07.816954 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 10:12:07.816954 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 09 10:12:07.816954 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:12:07.824504 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 515/1023] 10.222.0.36 () {56 vars in 1120 bytes} [Tue Aug 9 10:12:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:12:07.824655 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dded67-0d42-48ff-a3b6-259e37bf1c53 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:07.869280 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:07.926470 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dded67-0d42-48ff-a3b6-259e37bf1c53 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:07.967159 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422881a4-4ee7-4f6e-b22f-bd61ec2d4229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:07.967760 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422881a4-4ee7-4f6e-b22f-bd61ec2d4229 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:07.968037 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422881a4-4ee7-4f6e-b22f-bd61ec2d4229 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:07.968305 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422881a4-4ee7-4f6e-b22f-bd61ec2d4229 None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:07.968971 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422881a4-4ee7-4f6e-b22f-bd61ec2d4229 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:12:07.969275 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422881a4-4ee7-4f6e-b22f-bd61ec2d4229 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:07.970655 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422881a4-4ee7-4f6e-b22f-bd61ec2d4229 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:07.979716 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 509/1024] 10.222.0.36 () {56 vars in 1115 bytes} [Tue Aug 9 10:12:07 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:12:07.985507 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be57a07b-55f4-4228-8c10-4519e4aaaf9f None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:08.089698 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be57a07b-55f4-4228-8c10-4519e4aaaf9f None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:08.123306 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223fe1ae-5e31-413e-a5fe-b31aff642799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:08.123921 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223fe1ae-5e31-413e-a5fe-b31aff642799 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:08.124193 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223fe1ae-5e31-413e-a5fe-b31aff642799 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:08.124459 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223fe1ae-5e31-413e-a5fe-b31aff642799 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:08.134236 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223fe1ae-5e31-413e-a5fe-b31aff642799 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:08.136370 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223fe1ae-5e31-413e-a5fe-b31aff642799 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:08.151256 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-223fe1ae-5e31-413e-a5fe-b31aff642799 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:12:08.151256 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:12:08.151256 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:12:08.151256 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:12:08.151256 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:12:08.151256 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:12:08.151256 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:12:08.151256 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:12:08.151256 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:12:08.151256 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:12:08.151256 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:12:08.151256 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:12:08.151256 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 10:12:08.151256 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 10:12:08.151256 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 10:12:08.151256 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 10:12:08.152292 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:12:08.152292 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:12:08.152292 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:12:08.152292 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:12:08.152292 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:12:08.152292 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:12:08.152292 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:12:08.152292 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:12:08.152292 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:12:08.152292 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:12:08.152292 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:12:08.152292 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:12:08.152292 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:12:08.152292 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:12:08.152292 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:12:08.152292 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:12:08.152292 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 10:12:08.153191 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 10:12:08.153191 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:12:08.153191 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:12:08.154171 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 516/1025] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:12:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:12:08.157888 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422881a4-4ee7-4f6e-b22f-bd61ec2d4229 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:08.258989 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422881a4-4ee7-4f6e-b22f-bd61ec2d4229 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:08.265774 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:08.293698 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ea3fd6-259d-4fb0-8fef-d0bcf431b6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:08.294324 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea3fd6-259d-4fb0-8fef-d0bcf431b6d1 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:08.294607 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea3fd6-259d-4fb0-8fef-d0bcf431b6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:08.294875 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea3fd6-259d-4fb0-8fef-d0bcf431b6d1 None admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:08.295531 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ea3fd6-259d-4fb0-8fef-d0bcf431b6d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:12:08.295858 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ea3fd6-259d-4fb0-8fef-d0bcf431b6d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:08.297200 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ea3fd6-259d-4fb0-8fef-d0bcf431b6d1 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:08.308343 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 510/1026] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Aug 9 10:12:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:12:08.313688 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223fe1ae-5e31-413e-a5fe-b31aff642799 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:08.332750 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:08.416023 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223fe1ae-5e31-413e-a5fe-b31aff642799 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:08.452540 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b60438d-f0ac-4b55-9c88-7480566d6ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:08.453162 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b60438d-f0ac-4b55-9c88-7480566d6ddc None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:08.453437 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b60438d-f0ac-4b55-9c88-7480566d6ddc None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:08.453703 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b60438d-f0ac-4b55-9c88-7480566d6ddc None admin] PATH_INFO: `/v3/users/nova` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:08.461342 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b60438d-f0ac-4b55-9c88-7480566d6ddc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:08.462802 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b60438d-f0ac-4b55-9c88-7480566d6ddc None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:08.474303 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-0b60438d-f0ac-4b55-9c88-7480566d6ddc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 09 10:12:08.474303 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:12:08.474303 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:12:08.474303 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:12:08.474303 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:12:08.474303 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:12:08.474303 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:12:08.474303 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:12:08.474303 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:12:08.474303 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:12:08.474303 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:12:08.474303 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:12:08.474303 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 10:12:08.474303 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 10:12:08.474303 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 10:12:08.474303 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 10:12:08.475336 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:12:08.475336 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:12:08.475336 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 10:12:08.475336 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 10:12:08.475336 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 10:12:08.475336 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 10:12:08.475336 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:12:08.475336 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:12:08.475336 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:12:08.475336 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:12:08.475336 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:12:08.475336 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:12:08.475336 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:12:08.475336 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:12:08.475336 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:12:08.475336 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:12:08.475336 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:12:08.475336 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:12:08.476441 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:12:08.476441 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:12:08.476441 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 10:12:08.476441 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 10:12:08.476441 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 10:12:08.476441 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 10:12:08.476441 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 10:12:08.476441 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 10:12:08.476441 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 09 10:12:08.476441 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:12:08.480714 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 517/1027] 10.222.0.36 () {56 vars in 1093 bytes} [Tue Aug 9 10:12:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:12:08.482100 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ea3fd6-259d-4fb0-8fef-d0bcf431b6d1 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:08.586436 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ea3fd6-259d-4fb0-8fef-d0bcf431b6d1 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:08.620288 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64d65a9-3152-49c4-b03c-cfb1ee8e0c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:08.620896 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d65a9-3152-49c4-b03c-cfb1ee8e0c60 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:08.621176 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d65a9-3152-49c4-b03c-cfb1ee8e0c60 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:08.621451 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d65a9-3152-49c4-b03c-cfb1ee8e0c60 None admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:08.622200 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64d65a9-3152-49c4-b03c-cfb1ee8e0c60 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:12:08.622507 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64d65a9-3152-49c4-b03c-cfb1ee8e0c60 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:08.623920 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64d65a9-3152-49c4-b03c-cfb1ee8e0c60 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:08.646153 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 511/1028] 10.222.0.36 () {56 vars in 1133 bytes} [Tue Aug 9 10:12:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:12:08.647416 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b60438d-f0ac-4b55-9c88-7480566d6ddc None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:08.727186 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:08.751725 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b60438d-f0ac-4b55-9c88-7480566d6ddc None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:08.785773 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e173aad1-fc80-413e-bef5-f9ff6c6d8caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:08.786397 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e173aad1-fc80-413e-bef5-f9ff6c6d8caf None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:08.786676 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e173aad1-fc80-413e-bef5-f9ff6c6d8caf None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:08.786942 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e173aad1-fc80-413e-bef5-f9ff6c6d8caf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:08.854515 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e173aad1-fc80-413e-bef5-f9ff6c6d8caf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:08.855981 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e173aad1-fc80-413e-bef5-f9ff6c6d8caf None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:08.924040 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda6dbc-dcfd-4549-82e8-b3b9d3a6747c None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:08.924422 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda6dbc-dcfd-4549-82e8-b3b9d3a6747c None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:08.924770 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda6dbc-dcfd-4549-82e8-b3b9d3a6747c None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:08.926233 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 512/1029] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:12:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 10:12:08.931682 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5812ee1-af1a-4534-8d7e-42a50a852f7a None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:08.932707 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5812ee1-af1a-4534-8d7e-42a50a852f7a None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:08.933038 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5812ee1-af1a-4534-8d7e-42a50a852f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:08.934578 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:08.951927 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-d5812ee1-af1a-4534-8d7e-42a50a852f7a None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:12:08.953103 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-d5812ee1-af1a-4534-8d7e-42a50a852f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:12:08.969307 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 518/1030] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Aug 9 10:12:08 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 10:12:08.971294 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:08.975002 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e173aad1-fc80-413e-bef5-f9ff6c6d8caf None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:09.025928 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 513/1031] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:12:08 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 10:12:09.049533 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5812ee1-af1a-4534-8d7e-42a50a852f7a None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:09.083345 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e173aad1-fc80-413e-bef5-f9ff6c6d8caf None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:09.124233 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e7f7d2-d4c4-4a13-b37d-b2af0853677b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:09.124863 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e7f7d2-d4c4-4a13-b37d-b2af0853677b None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:09.125142 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e7f7d2-d4c4-4a13-b37d-b2af0853677b None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:09.125414 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e7f7d2-d4c4-4a13-b37d-b2af0853677b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:09.136871 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e7f7d2-d4c4-4a13-b37d-b2af0853677b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:09.138365 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e7f7d2-d4c4-4a13-b37d-b2af0853677b None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:09.154244 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-26e7f7d2-d4c4-4a13-b37d-b2af0853677b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:12:09.154244 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:12:09.154244 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:12:09.154244 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:12:09.154244 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:12:09.154244 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:12:09.154244 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:12:09.154244 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:12:09.154244 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:12:09.154244 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:12:09.154244 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:12:09.154244 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:12:09.154244 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 10:12:09.154244 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 10:12:09.154244 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 10:12:09.154244 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 10:12:09.155219 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:12:09.155219 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:12:09.155219 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:12:09.155219 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:12:09.155219 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:12:09.155219 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:12:09.155219 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:12:09.155219 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:12:09.155219 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:12:09.155219 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:12:09.155219 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:12:09.155219 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:12:09.155219 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:12:09.155219 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:12:09.155219 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:12:09.155219 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:12:09.155219 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 10:12:09.156110 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 10:12:09.156110 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:12:09.156110 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:12:09.156110 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 519/1032] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:12:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:12:09.160805 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e7f7d2-d4c4-4a13-b37d-b2af0853677b None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:09.162628 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5812ee1-af1a-4534-8d7e-42a50a852f7a None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:09.192123 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:09.199821 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91abbc3e-9404-4ad6-9671-751bcb05cd36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:09.200460 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91abbc3e-9404-4ad6-9671-751bcb05cd36 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:09.200740 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91abbc3e-9404-4ad6-9671-751bcb05cd36 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:09.201007 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91abbc3e-9404-4ad6-9671-751bcb05cd36 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:09.202154 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91abbc3e-9404-4ad6-9671-751bcb05cd36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:09.203630 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91abbc3e-9404-4ad6-9671-751bcb05cd36 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:09.205385 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 514/1033] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:12:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:12:09.210729 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91abbc3e-9404-4ad6-9671-751bcb05cd36 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:09.236221 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:09.268134 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e7f7d2-d4c4-4a13-b37d-b2af0853677b None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:09.305694 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b24720c-41d5-4918-8503-0bdfd6120235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:09.306400 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b24720c-41d5-4918-8503-0bdfd6120235 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:09.306682 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b24720c-41d5-4918-8503-0bdfd6120235 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:09.307519 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b24720c-41d5-4918-8503-0bdfd6120235 None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:09.308131 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b24720c-41d5-4918-8503-0bdfd6120235 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:12:09.308431 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b24720c-41d5-4918-8503-0bdfd6120235 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:09.309984 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b24720c-41d5-4918-8503-0bdfd6120235 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:09.319263 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91abbc3e-9404-4ad6-9671-751bcb05cd36 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:09.322151 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 520/1034] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Aug 9 10:12:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:12:09.327780 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b24720c-41d5-4918-8503-0bdfd6120235 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:09.355290 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a4c9e2-bbb0-4fa3-b9cf-995056b8c44b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:09.355903 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a4c9e2-bbb0-4fa3-b9cf-995056b8c44b None admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:09.356219 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a4c9e2-bbb0-4fa3-b9cf-995056b8c44b None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:09.356480 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a4c9e2-bbb0-4fa3-b9cf-995056b8c44b None admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:09.357109 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a4c9e2-bbb0-4fa3-b9cf-995056b8c44b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:09.358561 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a4c9e2-bbb0-4fa3-b9cf-995056b8c44b None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:09.384007 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 515/1035] 10.222.0.36 () {60 vars in 1132 bytes} [Tue Aug 9 10:12:09 2022] POST /identity/v3/users => generated 285 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 10:12:09.403063 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29e10a-e4c3-451c-b2b5-1b94009ef4cb None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:09.403350 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29e10a-e4c3-451c-b2b5-1b94009ef4cb None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:09.403628 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29e10a-e4c3-451c-b2b5-1b94009ef4cb None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:09.405165 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 516/1036] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:12:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 10:12:09.410763 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75076a98-cf38-4222-a74d-6cf9c4e1f260 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:09.411051 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75076a98-cf38-4222-a74d-6cf9c4e1f260 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:09.411331 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75076a98-cf38-4222-a74d-6cf9c4e1f260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:09.427810 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:09.433959 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-75076a98-cf38-4222-a74d-6cf9c4e1f260 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:12:09.435215 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-75076a98-cf38-4222-a74d-6cf9c4e1f260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:12:09.444593 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b24720c-41d5-4918-8503-0bdfd6120235 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:09.485441 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f928db-7c5a-4f08-aaf6-e1e5e72da2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:09.486112 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f928db-7c5a-4f08-aaf6-e1e5e72da2eb None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:09.486417 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f928db-7c5a-4f08-aaf6-e1e5e72da2eb None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:09.486667 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f928db-7c5a-4f08-aaf6-e1e5e72da2eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:09.494105 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f928db-7c5a-4f08-aaf6-e1e5e72da2eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:09.496045 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f928db-7c5a-4f08-aaf6-e1e5e72da2eb None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:09.508767 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-95f928db-7c5a-4f08-aaf6-e1e5e72da2eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 10:12:09.508767 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:12:09.508767 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:12:09.508767 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:12:09.508767 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:12:09.508767 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:12:09.508767 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:12:09.508767 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:12:09.508767 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:12:09.508767 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:12:09.508767 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:12:09.508767 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:12:09.508767 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 10:12:09.508767 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 10:12:09.508767 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 10:12:09.509741 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 10:12:09.509741 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:12:09.509741 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:12:09.509741 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:12:09.509741 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:12:09.509741 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:12:09.509741 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:12:09.509741 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:12:09.509741 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:12:09.509741 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:12:09.509741 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:12:09.509741 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:12:09.509741 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:12:09.509741 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:12:09.509741 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:12:09.509741 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:12:09.509741 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:12:09.514975 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 10:12:09.514975 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 10:12:09.514975 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 10:12:09.514975 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 10:12:09.514975 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 10:12:09.514975 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 10:12:09.514975 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 10:12:09.514975 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:12:09.515447 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 517/1037] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:12:09 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 10:12:09.515535 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 521/1038] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Aug 9 10:12:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 10:12:09.518097 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75076a98-cf38-4222-a74d-6cf9c4e1f260 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:09.529563 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:09.536855 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f928db-7c5a-4f08-aaf6-e1e5e72da2eb None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:09.637093 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75076a98-cf38-4222-a74d-6cf9c4e1f260 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:09.660236 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f928db-7c5a-4f08-aaf6-e1e5e72da2eb None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:09.672966 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242690b2-5aff-4689-83fb-bff28f40d440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:09.673583 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242690b2-5aff-4689-83fb-bff28f40d440 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:09.673875 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242690b2-5aff-4689-83fb-bff28f40d440 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:09.674159 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242690b2-5aff-4689-83fb-bff28f40d440 None admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:09.674846 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242690b2-5aff-4689-83fb-bff28f40d440 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:12:09.675155 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242690b2-5aff-4689-83fb-bff28f40d440 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:09.676600 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242690b2-5aff-4689-83fb-bff28f40d440 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:09.693454 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 518/1039] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Aug 9 10:12:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:12:09.694549 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242690b2-5aff-4689-83fb-bff28f40d440 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:09.704249 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bdf325-17af-4c6c-bca2-d659bc5e96e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:09.704875 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bdf325-17af-4c6c-bca2-d659bc5e96e7 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:09.705149 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bdf325-17af-4c6c-bca2-d659bc5e96e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:09.705422 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bdf325-17af-4c6c-bca2-d659bc5e96e7 None admin] PATH_INFO: `/v3/services/image` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:09.706042 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bdf325-17af-4c6c-bca2-d659bc5e96e7 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:09.707406 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bdf325-17af-4c6c-bca2-d659bc5e96e7 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:09.716757 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-43bdf325-17af-4c6c-bca2-d659bc5e96e7 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 09 10:12:09.716757 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:12:09.716757 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 10:12:09.716757 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 10:12:09.716757 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 10:12:09.716757 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 10:12:09.716757 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 10:12:09.716757 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 10:12:09.716757 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 09 10:12:09.716757 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:12:09.716757 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 10:12:09.716757 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:12:09.716757 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:12:09.716757 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:12:09.716757 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:12:09.716757 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:12:09.716757 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:12:09.717739 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:12:09.717739 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:12:09.717739 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:12:09.717739 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:12:09.717739 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:12:09.717739 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:12:09.717739 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 10:12:09.717739 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 10:12:09.717739 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 10:12:09.717739 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 10:12:09.717739 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:12:09.717739 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:12:09.717739 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:12:09.717739 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:12:09.717739 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:12:09.717739 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:12:09.718922 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:12:09.718922 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:12:09.718922 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:12:09.718922 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:12:09.718922 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:12:09.718922 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:12:09.718922 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:12:09.718922 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:12:09.718922 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:12:09.718922 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:12:09.718922 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 10:12:09.718922 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 10:12:09.718922 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 09 10:12:09.718922 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:12:09.722173 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 522/1040] 10.222.0.36 () {56 vars in 1105 bytes} [Tue Aug 9 10:12:09 2022] GET /identity/v3/services/image => generated 86 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:12:09.723886 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bdf325-17af-4c6c-bca2-d659bc5e96e7 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:09.739593 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:09.769055 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:09.805990 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242690b2-5aff-4689-83fb-bff28f40d440 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:09.831193 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bdf325-17af-4c6c-bca2-d659bc5e96e7 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:09.842358 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eb7d72-c1ae-45d1-9195-1821029288e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:09.842962 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb7d72-c1ae-45d1-9195-1821029288e0 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:09.843241 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb7d72-c1ae-45d1-9195-1821029288e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:09.843509 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb7d72-c1ae-45d1-9195-1821029288e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:09.844230 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eb7d72-c1ae-45d1-9195-1821029288e0 None admin] RBAC: Adding query filter params (role.id=285df47e9c4f4da4a33cfc06254dc9ea, scope.project.id=28891cf6239a43469326a864fb0d216c, user.id=eb863beaaa9f495c8b64655996c061f2) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:12:09.844537 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eb7d72-c1ae-45d1-9195-1821029288e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:09.846178 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eb7d72-c1ae-45d1-9195-1821029288e0 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:09.861872 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 519/1041] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Aug 9 10:12:09 2022] GET /identity/v3/role_assignments?user.id=eb863beaaa9f495c8b64655996c061f2&scope.project.id=28891cf6239a43469326a864fb0d216c&role.id=285df47e9c4f4da4a33cfc06254dc9ea => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:12:09.879764 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e29f50-0038-4496-8c69-a43f1b4d5a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:09.880547 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e29f50-0038-4496-8c69-a43f1b4d5a49 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:09.880903 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e29f50-0038-4496-8c69-a43f1b4d5a49 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:09.881253 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e29f50-0038-4496-8c69-a43f1b4d5a49 None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:09.882085 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e29f50-0038-4496-8c69-a43f1b4d5a49 None admin] RBAC: Adding query filter params (name=image) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:12:09.882461 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e29f50-0038-4496-8c69-a43f1b4d5a49 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:09.884030 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e29f50-0038-4496-8c69-a43f1b4d5a49 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:09.894869 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 523/1042] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:12:09 2022] GET /identity/v3/services?name=image => generated 122 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:12:09.896012 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eb7d72-c1ae-45d1-9195-1821029288e0 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:10.013783 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eb7d72-c1ae-45d1-9195-1821029288e0 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:10.044521 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:10.050405 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152371f0-fbd5-44a5-aaf9-98d4770e1fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:10.051071 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152371f0-fbd5-44a5-aaf9-98d4770e1fa3 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:10.051410 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152371f0-fbd5-44a5-aaf9-98d4770e1fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:10.051743 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152371f0-fbd5-44a5-aaf9-98d4770e1fa3 None admin] PATH_INFO: `/v3/services` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:10.052426 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152371f0-fbd5-44a5-aaf9-98d4770e1fa3 None admin] RBAC: Adding query filter params (type=image) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:12:10.052786 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152371f0-fbd5-44a5-aaf9-98d4770e1fa3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:10.054243 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152371f0-fbd5-44a5-aaf9-98d4770e1fa3 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:10.060409 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 520/1043] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:12:09 2022] GET /identity/v3/services?type=image => generated 350 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:12:10.066113 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e29f50-0038-4496-8c69-a43f1b4d5a49 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:10.144613 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:10.171186 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e29f50-0038-4496-8c69-a43f1b4d5a49 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:10.205773 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5218afda-86f4-44be-80a8-78662ea015f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:10.206462 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218afda-86f4-44be-80a8-78662ea015f0 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:10.206792 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218afda-86f4-44be-80a8-78662ea015f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:10.207066 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218afda-86f4-44be-80a8-78662ea015f0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:10.207764 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5218afda-86f4-44be-80a8-78662ea015f0 None admin] RBAC: Adding query filter params (interface=public, service_id=68411d91d22341d4b3e30793ff9926e6, region_id=RegionOne) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:12:10.208068 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5218afda-86f4-44be-80a8-78662ea015f0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:10.209418 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5218afda-86f4-44be-80a8-78662ea015f0 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:10.219495 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 524/1044] 10.222.0.36 () {56 vars in 1251 bytes} [Tue Aug 9 10:12:10 2022] GET /identity/v3/endpoints?service_id=68411d91d22341d4b3e30793ff9926e6&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:12:10.220734 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152371f0-fbd5-44a5-aaf9-98d4770e1fa3 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:10.323236 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152371f0-fbd5-44a5-aaf9-98d4770e1fa3 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:10.356122 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0d00fd-8a87-4548-8c00-2b1aeff63abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:10.356715 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0d00fd-8a87-4548-8c00-2b1aeff63abe None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:10.356989 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0d00fd-8a87-4548-8c00-2b1aeff63abe None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:10.357263 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0d00fd-8a87-4548-8c00-2b1aeff63abe None admin] PATH_INFO: `/v3/services` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:10.357878 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0d00fd-8a87-4548-8c00-2b1aeff63abe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:10.359219 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0d00fd-8a87-4548-8c00-2b1aeff63abe None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:10.370074 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 521/1045] 10.222.0.36 () {56 vars in 1087 bytes} [Tue Aug 9 10:12:10 2022] GET /identity/v3/services => generated 1957 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:12:11.544599 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371a579-0f9b-4c91-9404-929f70dec1c1 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:11.545132 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371a579-0f9b-4c91-9404-929f70dec1c1 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:11.545132 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371a579-0f9b-4c91-9404-929f70dec1c1 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:11.546631 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 525/1046] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:12:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:12:11.551514 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef4cbd0-16fc-461a-a1d8-1e5452b26069 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:11.551895 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef4cbd0-16fc-461a-a1d8-1e5452b26069 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:11.552068 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef4cbd0-16fc-461a-a1d8-1e5452b26069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:11.571496 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-eef4cbd0-16fc-461a-a1d8-1e5452b26069 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:12:11.573005 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-eef4cbd0-16fc-461a-a1d8-1e5452b26069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:12:11.630321 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:11.643317 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 522/1047] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:12:11 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 10:12:11.667666 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6371a579-0f9b-4c91-9404-929f70dec1c1 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:11.772326 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6371a579-0f9b-4c91-9404-929f70dec1c1 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:11.807590 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8441cade-51cd-4123-af41-3e0c10b74202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:11.808138 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8441cade-51cd-4123-af41-3e0c10b74202 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:11.808416 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8441cade-51cd-4123-af41-3e0c10b74202 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:11.808683 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8441cade-51cd-4123-af41-3e0c10b74202 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:11.816200 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:11.820140 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8441cade-51cd-4123-af41-3e0c10b74202 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 10:12:11.825996 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-8441cade-51cd-4123-af41-3e0c10b74202 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 10:12:11.825996 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:12:11.825996 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:12:11.825996 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:12:11.825996 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:12:11.825996 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:12:11.825996 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:12:11.825996 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:12:11.825996 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:12:11.825996 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:12:11.825996 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:12:11.825996 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:12:11.825996 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 10:12:11.825996 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 10:12:11.825996 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 10:12:11.825996 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 10:12:11.826895 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 10:12:11.826895 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 10:12:11.826895 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 10:12:11.826895 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 10:12:11.826895 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:12:11.826895 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:12:11.826895 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:12:11.826895 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:12:11.826895 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:12:11.826895 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:12:11.826895 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:12:11.826895 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:12:11.826895 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:12:11.826895 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:12:11.826895 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:12:11.826895 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:12:11.827730 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:12:11.827730 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:12:11.827730 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:12:11.827730 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:12:11.827730 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 10:12:11.827730 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 10:12:11.827730 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 10:12:11.827730 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 10:12:11.827730 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 10:12:11.827730 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 10:12:11.827730 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 10:12:11.827730 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:12:11.827730 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 526/1048] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Aug 9 10:12:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:12:11.835160 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef4cbd0-16fc-461a-a1d8-1e5452b26069 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:11.878141 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcb8953-c8ae-47bc-baa7-61872deb8530 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:11.878816 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcb8953-c8ae-47bc-baa7-61872deb8530 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:11.879676 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcb8953-c8ae-47bc-baa7-61872deb8530 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:11.881345 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 527/1049] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:12:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:12:11.887893 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8e4ed-14bc-422d-ada6-ed4584d55336 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:11.888181 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8e4ed-14bc-422d-ada6-ed4584d55336 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:11.888454 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8e4ed-14bc-422d-ada6-ed4584d55336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:11.906880 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-89d8e4ed-14bc-422d-ada6-ed4584d55336 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:12:11.908055 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-89d8e4ed-14bc-422d-ada6-ed4584d55336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:12:11.939418 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef4cbd0-16fc-461a-a1d8-1e5452b26069 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:11.978223 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dee8e0-990a-4be9-848b-9feac25f1eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:11.979344 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dee8e0-990a-4be9-848b-9feac25f1eba None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:11.979624 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dee8e0-990a-4be9-848b-9feac25f1eba None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:11.979944 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dee8e0-990a-4be9-848b-9feac25f1eba None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:11.980597 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dee8e0-990a-4be9-848b-9feac25f1eba None admin] RBAC: Adding query filter params (name=admin) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:12:11.980896 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dee8e0-990a-4be9-848b-9feac25f1eba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:11.982274 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dee8e0-990a-4be9-848b-9feac25f1eba None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:11.984431 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 528/1050] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:12:11 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 10:12:11.992233 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 523/1051] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Aug 9 10:12:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:12:11.997755 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d8e4ed-14bc-422d-ada6-ed4584d55336 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:12.008339 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dee8e0-990a-4be9-848b-9feac25f1eba None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:12.066373 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:12.104619 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d8e4ed-14bc-422d-ada6-ed4584d55336 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:12.116574 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dee8e0-990a-4be9-848b-9feac25f1eba None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:12.135890 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:12.143338 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e96d110-6af7-475d-a0fe-c476cd5babd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:12.143975 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e96d110-6af7-475d-a0fe-c476cd5babd1 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:12.144252 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e96d110-6af7-475d-a0fe-c476cd5babd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:12.144528 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e96d110-6af7-475d-a0fe-c476cd5babd1 None admin] PATH_INFO: `/v3/users/189f8bcc9a584409bd499d9327090559` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:12.153052 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8546f333-993a-48f9-820c-03bcbed5d6e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:12.153982 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8546f333-993a-48f9-820c-03bcbed5d6e9 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:12.154458 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8546f333-993a-48f9-820c-03bcbed5d6e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:12.154911 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8546f333-993a-48f9-820c-03bcbed5d6e9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:12.158519 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e96d110-6af7-475d-a0fe-c476cd5babd1 None admin] RBAC: Authorizing `identity:get_user(user_id=189f8bcc9a584409bd499d9327090559)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:12.159966 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e96d110-6af7-475d-a0fe-c476cd5babd1 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:12.161623 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 529/1052] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Aug 9 10:12:11 2022] GET /identity/v3/users/189f8bcc9a584409bd499d9327090559 => generated 285 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:12:12.168230 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e96d110-6af7-475d-a0fe-c476cd5babd1 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:12.173073 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8546f333-993a-48f9-820c-03bcbed5d6e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 10:12:12.177713 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-8546f333-993a-48f9-820c-03bcbed5d6e9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 09 10:12:12.177713 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:12:12.177713 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:12:12.177713 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:12:12.177713 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:12:12.177713 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:12:12.177713 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:12:12.177713 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:12:12.177713 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:12:12.177713 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:12:12.177713 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:12:12.177713 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:12:12.177713 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 10:12:12.177713 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 10:12:12.177713 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 10:12:12.177713 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 10:12:12.182711 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 10:12:12.182711 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 10:12:12.182711 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 10:12:12.182711 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 10:12:12.182711 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:12:12.182711 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:12:12.182711 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:12:12.182711 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:12:12.182711 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:12:12.182711 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:12:12.182711 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:12:12.182711 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:12:12.182711 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:12:12.182711 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:12:12.182711 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:12:12.182711 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:12:12.183611 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:12:12.183611 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:12:12.183611 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:12:12.183611 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:12:12.183611 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 10:12:12.183611 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 10:12:12.183611 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 10:12:12.183611 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 10:12:12.183611 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 10:12:12.183611 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 10:12:12.183611 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 09 10:12:12.183611 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:12:12.183611 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 524/1053] 10.222.0.36 () {56 vars in 1120 bytes} [Tue Aug 9 10:12:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 10:12:12.184953 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8546f333-993a-48f9-820c-03bcbed5d6e9 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:12.279075 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e96d110-6af7-475d-a0fe-c476cd5babd1 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:12.287831 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8546f333-993a-48f9-820c-03bcbed5d6e9 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:12.302164 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:12.318224 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787755be-c84f-4581-8711-8b526bf8b7af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:12.318750 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787755be-c84f-4581-8711-8b526bf8b7af None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:12.319027 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787755be-c84f-4581-8711-8b526bf8b7af None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:12.319295 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787755be-c84f-4581-8711-8b526bf8b7af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:12.326075 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce57534-7d09-4626-8b6d-dd0985654d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:12.326943 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce57534-7d09-4626-8b6d-dd0985654d65 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:12.327444 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce57534-7d09-4626-8b6d-dd0985654d65 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:12.327907 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce57534-7d09-4626-8b6d-dd0985654d65 None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:12.328784 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce57534-7d09-4626-8b6d-dd0985654d65 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:12:12.329280 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce57534-7d09-4626-8b6d-dd0985654d65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:12.330882 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce57534-7d09-4626-8b6d-dd0985654d65 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:12.344848 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 525/1054] 10.222.0.36 () {56 vars in 1115 bytes} [Tue Aug 9 10:12:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:12:12.345685 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce57534-7d09-4626-8b6d-dd0985654d65 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:12.383564 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:12.396706 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787755be-c84f-4581-8711-8b526bf8b7af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:12.398191 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787755be-c84f-4581-8711-8b526bf8b7af None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:12.449394 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce57534-7d09-4626-8b6d-dd0985654d65 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:12.481758 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4197785-aa33-420e-baba-577ac0617f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:12.482406 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4197785-aa33-420e-baba-577ac0617f35 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:12.482688 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4197785-aa33-420e-baba-577ac0617f35 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:12.482958 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4197785-aa33-420e-baba-577ac0617f35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:12.493180 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4197785-aa33-420e-baba-577ac0617f35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:12.495208 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4197785-aa33-420e-baba-577ac0617f35 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:12.497167 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 530/1055] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Aug 9 10:12:12 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 09 10:12:12.498329 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c3c39f-9e41-4fe0-b90f-f38597bddeb0 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:12.498614 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c3c39f-9e41-4fe0-b90f-f38597bddeb0 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:12.498881 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c3c39f-9e41-4fe0-b90f-f38597bddeb0 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:12.500231 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 531/1056] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:12:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:12:12.504936 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c3c39f-9e41-4fe0-b90f-f38597bddeb0 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:12.509088 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-e4197785-aa33-420e-baba-577ac0617f35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:12:12.509088 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:12:12.509088 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:12:12.509088 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:12:12.509088 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:12:12.509088 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:12:12.509088 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:12:12.509088 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:12:12.509088 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:12:12.509088 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:12:12.509088 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:12:12.509088 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:12:12.509088 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 10:12:12.509088 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 10:12:12.509088 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 10:12:12.509088 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 10:12:12.510876 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:12:12.510876 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:12:12.510876 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:12:12.510876 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:12:12.510876 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:12:12.510876 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:12:12.510876 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:12:12.510876 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:12:12.510876 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:12:12.510876 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:12:12.510876 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:12:12.510876 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:12:12.510876 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:12:12.510876 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:12:12.510876 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:12:12.510876 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:12:12.510876 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 10:12:12.511794 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 10:12:12.511794 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:12:12.511794 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:12:12.511794 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 526/1057] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:12:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 10:12:12.512403 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267651cb-cf7e-4494-9d65-94deb406453b None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:12.512566 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267651cb-cf7e-4494-9d65-94deb406453b None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:12.512797 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267651cb-cf7e-4494-9d65-94deb406453b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:12.530101 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-267651cb-cf7e-4494-9d65-94deb406453b None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:12:12.531291 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-267651cb-cf7e-4494-9d65-94deb406453b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:12:12.552697 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:12.597230 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:12.601552 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 527/1058] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:12:12 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 10:12:12.602410 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267651cb-cf7e-4494-9d65-94deb406453b None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:12.619678 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c3c39f-9e41-4fe0-b90f-f38597bddeb0 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:12.654424 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acab1434-2f5a-43ca-9fb9-74aa1a5044ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:12.655051 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab1434-2f5a-43ca-9fb9-74aa1a5044ce None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:12.655326 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab1434-2f5a-43ca-9fb9-74aa1a5044ce None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:12.655607 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab1434-2f5a-43ca-9fb9-74aa1a5044ce None admin] PATH_INFO: `/v3/projects/c214ab70f4124b2a9e647d2b7cc26a1b` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:12.656705 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acab1434-2f5a-43ca-9fb9-74aa1a5044ce None admin] RBAC: Authorizing `identity:get_project(project_id=c214ab70f4124b2a9e647d2b7cc26a1b)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:12.658161 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acab1434-2f5a-43ca-9fb9-74aa1a5044ce None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:12.659780 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 532/1059] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Aug 9 10:12:12 2022] GET /identity/v3/projects/c214ab70f4124b2a9e647d2b7cc26a1b => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:12:12.660521 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acab1434-2f5a-43ca-9fb9-74aa1a5044ce None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:12.706216 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267651cb-cf7e-4494-9d65-94deb406453b None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:12.739274 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c29111-2d56-407f-8786-279e41ab4963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:12.739863 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c29111-2d56-407f-8786-279e41ab4963 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:12.740135 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c29111-2d56-407f-8786-279e41ab4963 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:12.740401 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c29111-2d56-407f-8786-279e41ab4963 None admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:12.741026 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c29111-2d56-407f-8786-279e41ab4963 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:12:12.741317 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c29111-2d56-407f-8786-279e41ab4963 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:12.742683 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c29111-2d56-407f-8786-279e41ab4963 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:12.753881 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 528/1060] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Aug 9 10:12:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:12:12.754632 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c29111-2d56-407f-8786-279e41ab4963 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:12.763000 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acab1434-2f5a-43ca-9fb9-74aa1a5044ce None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:12.772970 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:12.797751 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32ed355-d68f-4b73-a118-27cdbb623245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:12.798391 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ed355-d68f-4b73-a118-27cdbb623245 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:12.798672 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ed355-d68f-4b73-a118-27cdbb623245 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:12.798943 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ed355-d68f-4b73-a118-27cdbb623245 None admin] PATH_INFO: `/v3/services/image` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:12.799545 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32ed355-d68f-4b73-a118-27cdbb623245 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:12.800908 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32ed355-d68f-4b73-a118-27cdbb623245 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:12.809495 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-c32ed355-d68f-4b73-a118-27cdbb623245 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 09 10:12:12.809495 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:12:12.809495 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 10:12:12.809495 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 10:12:12.809495 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 10:12:12.809495 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 10:12:12.809495 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 10:12:12.809495 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 10:12:12.809495 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 09 10:12:12.809495 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:12:12.809495 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 10:12:12.809495 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:12:12.809495 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:12:12.809495 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:12:12.809495 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:12:12.809495 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:12:12.809495 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:12:12.810521 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:12:12.810521 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:12:12.810521 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:12:12.810521 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:12:12.810521 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:12:12.810521 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:12:12.810521 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 10:12:12.810521 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 10:12:12.810521 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 10:12:12.810521 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 10:12:12.810521 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:12:12.810521 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:12:12.810521 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:12:12.810521 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:12:12.810521 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:12:12.810521 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:12:12.811474 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:12:12.811474 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:12:12.811474 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:12:12.811474 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:12:12.811474 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:12:12.811474 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:12:12.811474 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:12:12.811474 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:12:12.811474 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:12:12.811474 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:12:12.811474 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 10:12:12.811474 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 10:12:12.811474 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 09 10:12:12.811474 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:12:12.811474 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 533/1061] 10.222.0.36 () {56 vars in 1105 bytes} [Tue Aug 9 10:12:12 2022] GET /identity/v3/services/image => generated 86 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:12:12.812448 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32ed355-d68f-4b73-a118-27cdbb623245 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:12.832421 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:12.861194 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c29111-2d56-407f-8786-279e41ab4963 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:12.894265 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693c7c60-5ad2-48b9-a767-72e1091e5bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:12.894856 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c7c60-5ad2-48b9-a767-72e1091e5bb4 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:12.895130 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c7c60-5ad2-48b9-a767-72e1091e5bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:12.895398 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c7c60-5ad2-48b9-a767-72e1091e5bb4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:12.896103 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693c7c60-5ad2-48b9-a767-72e1091e5bb4 None admin] RBAC: Adding query filter params (role.id=89ca30cbbb634be8a96e9921aa56626b, scope.project.id=c214ab70f4124b2a9e647d2b7cc26a1b, user.id=189f8bcc9a584409bd499d9327090559) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:12:12.896405 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693c7c60-5ad2-48b9-a767-72e1091e5bb4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:12.897810 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693c7c60-5ad2-48b9-a767-72e1091e5bb4 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:12.903721 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 529/1062] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Aug 9 10:12:12 2022] GET /identity/v3/role_assignments?user.id=189f8bcc9a584409bd499d9327090559&scope.project.id=c214ab70f4124b2a9e647d2b7cc26a1b&role.id=89ca30cbbb634be8a96e9921aa56626b => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:12:12.904610 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693c7c60-5ad2-48b9-a767-72e1091e5bb4 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:12.911857 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32ed355-d68f-4b73-a118-27cdbb623245 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:12.954473 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a919de58-15b0-46a6-9539-c5faf2fba498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:12.955115 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a919de58-15b0-46a6-9539-c5faf2fba498 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:12.955395 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a919de58-15b0-46a6-9539-c5faf2fba498 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:12.955670 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a919de58-15b0-46a6-9539-c5faf2fba498 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:12.965443 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a919de58-15b0-46a6-9539-c5faf2fba498 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:12.966980 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a919de58-15b0-46a6-9539-c5faf2fba498 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:12.979366 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-a919de58-15b0-46a6-9539-c5faf2fba498 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 09 10:12:12.979366 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:12:12.979366 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:12:12.979366 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:12:12.979366 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:12:12.979366 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:12:12.979366 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:12:12.979366 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:12:12.979366 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:12:12.979366 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:12:12.979366 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:12:12.979366 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:12:12.979366 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 10:12:12.979366 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 10:12:12.979366 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 10:12:12.979366 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 10:12:12.980396 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:12:12.980396 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:12:12.980396 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 10:12:12.980396 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 10:12:12.980396 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 10:12:12.980396 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 10:12:12.980396 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:12:12.980396 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:12:12.980396 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:12:12.980396 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:12:12.980396 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:12:12.980396 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:12:12.980396 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:12:12.980396 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:12:12.980396 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:12:12.980396 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:12:12.980396 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:12:12.980396 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:12:12.981383 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:12:12.981383 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:12:12.981383 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 10:12:12.981383 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 10:12:12.981383 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 10:12:12.981383 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 10:12:12.981383 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 10:12:12.981383 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 10:12:12.981383 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 09 10:12:12.981383 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:12:12.985440 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 534/1063] 10.222.0.36 () {56 vars in 1093 bytes} [Tue Aug 9 10:12:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:12:12.986393 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a919de58-15b0-46a6-9539-c5faf2fba498 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:13.016125 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:13.039989 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693c7c60-5ad2-48b9-a767-72e1091e5bb4 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:13.079575 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b100442-9d69-49f0-be80-8e69cf19c503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:13.080048 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b100442-9d69-49f0-be80-8e69cf19c503 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:13.080327 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b100442-9d69-49f0-be80-8e69cf19c503 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:13.080597 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b100442-9d69-49f0-be80-8e69cf19c503 None admin] PATH_INFO: `/v3/services` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:13.081217 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b100442-9d69-49f0-be80-8e69cf19c503 None admin] RBAC: Adding query filter params (name=image) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:12:13.081516 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b100442-9d69-49f0-be80-8e69cf19c503 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:13.082698 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:13.082902 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b100442-9d69-49f0-be80-8e69cf19c503 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:13.087824 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 530/1064] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:12:12 2022] GET /identity/v3/services?name=image => generated 122 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:12:13.093439 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b100442-9d69-49f0-be80-8e69cf19c503 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:13.107763 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a919de58-15b0-46a6-9539-c5faf2fba498 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:13.145034 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712006ed-66ac-41e8-9b7f-82a5b09a29af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:13.145635 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712006ed-66ac-41e8-9b7f-82a5b09a29af None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:13.145935 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712006ed-66ac-41e8-9b7f-82a5b09a29af None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:13.146239 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712006ed-66ac-41e8-9b7f-82a5b09a29af None admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:13.146928 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712006ed-66ac-41e8-9b7f-82a5b09a29af None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:12:13.147231 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712006ed-66ac-41e8-9b7f-82a5b09a29af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:13.148720 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712006ed-66ac-41e8-9b7f-82a5b09a29af None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:13.171245 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 535/1065] 10.222.0.36 () {56 vars in 1133 bytes} [Tue Aug 9 10:12:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:12:13.172291 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712006ed-66ac-41e8-9b7f-82a5b09a29af None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:13.201807 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b100442-9d69-49f0-be80-8e69cf19c503 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:13.237654 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eeb086-1152-4d32-8e1d-7862e49ee9bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:13.238396 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eeb086-1152-4d32-8e1d-7862e49ee9bd None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:13.238736 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eeb086-1152-4d32-8e1d-7862e49ee9bd None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:13.239073 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eeb086-1152-4d32-8e1d-7862e49ee9bd None admin] PATH_INFO: `/v3/services` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:13.239759 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90eeb086-1152-4d32-8e1d-7862e49ee9bd None admin] RBAC: Adding query filter params (type=image) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:12:13.240131 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90eeb086-1152-4d32-8e1d-7862e49ee9bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:13.241564 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90eeb086-1152-4d32-8e1d-7862e49ee9bd None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:13.246631 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 531/1066] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:12:13 2022] GET /identity/v3/services?type=image => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:12:13.252357 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eeb086-1152-4d32-8e1d-7862e49ee9bd None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:13.264860 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:13.281825 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712006ed-66ac-41e8-9b7f-82a5b09a29af None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:13.319307 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26199cd3-fc92-4540-8982-08d438733266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:13.320702 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26199cd3-fc92-4540-8982-08d438733266 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:13.321128 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26199cd3-fc92-4540-8982-08d438733266 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:13.321539 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26199cd3-fc92-4540-8982-08d438733266 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:13.331564 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:13.335772 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26199cd3-fc92-4540-8982-08d438733266 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:13.337601 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26199cd3-fc92-4540-8982-08d438733266 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:13.353068 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-26199cd3-fc92-4540-8982-08d438733266 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:12:13.353068 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:12:13.353068 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:12:13.353068 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:12:13.353068 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:12:13.353068 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:12:13.353068 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:12:13.353068 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:12:13.353068 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:12:13.353068 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:12:13.353068 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:12:13.353068 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:12:13.353068 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 10:12:13.353068 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 10:12:13.353068 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 10:12:13.353068 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 10:12:13.358240 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:12:13.358240 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:12:13.358240 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:12:13.358240 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:12:13.358240 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:12:13.358240 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:12:13.358240 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:12:13.358240 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:12:13.358240 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:12:13.358240 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:12:13.358240 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:12:13.358240 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:12:13.358240 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:12:13.358240 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:12:13.358240 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:12:13.358240 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:12:13.358240 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 10:12:13.359179 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 10:12:13.359179 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:12:13.359179 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:12:13.359179 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 536/1067] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:12:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:12:13.360426 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26199cd3-fc92-4540-8982-08d438733266 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:13.370218 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eeb086-1152-4d32-8e1d-7862e49ee9bd None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:13.405309 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0122b78-1640-4485-a32c-f3b12886e9e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:13.405962 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0122b78-1640-4485-a32c-f3b12886e9e5 None admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:13.406239 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0122b78-1640-4485-a32c-f3b12886e9e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:13.406506 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0122b78-1640-4485-a32c-f3b12886e9e5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:13.407266 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0122b78-1640-4485-a32c-f3b12886e9e5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:13.408622 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0122b78-1640-4485-a32c-f3b12886e9e5 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:13.437878 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 532/1068] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:12:13 2022] POST /identity/v3/endpoints => generated 327 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 10:12:13.473501 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26199cd3-fc92-4540-8982-08d438733266 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:13.518104 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1add80ad-388b-43c6-a352-f4995281c212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:13.518714 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1add80ad-388b-43c6-a352-f4995281c212 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:13.518988 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1add80ad-388b-43c6-a352-f4995281c212 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:13.519254 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1add80ad-388b-43c6-a352-f4995281c212 None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:13.519898 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1add80ad-388b-43c6-a352-f4995281c212 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:12:13.520197 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1add80ad-388b-43c6-a352-f4995281c212 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:13.521646 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1add80ad-388b-43c6-a352-f4995281c212 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:13.534567 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 537/1069] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Aug 9 10:12:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:12:13.540734 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0122b78-1640-4485-a32c-f3b12886e9e5 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:13.611729 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:13.659736 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0122b78-1640-4485-a32c-f3b12886e9e5 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:13.694801 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162d08ee-4af6-4063-828b-95afdccb2851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:13.695712 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d08ee-4af6-4063-828b-95afdccb2851 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:13.696193 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d08ee-4af6-4063-828b-95afdccb2851 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:13.696642 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d08ee-4af6-4063-828b-95afdccb2851 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:13.704106 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162d08ee-4af6-4063-828b-95afdccb2851 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:13.705739 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162d08ee-4af6-4063-828b-95afdccb2851 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:13.717876 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-162d08ee-4af6-4063-828b-95afdccb2851 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 10:12:13.717876 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:12:13.717876 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:12:13.717876 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:12:13.717876 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:12:13.717876 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:12:13.717876 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:12:13.717876 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:12:13.717876 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:12:13.717876 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:12:13.717876 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:12:13.717876 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:12:13.717876 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 10:12:13.717876 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 10:12:13.717876 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 10:12:13.718807 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 10:12:13.718807 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:12:13.718807 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:12:13.718807 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:12:13.718807 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:12:13.718807 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:12:13.718807 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:12:13.718807 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:12:13.718807 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:12:13.718807 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:12:13.718807 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:12:13.718807 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:12:13.718807 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:12:13.718807 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:12:13.718807 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:12:13.718807 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:12:13.718807 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:12:13.719727 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 10:12:13.719727 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 10:12:13.719727 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 10:12:13.719727 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 10:12:13.719727 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 10:12:13.719727 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 10:12:13.719727 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 10:12:13.719727 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:12:13.719727 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 533/1070] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Aug 9 10:12:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:12:13.726176 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1add80ad-388b-43c6-a352-f4995281c212 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:13.774174 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:13.830219 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1add80ad-388b-43c6-a352-f4995281c212 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:13.865496 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5e3395-0f55-43f5-8940-511dfb569cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:13.866130 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e3395-0f55-43f5-8940-511dfb569cc5 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:13.866412 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e3395-0f55-43f5-8940-511dfb569cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:13.866680 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e3395-0f55-43f5-8940-511dfb569cc5 None admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:13.867369 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5e3395-0f55-43f5-8940-511dfb569cc5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:12:13.867674 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5e3395-0f55-43f5-8940-511dfb569cc5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:13.869428 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5e3395-0f55-43f5-8940-511dfb569cc5 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:13.886129 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 538/1071] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Aug 9 10:12:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:12:13.887321 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162d08ee-4af6-4063-828b-95afdccb2851 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:14.016089 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162d08ee-4af6-4063-828b-95afdccb2851 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:14.041984 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:14.053484 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7525511-ddf4-44f6-b1c9-07d3260dbf98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:14.054165 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7525511-ddf4-44f6-b1c9-07d3260dbf98 None admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:14.054446 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7525511-ddf4-44f6-b1c9-07d3260dbf98 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:14.054714 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7525511-ddf4-44f6-b1c9-07d3260dbf98 None admin] PATH_INFO: `/v3/projects/28891cf6239a43469326a864fb0d216c/users/eb863beaaa9f495c8b64655996c061f2/roles/285df47e9c4f4da4a33cfc06254dc9ea` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:14.057701 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7525511-ddf4-44f6-b1c9-07d3260dbf98 None admin] RBAC: Authorizing `identity:create_grant(project_id=28891cf6239a43469326a864fb0d216c, user_id=eb863beaaa9f495c8b64655996c061f2, role_id=285df47e9c4f4da4a33cfc06254dc9ea)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:14.059175 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7525511-ddf4-44f6-b1c9-07d3260dbf98 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:14.072155 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 534/1072] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Aug 9 10:12:13 2022] PUT /identity/v3/projects/28891cf6239a43469326a864fb0d216c/users/eb863beaaa9f495c8b64655996c061f2/roles/285df47e9c4f4da4a33cfc06254dc9ea => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 10:12:14.910065 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b2b79-0abc-41a8-b5b7-afe538c5b084 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:14.910590 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b2b79-0abc-41a8-b5b7-afe538c5b084 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:14.910590 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b2b79-0abc-41a8-b5b7-afe538c5b084 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:14.911941 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 539/1073] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:12:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:12:14.918138 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1991856-d51a-4089-815d-a32283cde63f None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:14.918548 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1991856-d51a-4089-815d-a32283cde63f None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:14.918716 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1991856-d51a-4089-815d-a32283cde63f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:14.936842 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-e1991856-d51a-4089-815d-a32283cde63f None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:12:14.938047 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-e1991856-d51a-4089-815d-a32283cde63f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:12:15.013911 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 535/1074] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:12:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 10:12:15.035844 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99b2b79-0abc-41a8-b5b7-afe538c5b084 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:15.141732 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99b2b79-0abc-41a8-b5b7-afe538c5b084 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:15.154010 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:15.189215 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88d5e90-a240-48a3-87ff-ae265dd70e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:15.189758 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88d5e90-a240-48a3-87ff-ae265dd70e09 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:15.190068 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88d5e90-a240-48a3-87ff-ae265dd70e09 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:15.190342 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88d5e90-a240-48a3-87ff-ae265dd70e09 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:15.201123 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88d5e90-a240-48a3-87ff-ae265dd70e09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 10:12:15.205853 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-d88d5e90-a240-48a3-87ff-ae265dd70e09 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 10:12:15.205853 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:12:15.205853 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:12:15.205853 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:12:15.205853 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:12:15.205853 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:12:15.205853 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:12:15.205853 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:12:15.205853 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:12:15.205853 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:12:15.205853 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:12:15.205853 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:12:15.205853 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 10:12:15.205853 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 10:12:15.205853 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 10:12:15.205853 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 10:12:15.206795 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 10:12:15.206795 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 10:12:15.206795 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 10:12:15.206795 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 10:12:15.206795 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:12:15.206795 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:12:15.206795 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:12:15.206795 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:12:15.206795 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:12:15.206795 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:12:15.206795 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:12:15.206795 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:12:15.206795 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:12:15.206795 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:12:15.206795 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:12:15.206795 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:12:15.212734 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:12:15.212734 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:12:15.212734 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:12:15.212734 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:12:15.212734 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 10:12:15.212734 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 10:12:15.212734 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 10:12:15.212734 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 10:12:15.212734 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 10:12:15.212734 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 10:12:15.212734 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 10:12:15.212734 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:12:15.212734 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 540/1075] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Aug 9 10:12:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 10:12:15.214936 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1991856-d51a-4089-815d-a32283cde63f None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:15.314027 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1991856-d51a-4089-815d-a32283cde63f None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:15.328628 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:15.350212 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2d74c0-74f3-4037-8740-3ce9bcaaffcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:15.350819 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d74c0-74f3-4037-8740-3ce9bcaaffcf None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:15.351099 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d74c0-74f3-4037-8740-3ce9bcaaffcf None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:15.351371 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d74c0-74f3-4037-8740-3ce9bcaaffcf None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:15.352030 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2d74c0-74f3-4037-8740-3ce9bcaaffcf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:12:15.352335 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2d74c0-74f3-4037-8740-3ce9bcaaffcf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:15.353918 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2d74c0-74f3-4037-8740-3ce9bcaaffcf None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:15.366678 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 536/1076] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Aug 9 10:12:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:12:15.367860 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88d5e90-a240-48a3-87ff-ae265dd70e09 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:15.472029 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b96c9c-a669-4fa9-be39-b0a6d438eca3 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:15.472227 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88d5e90-a240-48a3-87ff-ae265dd70e09 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:15.472345 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b96c9c-a669-4fa9-be39-b0a6d438eca3 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:15.472345 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b96c9c-a669-4fa9-be39-b0a6d438eca3 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:15.473265 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 537/1077] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:12:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 10:12:15.478152 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe6c20-17ee-47c2-ae5b-3300fded340f None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:15.478457 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe6c20-17ee-47c2-ae5b-3300fded340f None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:15.478741 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe6c20-17ee-47c2-ae5b-3300fded340f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:15.498166 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-7ebe6c20-17ee-47c2-ae5b-3300fded340f None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:12:15.499338 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-7ebe6c20-17ee-47c2-ae5b-3300fded340f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:12:15.510460 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b618451-64aa-487d-972d-3cfd1dba83fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:15.511376 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b618451-64aa-487d-972d-3cfd1dba83fd None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:15.511658 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b618451-64aa-487d-972d-3cfd1dba83fd None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:15.511925 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b618451-64aa-487d-972d-3cfd1dba83fd None admin] PATH_INFO: `/v3/users/189f8bcc9a584409bd499d9327090559` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:15.513067 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b618451-64aa-487d-972d-3cfd1dba83fd None admin] RBAC: Authorizing `identity:get_user(user_id=189f8bcc9a584409bd499d9327090559)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:15.514554 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b618451-64aa-487d-972d-3cfd1dba83fd None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:15.516258 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 541/1078] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Aug 9 10:12:15 2022] GET /identity/v3/users/189f8bcc9a584409bd499d9327090559 => generated 285 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:12:15.521689 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b618451-64aa-487d-972d-3cfd1dba83fd None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:15.558395 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:15.572736 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 538/1079] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:12:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 10:12:15.594223 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebe6c20-17ee-47c2-ae5b-3300fded340f None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:15.631255 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b618451-64aa-487d-972d-3cfd1dba83fd None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:15.668412 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadc2984-a02b-4bab-8a02-c876232942a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:15.669043 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadc2984-a02b-4bab-8a02-c876232942a3 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:15.669319 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadc2984-a02b-4bab-8a02-c876232942a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:15.669586 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadc2984-a02b-4bab-8a02-c876232942a3 None admin] PATH_INFO: `/v3/projects/c214ab70f4124b2a9e647d2b7cc26a1b` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:15.670728 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadc2984-a02b-4bab-8a02-c876232942a3 None admin] RBAC: Authorizing `identity:get_project(project_id=c214ab70f4124b2a9e647d2b7cc26a1b)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:15.672277 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadc2984-a02b-4bab-8a02-c876232942a3 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:15.679045 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 542/1080] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Aug 9 10:12:15 2022] GET /identity/v3/projects/c214ab70f4124b2a9e647d2b7cc26a1b => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:12:15.679706 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadc2984-a02b-4bab-8a02-c876232942a3 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:15.697213 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebe6c20-17ee-47c2-ae5b-3300fded340f None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:15.705750 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:15.735622 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3612b001-115f-4f91-b342-7c2a697b5c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:15.736262 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3612b001-115f-4f91-b342-7c2a697b5c73 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:15.736543 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3612b001-115f-4f91-b342-7c2a697b5c73 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:15.736819 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3612b001-115f-4f91-b342-7c2a697b5c73 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:15.785400 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadc2984-a02b-4bab-8a02-c876232942a3 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:15.786936 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:15.814039 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3612b001-115f-4f91-b342-7c2a697b5c73 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:15.815485 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3612b001-115f-4f91-b342-7c2a697b5c73 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:15.821380 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68e48dd-9eb5-4442-a7f2-18840b84c69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:15.822068 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e48dd-9eb5-4442-a7f2-18840b84c69a None admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:15.822878 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e48dd-9eb5-4442-a7f2-18840b84c69a None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:15.823152 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e48dd-9eb5-4442-a7f2-18840b84c69a None admin] PATH_INFO: `/v3/projects/c214ab70f4124b2a9e647d2b7cc26a1b/users/189f8bcc9a584409bd499d9327090559/roles/89ca30cbbb634be8a96e9921aa56626b` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:15.825057 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68e48dd-9eb5-4442-a7f2-18840b84c69a None admin] RBAC: Authorizing `identity:create_grant(project_id=c214ab70f4124b2a9e647d2b7cc26a1b, user_id=189f8bcc9a584409bd499d9327090559, role_id=89ca30cbbb634be8a96e9921aa56626b)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:15.826511 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68e48dd-9eb5-4442-a7f2-18840b84c69a None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:15.841425 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 543/1081] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Aug 9 10:12:15 2022] PUT /identity/v3/projects/c214ab70f4124b2a9e647d2b7cc26a1b/users/189f8bcc9a584409bd499d9327090559/roles/89ca30cbbb634be8a96e9921aa56626b => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 10:12:15.926753 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 539/1082] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Aug 9 10:12:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 09 10:12:15.933582 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68e48dd-9eb5-4442-a7f2-18840b84c69a None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:16.044052 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68e48dd-9eb5-4442-a7f2-18840b84c69a None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:16.078352 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f51ad5b-1111-4097-bbf3-931850318e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:16.078987 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f51ad5b-1111-4097-bbf3-931850318e22 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:16.079266 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f51ad5b-1111-4097-bbf3-931850318e22 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:16.079541 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f51ad5b-1111-4097-bbf3-931850318e22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:16.090642 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f51ad5b-1111-4097-bbf3-931850318e22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:16.092091 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f51ad5b-1111-4097-bbf3-931850318e22 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:16.106519 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabeb657-aae8-4c99-9d9f-ac7203f53a87 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:16.106813 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabeb657-aae8-4c99-9d9f-ac7203f53a87 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:16.107083 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabeb657-aae8-4c99-9d9f-ac7203f53a87 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:16.107391 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-3f51ad5b-1111-4097-bbf3-931850318e22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:12:16.107391 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:12:16.107391 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:12:16.107391 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:12:16.107391 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:12:16.107391 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:12:16.107391 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:12:16.107391 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:12:16.107391 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:12:16.107391 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:12:16.107391 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:12:16.107391 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:12:16.107391 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 10:12:16.107391 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 10:12:16.107391 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 10:12:16.107391 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 10:12:16.108308 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:12:16.108308 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:12:16.108308 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:12:16.108308 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:12:16.108308 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:12:16.108308 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:12:16.108308 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:12:16.108308 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:12:16.108308 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:12:16.108308 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:12:16.108308 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:12:16.108308 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:12:16.108308 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:12:16.108308 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:12:16.108308 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:12:16.108308 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:12:16.108308 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 10:12:16.113236 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 10:12:16.113236 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:12:16.113236 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:12:16.113435 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 540/1084] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:12:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 10:12:16.113506 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 544/1084] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:12:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:12:16.113574 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf07457-3d3e-4786-8067-d0ebae191a46 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:16.113717 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf07457-3d3e-4786-8067-d0ebae191a46 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:16.114030 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf07457-3d3e-4786-8067-d0ebae191a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:16.116222 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f51ad5b-1111-4097-bbf3-931850318e22 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:16.126932 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:16.132973 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-1cf07457-3d3e-4786-8067-d0ebae191a46 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:12:16.133857 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:16.134421 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-1cf07457-3d3e-4786-8067-d0ebae191a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:12:16.208338 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 541/1085] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:12:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 10:12:16.226579 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f51ad5b-1111-4097-bbf3-931850318e22 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:16.232210 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf07457-3d3e-4786-8067-d0ebae191a46 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:16.268910 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa131c05-af51-4ca9-ae28-e9eda66ff79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:16.269893 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa131c05-af51-4ca9-ae28-e9eda66ff79b None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:16.270402 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa131c05-af51-4ca9-ae28-e9eda66ff79b None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:16.270894 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa131c05-af51-4ca9-ae28-e9eda66ff79b None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:16.271779 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa131c05-af51-4ca9-ae28-e9eda66ff79b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:12:16.272737 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa131c05-af51-4ca9-ae28-e9eda66ff79b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:16.274699 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa131c05-af51-4ca9-ae28-e9eda66ff79b None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:16.288569 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 545/1086] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Aug 9 10:12:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:12:16.341127 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf07457-3d3e-4786-8067-d0ebae191a46 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:16.381519 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4a674c-864e-4f47-803d-e4b0c97559e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:16.382483 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4a674c-864e-4f47-803d-e4b0c97559e9 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:16.382910 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4a674c-864e-4f47-803d-e4b0c97559e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:16.383332 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4a674c-864e-4f47-803d-e4b0c97559e9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:16.386873 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:16.396911 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4a674c-864e-4f47-803d-e4b0c97559e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 10:12:16.402244 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-ac4a674c-864e-4f47-803d-e4b0c97559e9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 09 10:12:16.402244 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:12:16.402244 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:12:16.402244 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:12:16.402244 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:12:16.402244 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:12:16.402244 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:12:16.402244 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:12:16.402244 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:12:16.402244 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:12:16.402244 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:12:16.402244 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:12:16.402244 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 10:12:16.402244 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 10:12:16.402244 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 10:12:16.402244 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 10:12:16.403275 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 10:12:16.403275 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 10:12:16.403275 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 10:12:16.403275 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 10:12:16.403275 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:12:16.403275 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:12:16.403275 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:12:16.403275 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:12:16.403275 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:12:16.403275 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:12:16.403275 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:12:16.403275 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:12:16.403275 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:12:16.403275 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:12:16.403275 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:12:16.403275 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:12:16.404120 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:12:16.404120 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:12:16.404120 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:12:16.404120 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:12:16.404120 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 10:12:16.404120 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 10:12:16.404120 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 10:12:16.404120 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 10:12:16.404120 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 10:12:16.404120 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 10:12:16.404120 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 09 10:12:16.404120 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:12:16.406180 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 542/1087] 10.222.0.36 () {56 vars in 1120 bytes} [Tue Aug 9 10:12:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 10:12:16.409628 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa131c05-af51-4ca9-ae28-e9eda66ff79b None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:16.491054 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:16.519063 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa131c05-af51-4ca9-ae28-e9eda66ff79b None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:16.557445 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dac0e1a-dff7-454e-a9d4-2d3f88a04fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:16.558238 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac0e1a-dff7-454e-a9d4-2d3f88a04fe4 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:16.558615 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac0e1a-dff7-454e-a9d4-2d3f88a04fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:16.559002 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac0e1a-dff7-454e-a9d4-2d3f88a04fe4 None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:16.559766 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dac0e1a-dff7-454e-a9d4-2d3f88a04fe4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:12:16.560191 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dac0e1a-dff7-454e-a9d4-2d3f88a04fe4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:16.561661 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dac0e1a-dff7-454e-a9d4-2d3f88a04fe4 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:16.570435 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 546/1088] 10.222.0.36 () {56 vars in 1115 bytes} [Tue Aug 9 10:12:16 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:12:16.576357 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4a674c-864e-4f47-803d-e4b0c97559e9 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:16.678494 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4a674c-864e-4f47-803d-e4b0c97559e9 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:16.712002 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc3f7a7-ae3b-4f6b-99e2-ae65839870fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:16.712611 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc3f7a7-ae3b-4f6b-99e2-ae65839870fb None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:16.713442 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc3f7a7-ae3b-4f6b-99e2-ae65839870fb None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:16.713713 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc3f7a7-ae3b-4f6b-99e2-ae65839870fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:16.723643 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc3f7a7-ae3b-4f6b-99e2-ae65839870fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:16.725078 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc3f7a7-ae3b-4f6b-99e2-ae65839870fb None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:16.739907 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-8cc3f7a7-ae3b-4f6b-99e2-ae65839870fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:12:16.739907 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:12:16.739907 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:12:16.739907 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:12:16.739907 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:12:16.739907 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:12:16.739907 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:12:16.739907 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:12:16.739907 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:12:16.739907 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:12:16.739907 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:12:16.739907 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:12:16.739907 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 10:12:16.739907 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 10:12:16.739907 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 10:12:16.739907 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 10:12:16.741001 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:12:16.741001 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:12:16.741001 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:12:16.741001 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:12:16.741001 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:12:16.741001 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:12:16.741001 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:12:16.741001 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:12:16.741001 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:12:16.741001 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:12:16.741001 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:12:16.741001 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:12:16.741001 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:12:16.741001 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:12:16.741001 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:12:16.741001 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:12:16.741001 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 10:12:16.742102 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 10:12:16.742102 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:12:16.742102 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:12:16.745727 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 543/1089] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:12:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 10:12:16.746751 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dac0e1a-dff7-454e-a9d4-2d3f88a04fe4 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:16.844487 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dac0e1a-dff7-454e-a9d4-2d3f88a04fe4 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:16.877677 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3d4509-54ee-4d2c-86d7-9e846802a515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:16.878300 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3d4509-54ee-4d2c-86d7-9e846802a515 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:16.878583 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3d4509-54ee-4d2c-86d7-9e846802a515 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:16.878858 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3d4509-54ee-4d2c-86d7-9e846802a515 None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:16.879499 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3d4509-54ee-4d2c-86d7-9e846802a515 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:12:16.879800 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3d4509-54ee-4d2c-86d7-9e846802a515 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:16.881159 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3d4509-54ee-4d2c-86d7-9e846802a515 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:16.883494 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:16.893949 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 547/1090] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Aug 9 10:12:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:12:16.899478 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc3f7a7-ae3b-4f6b-99e2-ae65839870fb None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:16.949396 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:17.005021 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc3f7a7-ae3b-4f6b-99e2-ae65839870fb None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:17.037455 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378995b9-d1e7-4ab4-81a3-8d3a624b5d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:17.038094 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378995b9-d1e7-4ab4-81a3-8d3a624b5d3d None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:17.038369 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378995b9-d1e7-4ab4-81a3-8d3a624b5d3d None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:17.038635 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378995b9-d1e7-4ab4-81a3-8d3a624b5d3d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:17.046594 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378995b9-d1e7-4ab4-81a3-8d3a624b5d3d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:17.048005 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378995b9-d1e7-4ab4-81a3-8d3a624b5d3d None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:17.058904 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-378995b9-d1e7-4ab4-81a3-8d3a624b5d3d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 09 10:12:17.058904 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:12:17.058904 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:12:17.058904 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:12:17.058904 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:12:17.058904 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:12:17.058904 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:12:17.058904 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:12:17.058904 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:12:17.058904 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:12:17.058904 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:12:17.058904 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:12:17.058904 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 10:12:17.058904 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 10:12:17.058904 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 10:12:17.058904 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 10:12:17.060028 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:12:17.060028 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:12:17.060028 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 10:12:17.060028 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 10:12:17.060028 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 10:12:17.060028 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 10:12:17.060028 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:12:17.060028 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:12:17.060028 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:12:17.060028 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:12:17.060028 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:12:17.060028 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:12:17.060028 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:12:17.060028 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:12:17.060028 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:12:17.060028 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:12:17.060028 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:12:17.060028 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:12:17.061450 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:12:17.061450 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:12:17.061450 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 10:12:17.061450 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 10:12:17.061450 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 10:12:17.061450 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 10:12:17.061450 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 10:12:17.061450 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 10:12:17.061450 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 09 10:12:17.061450 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:12:17.061450 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 544/1091] 10.222.0.36 () {56 vars in 1093 bytes} [Tue Aug 9 10:12:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 10:12:17.065650 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3d4509-54ee-4d2c-86d7-9e846802a515 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:17.161630 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3d4509-54ee-4d2c-86d7-9e846802a515 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:17.194425 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0628fed-a999-4bd7-b110-f6948d01c66c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:17.195015 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0628fed-a999-4bd7-b110-f6948d01c66c None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:17.195343 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0628fed-a999-4bd7-b110-f6948d01c66c None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:17.195554 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0628fed-a999-4bd7-b110-f6948d01c66c None admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:17.196270 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0628fed-a999-4bd7-b110-f6948d01c66c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:12:17.196571 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0628fed-a999-4bd7-b110-f6948d01c66c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:17.198624 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0628fed-a999-4bd7-b110-f6948d01c66c None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:17.215629 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 548/1092] 10.222.0.36 () {56 vars in 1133 bytes} [Tue Aug 9 10:12:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:12:17.221329 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378995b9-d1e7-4ab4-81a3-8d3a624b5d3d None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:17.317003 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378995b9-d1e7-4ab4-81a3-8d3a624b5d3d None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:17.326160 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:17.350001 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd9b758-ddf1-46c2-be95-d6af4faa982c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:17.350598 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd9b758-ddf1-46c2-be95-d6af4faa982c None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:17.350874 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd9b758-ddf1-46c2-be95-d6af4faa982c None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:17.351143 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd9b758-ddf1-46c2-be95-d6af4faa982c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:17.416642 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd9b758-ddf1-46c2-be95-d6af4faa982c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:17.418288 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd9b758-ddf1-46c2-be95-d6af4faa982c None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:17.514535 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 545/1093] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Aug 9 10:12:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 09 10:12:17.520007 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0628fed-a999-4bd7-b110-f6948d01c66c None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:17.574500 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:17.619520 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0628fed-a999-4bd7-b110-f6948d01c66c None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:17.652128 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e722cbaa-2198-4909-9417-4263a1831601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:17.652744 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e722cbaa-2198-4909-9417-4263a1831601 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:17.653023 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e722cbaa-2198-4909-9417-4263a1831601 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:17.653292 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e722cbaa-2198-4909-9417-4263a1831601 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:17.663135 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e722cbaa-2198-4909-9417-4263a1831601 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:17.664565 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e722cbaa-2198-4909-9417-4263a1831601 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:17.678641 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-e722cbaa-2198-4909-9417-4263a1831601 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:12:17.678641 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:12:17.678641 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:12:17.678641 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:12:17.678641 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:12:17.678641 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:12:17.678641 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:12:17.678641 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:12:17.678641 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:12:17.678641 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:12:17.678641 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:12:17.678641 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:12:17.678641 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 10:12:17.678641 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 10:12:17.678641 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 10:12:17.678641 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 10:12:17.679826 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:12:17.679826 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:12:17.679826 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:12:17.679826 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:12:17.679826 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:12:17.679826 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:12:17.679826 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:12:17.679826 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:12:17.679826 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:12:17.679826 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:12:17.679826 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:12:17.679826 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:12:17.679826 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:12:17.679826 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:12:17.679826 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:12:17.679826 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:12:17.679826 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 10:12:17.680985 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 10:12:17.680985 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:12:17.680985 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:12:17.680985 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 549/1094] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:12:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:12:17.685899 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd9b758-ddf1-46c2-be95-d6af4faa982c None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:17.695626 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:17.783512 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd9b758-ddf1-46c2-be95-d6af4faa982c None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:17.817498 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41455480-75da-409a-b657-0267c4b4cef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:17.818124 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41455480-75da-409a-b657-0267c4b4cef7 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:17.818404 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41455480-75da-409a-b657-0267c4b4cef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:17.818676 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41455480-75da-409a-b657-0267c4b4cef7 None admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:17.819305 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41455480-75da-409a-b657-0267c4b4cef7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:12:17.819607 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41455480-75da-409a-b657-0267c4b4cef7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:17.820978 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41455480-75da-409a-b657-0267c4b4cef7 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:17.832522 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 546/1095] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Aug 9 10:12:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:12:17.838222 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e722cbaa-2198-4909-9417-4263a1831601 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:17.892975 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f628225b-37c9-454f-8c16-90504ce83500 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:17.893269 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f628225b-37c9-454f-8c16-90504ce83500 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:17.893546 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f628225b-37c9-454f-8c16-90504ce83500 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:17.894915 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 547/1096] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:12:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 10:12:17.899751 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809aa0b1-7e20-4bf7-81e7-98e136a30147 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:17.900032 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809aa0b1-7e20-4bf7-81e7-98e136a30147 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:17.900390 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809aa0b1-7e20-4bf7-81e7-98e136a30147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:17.919127 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-809aa0b1-7e20-4bf7-81e7-98e136a30147 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:12:17.920320 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-809aa0b1-7e20-4bf7-81e7-98e136a30147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:12:17.938267 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e722cbaa-2198-4909-9417-4263a1831601 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:17.945632 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:17.975293 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccab9a2-cf6a-45bb-a4cb-d763af967f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:17.975915 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccab9a2-cf6a-45bb-a4cb-d763af967f95 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:17.976191 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccab9a2-cf6a-45bb-a4cb-d763af967f95 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:17.976459 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccab9a2-cf6a-45bb-a4cb-d763af967f95 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:17.983404 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccab9a2-cf6a-45bb-a4cb-d763af967f95 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:17.984567 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:17.985011 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccab9a2-cf6a-45bb-a4cb-d763af967f95 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:17.990648 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 548/1097] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:12:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 10:12:17.996740 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-3ccab9a2-cf6a-45bb-a4cb-d763af967f95 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 10:12:17.996740 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:12:17.996740 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:12:17.996740 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:12:17.996740 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:12:17.996740 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:12:17.996740 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:12:17.996740 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:12:17.996740 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:12:17.996740 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:12:17.996740 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:12:17.996740 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:12:17.996740 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 10:12:17.996740 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 10:12:17.996740 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 10:12:17.997818 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 10:12:17.997818 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:12:17.997818 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:12:17.997818 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:12:17.997818 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:12:17.997818 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:12:17.997818 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:12:17.997818 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:12:17.997818 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:12:17.997818 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:12:17.997818 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:12:17.997818 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:12:17.997818 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:12:17.997818 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:12:17.997818 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:12:17.997818 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:12:17.997818 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:12:17.998937 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 10:12:17.998937 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 10:12:17.998937 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 10:12:17.998937 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 10:12:17.998937 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 10:12:17.998937 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 10:12:17.998937 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 10:12:17.998937 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:12:18.001991 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 550/1098] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Aug 9 10:12:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:12:18.003354 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809aa0b1-7e20-4bf7-81e7-98e136a30147 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:18.013564 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccab9a2-cf6a-45bb-a4cb-d763af967f95 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:18.100786 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809aa0b1-7e20-4bf7-81e7-98e136a30147 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:18.110650 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccab9a2-cf6a-45bb-a4cb-d763af967f95 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:18.135748 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02a2429-ec42-4d38-91b4-2ddc59ede17d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:18.136342 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a2429-ec42-4d38-91b4-2ddc59ede17d None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:18.136616 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a2429-ec42-4d38-91b4-2ddc59ede17d None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:18.136886 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a2429-ec42-4d38-91b4-2ddc59ede17d None admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:18.137563 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02a2429-ec42-4d38-91b4-2ddc59ede17d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:12:18.137887 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02a2429-ec42-4d38-91b4-2ddc59ede17d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:18.139292 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02a2429-ec42-4d38-91b4-2ddc59ede17d None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:18.144831 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcedd08e-4569-4e21-8e6a-f230ff9b0e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:18.145448 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcedd08e-4569-4e21-8e6a-f230ff9b0e00 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:18.145728 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcedd08e-4569-4e21-8e6a-f230ff9b0e00 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:18.146029 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcedd08e-4569-4e21-8e6a-f230ff9b0e00 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:18.150764 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 549/1099] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Aug 9 10:12:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:12:18.156739 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02a2429-ec42-4d38-91b4-2ddc59ede17d None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:18.157678 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcedd08e-4569-4e21-8e6a-f230ff9b0e00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 10:12:18.162352 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-dcedd08e-4569-4e21-8e6a-f230ff9b0e00 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 10:12:18.162352 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:12:18.162352 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:12:18.162352 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:12:18.162352 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:12:18.162352 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:12:18.162352 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:12:18.162352 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:12:18.162352 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:12:18.162352 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:12:18.162352 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:12:18.162352 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:12:18.162352 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 10:12:18.162352 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 10:12:18.162352 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 10:12:18.162352 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 10:12:18.163264 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 10:12:18.163264 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 10:12:18.163264 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 10:12:18.163264 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 10:12:18.163264 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:12:18.163264 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:12:18.163264 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:12:18.163264 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:12:18.163264 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:12:18.163264 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:12:18.163264 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:12:18.163264 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:12:18.163264 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:12:18.163264 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:12:18.163264 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:12:18.163264 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:12:18.164533 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:12:18.164533 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:12:18.164533 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:12:18.164533 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:12:18.164533 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 10:12:18.164533 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 10:12:18.164533 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 10:12:18.164533 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 10:12:18.164533 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 10:12:18.164533 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 10:12:18.164533 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 10:12:18.164533 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:12:18.164533 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 551/1100] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Aug 9 10:12:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 10:12:18.170220 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcedd08e-4569-4e21-8e6a-f230ff9b0e00 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:18.196586 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:18.215281 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:18.257219 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02a2429-ec42-4d38-91b4-2ddc59ede17d None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:18.268686 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcedd08e-4569-4e21-8e6a-f230ff9b0e00 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:18.290129 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee4f555-ae59-46ac-a2d4-9250d716d6a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:18.291489 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4f555-ae59-46ac-a2d4-9250d716d6a2 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:18.291778 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4f555-ae59-46ac-a2d4-9250d716d6a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:18.292051 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4f555-ae59-46ac-a2d4-9250d716d6a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:18.292768 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee4f555-ae59-46ac-a2d4-9250d716d6a2 None admin] RBAC: Adding query filter params (role.id=285df47e9c4f4da4a33cfc06254dc9ea, scope.project.id=28891cf6239a43469326a864fb0d216c, user.id=eb863beaaa9f495c8b64655996c061f2) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:12:18.293078 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee4f555-ae59-46ac-a2d4-9250d716d6a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:18.294529 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee4f555-ae59-46ac-a2d4-9250d716d6a2 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:18.300087 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 550/1101] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Aug 9 10:12:18 2022] GET /identity/v3/role_assignments?user.id=eb863beaaa9f495c8b64655996c061f2&scope.project.id=28891cf6239a43469326a864fb0d216c&role.id=285df47e9c4f4da4a33cfc06254dc9ea => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:12:18.303417 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e957662e-17e0-47db-94d5-99cded651552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:18.304020 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957662e-17e0-47db-94d5-99cded651552 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:18.304294 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957662e-17e0-47db-94d5-99cded651552 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:18.304560 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957662e-17e0-47db-94d5-99cded651552 None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:18.305226 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e957662e-17e0-47db-94d5-99cded651552 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:12:18.305525 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e957662e-17e0-47db-94d5-99cded651552 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:18.307775 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e957662e-17e0-47db-94d5-99cded651552 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:18.317642 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 552/1102] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Aug 9 10:12:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:12:18.325114 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee4f555-ae59-46ac-a2d4-9250d716d6a2 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:18.433462 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee4f555-ae59-46ac-a2d4-9250d716d6a2 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:18.458063 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:18.471442 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20f4655-c8c5-4801-b725-bf32935d36e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:18.472073 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f4655-c8c5-4801-b725-bf32935d36e4 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:18.472355 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f4655-c8c5-4801-b725-bf32935d36e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:18.472629 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f4655-c8c5-4801-b725-bf32935d36e4 None admin] PATH_INFO: `/v3/users/189f8bcc9a584409bd499d9327090559` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:18.473797 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20f4655-c8c5-4801-b725-bf32935d36e4 None admin] RBAC: Authorizing `identity:get_user(user_id=189f8bcc9a584409bd499d9327090559)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:18.475264 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20f4655-c8c5-4801-b725-bf32935d36e4 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:18.476843 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 551/1103] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Aug 9 10:12:18 2022] GET /identity/v3/users/189f8bcc9a584409bd499d9327090559 => generated 285 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:12:18.483526 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e957662e-17e0-47db-94d5-99cded651552 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:18.571966 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:18.587686 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e957662e-17e0-47db-94d5-99cded651552 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:18.624216 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2320328b-d66e-42f0-9aab-aae842cfc5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:18.624813 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2320328b-d66e-42f0-9aab-aae842cfc5e3 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:18.625094 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2320328b-d66e-42f0-9aab-aae842cfc5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:18.625360 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2320328b-d66e-42f0-9aab-aae842cfc5e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:18.693228 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2320328b-d66e-42f0-9aab-aae842cfc5e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:18.694624 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2320328b-d66e-42f0-9aab-aae842cfc5e3 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:18.784397 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:18.797634 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 553/1104] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Aug 9 10:12:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 10:12:18.803673 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20f4655-c8c5-4801-b725-bf32935d36e4 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:18.905894 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20f4655-c8c5-4801-b725-bf32935d36e4 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:18.943378 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d57ba96-dcc4-4b22-8d8d-3670ddff7c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:18.943951 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d57ba96-dcc4-4b22-8d8d-3670ddff7c8c None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:18.944231 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d57ba96-dcc4-4b22-8d8d-3670ddff7c8c None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:18.944504 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d57ba96-dcc4-4b22-8d8d-3670ddff7c8c None admin] PATH_INFO: `/v3/projects/c214ab70f4124b2a9e647d2b7cc26a1b` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:18.945713 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d57ba96-dcc4-4b22-8d8d-3670ddff7c8c None admin] RBAC: Authorizing `identity:get_project(project_id=c214ab70f4124b2a9e647d2b7cc26a1b)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:18.947263 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d57ba96-dcc4-4b22-8d8d-3670ddff7c8c None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:18.949764 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 552/1105] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Aug 9 10:12:18 2022] GET /identity/v3/projects/c214ab70f4124b2a9e647d2b7cc26a1b => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:12:18.955751 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2320328b-d66e-42f0-9aab-aae842cfc5e3 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:19.062153 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2320328b-d66e-42f0-9aab-aae842cfc5e3 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:19.096132 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb25bd0a-34f9-46b8-9c13-93a2c62273f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:19.096728 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb25bd0a-34f9-46b8-9c13-93a2c62273f6 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:19.097006 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb25bd0a-34f9-46b8-9c13-93a2c62273f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:19.097279 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb25bd0a-34f9-46b8-9c13-93a2c62273f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:19.098062 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb25bd0a-34f9-46b8-9c13-93a2c62273f6 None admin] RBAC: Adding query filter params (role.id=89ca30cbbb634be8a96e9921aa56626b, scope.project.id=c214ab70f4124b2a9e647d2b7cc26a1b, user.id=189f8bcc9a584409bd499d9327090559) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:12:19.098374 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb25bd0a-34f9-46b8-9c13-93a2c62273f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:19.099795 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb25bd0a-34f9-46b8-9c13-93a2c62273f6 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:19.106162 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 554/1106] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Aug 9 10:12:18 2022] GET /identity/v3/role_assignments?user.id=189f8bcc9a584409bd499d9327090559&scope.project.id=c214ab70f4124b2a9e647d2b7cc26a1b&role.id=89ca30cbbb634be8a96e9921aa56626b => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:12:21.130401 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c68314-2787-4356-8f06-d3f6977c80aa None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:21.130919 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c68314-2787-4356-8f06-d3f6977c80aa None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:21.130919 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c68314-2787-4356-8f06-d3f6977c80aa None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:21.132250 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 553/1107] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:12:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:12:21.138181 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8891782b-ce11-4089-83b6-68fa6cbe9bf5 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:21.138578 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8891782b-ce11-4089-83b6-68fa6cbe9bf5 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:21.138713 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8891782b-ce11-4089-83b6-68fa6cbe9bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:21.156723 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-8891782b-ce11-4089-83b6-68fa6cbe9bf5 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:12:21.157911 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-8891782b-ce11-4089-83b6-68fa6cbe9bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:12:21.202774 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:21.222413 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 555/1108] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:12:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 10:12:21.248602 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c68314-2787-4356-8f06-d3f6977c80aa None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:21.305751 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:21.347748 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c68314-2787-4356-8f06-d3f6977c80aa None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:21.380466 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82431560-c458-42f0-97dd-b4f831fa81a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:21.381074 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82431560-c458-42f0-97dd-b4f831fa81a8 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:21.381350 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82431560-c458-42f0-97dd-b4f831fa81a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:21.381617 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82431560-c458-42f0-97dd-b4f831fa81a8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:21.382719 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82431560-c458-42f0-97dd-b4f831fa81a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:21.384114 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82431560-c458-42f0-97dd-b4f831fa81a8 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:21.385720 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 554/1109] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:12:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:12:21.391405 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8891782b-ce11-4089-83b6-68fa6cbe9bf5 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:21.485692 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8891782b-ce11-4089-83b6-68fa6cbe9bf5 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:21.516735 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c94142-eff5-499e-b5ed-0544544938ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:21.517312 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c94142-eff5-499e-b5ed-0544544938ce None admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:21.517590 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c94142-eff5-499e-b5ed-0544544938ce None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:21.517874 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c94142-eff5-499e-b5ed-0544544938ce None admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:21.518502 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c94142-eff5-499e-b5ed-0544544938ce None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:21.519908 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c94142-eff5-499e-b5ed-0544544938ce None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:21.541096 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 556/1110] 10.222.0.36 () {60 vars in 1132 bytes} [Tue Aug 9 10:12:21 2022] POST /identity/v3/users => generated 286 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:12:23.565959 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d62624e-6f7b-4d9b-8582-fd98e822696f None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:23.566494 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d62624e-6f7b-4d9b-8582-fd98e822696f None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:23.566494 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d62624e-6f7b-4d9b-8582-fd98e822696f None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:23.567797 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 555/1111] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:12:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:12:23.573004 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514734aa-34ef-4aca-a798-cdaad7b483c6 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:23.573404 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514734aa-34ef-4aca-a798-cdaad7b483c6 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:23.573533 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514734aa-34ef-4aca-a798-cdaad7b483c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:23.591677 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-514734aa-34ef-4aca-a798-cdaad7b483c6 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:12:23.592837 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-514734aa-34ef-4aca-a798-cdaad7b483c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:12:23.621068 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:23.659156 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 557/1112] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:12:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 10:12:23.683087 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d62624e-6f7b-4d9b-8582-fd98e822696f None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:23.781635 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d62624e-6f7b-4d9b-8582-fd98e822696f None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:23.807272 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:23.815711 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a28582-b762-4557-8b5c-80524c3bfd24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:23.816368 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a28582-b762-4557-8b5c-80524c3bfd24 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:23.816590 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a28582-b762-4557-8b5c-80524c3bfd24 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:23.816858 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a28582-b762-4557-8b5c-80524c3bfd24 None admin] PATH_INFO: `/v3/roles/af19908af5d6489696eb27791925a5aa` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:23.818232 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a28582-b762-4557-8b5c-80524c3bfd24 None admin] RBAC: Authorizing `identity:get_role(role_id=af19908af5d6489696eb27791925a5aa)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:23.819577 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a28582-b762-4557-8b5c-80524c3bfd24 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:23.820855 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 556/1113] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Aug 9 10:12:23 2022] GET /identity/v3/roles/af19908af5d6489696eb27791925a5aa => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:12:23.827145 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514734aa-34ef-4aca-a798-cdaad7b483c6 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:23.920077 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514734aa-34ef-4aca-a798-cdaad7b483c6 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:23.951908 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b821f6ff-c34c-4afb-acd5-95c7868df61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:23.952521 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b821f6ff-c34c-4afb-acd5-95c7868df61e None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:23.952794 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b821f6ff-c34c-4afb-acd5-95c7868df61e None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:23.953061 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b821f6ff-c34c-4afb-acd5-95c7868df61e None admin] PATH_INFO: `/v3/users/4989fb9f00a54d9fa63093dba2252d1c` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:23.966386 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b821f6ff-c34c-4afb-acd5-95c7868df61e None admin] RBAC: Authorizing `identity:get_user(user_id=4989fb9f00a54d9fa63093dba2252d1c)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:23.967820 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b821f6ff-c34c-4afb-acd5-95c7868df61e None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:23.969405 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 558/1114] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Aug 9 10:12:23 2022] GET /identity/v3/users/4989fb9f00a54d9fa63093dba2252d1c => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:12:23.975040 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a28582-b762-4557-8b5c-80524c3bfd24 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:24.071084 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a28582-b762-4557-8b5c-80524c3bfd24 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:24.102131 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6acc89-b46a-43ad-847d-a4da42a1c7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:24.102711 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6acc89-b46a-43ad-847d-a4da42a1c7df None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:24.102983 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6acc89-b46a-43ad-847d-a4da42a1c7df None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:24.103872 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6acc89-b46a-43ad-847d-a4da42a1c7df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:24.160382 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:24.167879 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6acc89-b46a-43ad-847d-a4da42a1c7df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:24.169292 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6acc89-b46a-43ad-847d-a4da42a1c7df None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:24.262212 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 557/1115] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Aug 9 10:12:23 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 10:12:24.268041 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b821f6ff-c34c-4afb-acd5-95c7868df61e None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:24.295492 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:24.365623 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b821f6ff-c34c-4afb-acd5-95c7868df61e None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:24.397826 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66507bde-6d83-4c47-99c2-98e54e212fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:24.398468 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66507bde-6d83-4c47-99c2-98e54e212fc6 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:24.398743 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66507bde-6d83-4c47-99c2-98e54e212fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:24.399011 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66507bde-6d83-4c47-99c2-98e54e212fc6 None admin] PATH_INFO: `/v3/projects/c214ab70f4124b2a9e647d2b7cc26a1b` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:24.400651 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66507bde-6d83-4c47-99c2-98e54e212fc6 None admin] RBAC: Authorizing `identity:get_project(project_id=c214ab70f4124b2a9e647d2b7cc26a1b)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:24.402202 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66507bde-6d83-4c47-99c2-98e54e212fc6 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:24.403788 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 559/1116] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Aug 9 10:12:24 2022] GET /identity/v3/projects/c214ab70f4124b2a9e647d2b7cc26a1b => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:12:24.410029 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6acc89-b46a-43ad-847d-a4da42a1c7df None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:24.498943 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:24.505753 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6acc89-b46a-43ad-847d-a4da42a1c7df None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:24.538036 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee9272a-0f8c-47b1-993c-f88702ab554f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:24.538616 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee9272a-0f8c-47b1-993c-f88702ab554f None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:24.538890 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee9272a-0f8c-47b1-993c-f88702ab554f None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:24.539157 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee9272a-0f8c-47b1-993c-f88702ab554f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:24.539855 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee9272a-0f8c-47b1-993c-f88702ab554f None admin] RBAC: Adding query filter params (role.id=af19908af5d6489696eb27791925a5aa, scope.project.id=c214ab70f4124b2a9e647d2b7cc26a1b, user.id=4989fb9f00a54d9fa63093dba2252d1c) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:12:24.540158 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee9272a-0f8c-47b1-993c-f88702ab554f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:24.542420 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee9272a-0f8c-47b1-993c-f88702ab554f None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:24.547486 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 558/1117] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Aug 9 10:12:24 2022] GET /identity/v3/role_assignments?user.id=4989fb9f00a54d9fa63093dba2252d1c&scope.project.id=c214ab70f4124b2a9e647d2b7cc26a1b&role.id=af19908af5d6489696eb27791925a5aa => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:12:26.492121 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f87f2ec-d84a-4223-8b91-eb29d6d6a74b None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:26.492677 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f87f2ec-d84a-4223-8b91-eb29d6d6a74b None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:26.492677 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f87f2ec-d84a-4223-8b91-eb29d6d6a74b None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:26.494043 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 560/1118] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:12:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:12:26.499150 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7e4361-36c4-4a04-b2d6-53790775ebfa None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:26.499558 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7e4361-36c4-4a04-b2d6-53790775ebfa None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:26.499683 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7e4361-36c4-4a04-b2d6-53790775ebfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:26.517060 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-fc7e4361-36c4-4a04-b2d6-53790775ebfa None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:12:26.518248 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-fc7e4361-36c4-4a04-b2d6-53790775ebfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:12:26.582560 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 559/1119] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:12:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 10:12:26.604141 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f87f2ec-d84a-4223-8b91-eb29d6d6a74b None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:26.694845 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:26.703176 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f87f2ec-d84a-4223-8b91-eb29d6d6a74b None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:26.740583 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e10370-156e-424b-a9fc-d33675259126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:26.741205 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e10370-156e-424b-a9fc-d33675259126 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:26.741483 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e10370-156e-424b-a9fc-d33675259126 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:26.741755 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e10370-156e-424b-a9fc-d33675259126 None admin] PATH_INFO: `/v3/roles/af19908af5d6489696eb27791925a5aa` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:26.743204 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e10370-156e-424b-a9fc-d33675259126 None admin] RBAC: Authorizing `identity:get_role(role_id=af19908af5d6489696eb27791925a5aa)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:26.745044 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e10370-156e-424b-a9fc-d33675259126 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:26.746394 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 561/1120] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Aug 9 10:12:26 2022] GET /identity/v3/roles/af19908af5d6489696eb27791925a5aa => generated 223 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:12:26.752376 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7e4361-36c4-4a04-b2d6-53790775ebfa None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:26.839087 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:26.850866 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7e4361-36c4-4a04-b2d6-53790775ebfa None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:26.885100 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee437cc-3235-47a0-8ff5-9e4b11bc4819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:26.886095 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee437cc-3235-47a0-8ff5-9e4b11bc4819 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:26.886379 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee437cc-3235-47a0-8ff5-9e4b11bc4819 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:26.887309 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee437cc-3235-47a0-8ff5-9e4b11bc4819 None admin] PATH_INFO: `/v3/users/4989fb9f00a54d9fa63093dba2252d1c` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:26.887893 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee437cc-3235-47a0-8ff5-9e4b11bc4819 None admin] RBAC: Authorizing `identity:get_user(user_id=4989fb9f00a54d9fa63093dba2252d1c)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:26.889317 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee437cc-3235-47a0-8ff5-9e4b11bc4819 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:26.890891 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 560/1121] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Aug 9 10:12:26 2022] GET /identity/v3/users/4989fb9f00a54d9fa63093dba2252d1c => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:12:26.896711 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e10370-156e-424b-a9fc-d33675259126 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:26.994501 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e10370-156e-424b-a9fc-d33675259126 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:27.028173 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e0c06d-9b96-43d0-b65f-ca5159ac4e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:27.028786 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e0c06d-9b96-43d0-b65f-ca5159ac4e2a None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:27.029061 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e0c06d-9b96-43d0-b65f-ca5159ac4e2a None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:27.029330 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e0c06d-9b96-43d0-b65f-ca5159ac4e2a None admin] PATH_INFO: `/v3/projects/c214ab70f4124b2a9e647d2b7cc26a1b` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:27.030445 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e0c06d-9b96-43d0-b65f-ca5159ac4e2a None admin] RBAC: Authorizing `identity:get_project(project_id=c214ab70f4124b2a9e647d2b7cc26a1b)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:27.031866 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e0c06d-9b96-43d0-b65f-ca5159ac4e2a None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:27.033465 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 562/1122] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Aug 9 10:12:26 2022] GET /identity/v3/projects/c214ab70f4124b2a9e647d2b7cc26a1b => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:12:27.039428 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee437cc-3235-47a0-8ff5-9e4b11bc4819 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:27.136911 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee437cc-3235-47a0-8ff5-9e4b11bc4819 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:27.168988 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e436f614-369c-4357-992e-0c17122277a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:27.169623 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e436f614-369c-4357-992e-0c17122277a2 None admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:27.169936 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e436f614-369c-4357-992e-0c17122277a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:27.170212 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e436f614-369c-4357-992e-0c17122277a2 None admin] PATH_INFO: `/v3/projects/c214ab70f4124b2a9e647d2b7cc26a1b/users/4989fb9f00a54d9fa63093dba2252d1c/roles/af19908af5d6489696eb27791925a5aa` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:27.172315 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e436f614-369c-4357-992e-0c17122277a2 None admin] RBAC: Authorizing `identity:create_grant(project_id=c214ab70f4124b2a9e647d2b7cc26a1b, user_id=4989fb9f00a54d9fa63093dba2252d1c, role_id=af19908af5d6489696eb27791925a5aa)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:27.173724 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e436f614-369c-4357-992e-0c17122277a2 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:27.186626 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 561/1123] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Aug 9 10:12:27 2022] PUT /identity/v3/projects/c214ab70f4124b2a9e647d2b7cc26a1b/users/4989fb9f00a54d9fa63093dba2252d1c/roles/af19908af5d6489696eb27791925a5aa => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:12:29.146745 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26f67fc-6833-4da3-ac15-4dbac89901cd None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:29.147294 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26f67fc-6833-4da3-ac15-4dbac89901cd None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:29.147294 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26f67fc-6833-4da3-ac15-4dbac89901cd None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:29.148625 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 563/1124] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:12:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:12:29.154337 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8898f13-1667-4b57-8562-24e01e939c2a None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:29.154767 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8898f13-1667-4b57-8562-24e01e939c2a None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:29.154894 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8898f13-1667-4b57-8562-24e01e939c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:29.172962 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-e8898f13-1667-4b57-8562-24e01e939c2a None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:12:29.174176 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-e8898f13-1667-4b57-8562-24e01e939c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:12:29.185087 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:29.240134 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 562/1125] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:12:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 10:12:29.263385 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26f67fc-6833-4da3-ac15-4dbac89901cd None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:29.294203 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:29.363551 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26f67fc-6833-4da3-ac15-4dbac89901cd None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:29.395377 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b97a02-32fa-469d-b037-231e0eb3277e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:29.395981 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b97a02-32fa-469d-b037-231e0eb3277e None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:29.396256 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b97a02-32fa-469d-b037-231e0eb3277e None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:29.396525 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b97a02-32fa-469d-b037-231e0eb3277e None admin] PATH_INFO: `/v3/roles/af19908af5d6489696eb27791925a5aa` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:29.397892 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b97a02-32fa-469d-b037-231e0eb3277e None admin] RBAC: Authorizing `identity:get_role(role_id=af19908af5d6489696eb27791925a5aa)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:29.399243 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b97a02-32fa-469d-b037-231e0eb3277e None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:29.401314 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 564/1126] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Aug 9 10:12:29 2022] GET /identity/v3/roles/af19908af5d6489696eb27791925a5aa => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:12:29.407160 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8898f13-1667-4b57-8562-24e01e939c2a None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:29.501440 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8898f13-1667-4b57-8562-24e01e939c2a None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:29.533343 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86c5018-a56d-4278-8c47-e7fe2efbd307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:29.533975 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86c5018-a56d-4278-8c47-e7fe2efbd307 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:29.534249 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86c5018-a56d-4278-8c47-e7fe2efbd307 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:29.534515 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86c5018-a56d-4278-8c47-e7fe2efbd307 None admin] PATH_INFO: `/v3/users/4989fb9f00a54d9fa63093dba2252d1c` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:29.535604 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86c5018-a56d-4278-8c47-e7fe2efbd307 None admin] RBAC: Authorizing `identity:get_user(user_id=4989fb9f00a54d9fa63093dba2252d1c)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:29.537001 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86c5018-a56d-4278-8c47-e7fe2efbd307 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:29.538557 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 563/1127] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Aug 9 10:12:29 2022] GET /identity/v3/users/4989fb9f00a54d9fa63093dba2252d1c => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:12:29.544658 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b97a02-32fa-469d-b037-231e0eb3277e None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:29.636460 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:29.640301 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b97a02-32fa-469d-b037-231e0eb3277e None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:29.673325 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17954fe4-ac33-45fc-bd38-5a048a29ffa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:29.673931 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17954fe4-ac33-45fc-bd38-5a048a29ffa6 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:29.674206 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17954fe4-ac33-45fc-bd38-5a048a29ffa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:29.674472 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17954fe4-ac33-45fc-bd38-5a048a29ffa6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:29.739398 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17954fe4-ac33-45fc-bd38-5a048a29ffa6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:29.740833 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17954fe4-ac33-45fc-bd38-5a048a29ffa6 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:29.833204 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:29.837867 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 565/1128] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Aug 9 10:12:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 10:12:29.843140 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86c5018-a56d-4278-8c47-e7fe2efbd307 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:29.859477 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:29.943144 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86c5018-a56d-4278-8c47-e7fe2efbd307 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:29.976177 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ab6863-f162-4d41-86bb-8bb0f77a00b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:29.976802 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab6863-f162-4d41-86bb-8bb0f77a00b8 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:29.977078 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab6863-f162-4d41-86bb-8bb0f77a00b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:29.977346 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab6863-f162-4d41-86bb-8bb0f77a00b8 None admin] PATH_INFO: `/v3/projects/c214ab70f4124b2a9e647d2b7cc26a1b` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:29.979431 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ab6863-f162-4d41-86bb-8bb0f77a00b8 None admin] RBAC: Authorizing `identity:get_project(project_id=c214ab70f4124b2a9e647d2b7cc26a1b)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:29.980849 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ab6863-f162-4d41-86bb-8bb0f77a00b8 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:29.982493 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 564/1129] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Aug 9 10:12:29 2022] GET /identity/v3/projects/c214ab70f4124b2a9e647d2b7cc26a1b => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:12:29.988538 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17954fe4-ac33-45fc-bd38-5a048a29ffa6 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:30.082796 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17954fe4-ac33-45fc-bd38-5a048a29ffa6 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:30.114239 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bb2b62-f2f7-4668-af61-5e6941c43b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:30.114756 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb2b62-f2f7-4668-af61-5e6941c43b43 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:30.115032 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb2b62-f2f7-4668-af61-5e6941c43b43 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:30.115298 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb2b62-f2f7-4668-af61-5e6941c43b43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:30.116008 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bb2b62-f2f7-4668-af61-5e6941c43b43 None admin] RBAC: Adding query filter params (role.id=af19908af5d6489696eb27791925a5aa, scope.project.id=c214ab70f4124b2a9e647d2b7cc26a1b, user.id=4989fb9f00a54d9fa63093dba2252d1c) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:12:30.116311 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bb2b62-f2f7-4668-af61-5e6941c43b43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:30.117729 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bb2b62-f2f7-4668-af61-5e6941c43b43 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:30.123695 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 566/1130] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Aug 9 10:12:29 2022] GET /identity/v3/role_assignments?user.id=4989fb9f00a54d9fa63093dba2252d1c&scope.project.id=c214ab70f4124b2a9e647d2b7cc26a1b&role.id=af19908af5d6489696eb27791925a5aa => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:12:32.164180 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eea756-3930-4757-9a95-49cc396b20ed None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:32.164724 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eea756-3930-4757-9a95-49cc396b20ed None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:32.164724 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eea756-3930-4757-9a95-49cc396b20ed None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:32.166538 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 565/1131] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:12:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:12:32.171793 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513d18eb-5ff7-4a7d-9ba0-5f86de5e6a6e None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:32.172209 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513d18eb-5ff7-4a7d-9ba0-5f86de5e6a6e None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:32.172334 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513d18eb-5ff7-4a7d-9ba0-5f86de5e6a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:32.190163 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-513d18eb-5ff7-4a7d-9ba0-5f86de5e6a6e None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:12:32.191331 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-513d18eb-5ff7-4a7d-9ba0-5f86de5e6a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:12:32.244753 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:32.254749 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 567/1132] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:12:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 10:12:32.277791 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eea756-3930-4757-9a95-49cc396b20ed None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:32.356751 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:32.375390 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eea756-3930-4757-9a95-49cc396b20ed None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:32.408742 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ca9aa3-2707-4693-ba70-084fad2cefcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:32.409350 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca9aa3-2707-4693-ba70-084fad2cefcf None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:32.409625 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca9aa3-2707-4693-ba70-084fad2cefcf None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:32.409919 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca9aa3-2707-4693-ba70-084fad2cefcf None admin] PATH_INFO: `/v3/domains/default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:32.410992 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ca9aa3-2707-4693-ba70-084fad2cefcf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:32.412404 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ca9aa3-2707-4693-ba70-084fad2cefcf None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:32.413948 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 566/1133] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:12:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:12:32.420137 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513d18eb-5ff7-4a7d-9ba0-5f86de5e6a6e None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:32.515358 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513d18eb-5ff7-4a7d-9ba0-5f86de5e6a6e None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:32.547847 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a418306a-11e1-4d36-a812-1349dd99be92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:32.548433 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a418306a-11e1-4d36-a812-1349dd99be92 None admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:32.548711 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a418306a-11e1-4d36-a812-1349dd99be92 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:32.548980 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a418306a-11e1-4d36-a812-1349dd99be92 None admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:32.549607 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a418306a-11e1-4d36-a812-1349dd99be92 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:32.551062 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a418306a-11e1-4d36-a812-1349dd99be92 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:32.576722 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 568/1134] 10.222.0.36 () {60 vars in 1141 bytes} [Tue Aug 9 10:12:32 2022] POST /identity/v3/projects => generated 311 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:12:34.588397 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab71ba4-3c04-4d90-a292-91150b32920e None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:34.588987 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab71ba4-3c04-4d90-a292-91150b32920e None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:34.588987 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab71ba4-3c04-4d90-a292-91150b32920e None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:34.590315 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 567/1135] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:12:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:12:34.595467 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f15b17-c54b-4503-976b-d898b8a619e8 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:34.595908 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f15b17-c54b-4503-976b-d898b8a619e8 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:34.596015 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f15b17-c54b-4503-976b-d898b8a619e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:34.613531 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-b0f15b17-c54b-4503-976b-d898b8a619e8 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:12:34.614763 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-b0f15b17-c54b-4503-976b-d898b8a619e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:12:34.654423 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:34.681817 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 569/1136] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:12:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 10:12:34.706120 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab71ba4-3c04-4d90-a292-91150b32920e None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:34.804686 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab71ba4-3c04-4d90-a292-91150b32920e None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:34.839193 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4b310c-079a-4c54-86b9-d8c5057a3af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:34.839737 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b310c-079a-4c54-86b9-d8c5057a3af8 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:34.840013 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b310c-079a-4c54-86b9-d8c5057a3af8 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:34.840283 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b310c-079a-4c54-86b9-d8c5057a3af8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:34.841379 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4b310c-079a-4c54-86b9-d8c5057a3af8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:34.842825 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4b310c-079a-4c54-86b9-d8c5057a3af8 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:34.844381 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 568/1137] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:12:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:12:34.850229 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f15b17-c54b-4503-976b-d898b8a619e8 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:34.946862 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f15b17-c54b-4503-976b-d898b8a619e8 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:34.980386 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2029f7-4000-433e-aaec-23b7ecc65698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:34.980988 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2029f7-4000-433e-aaec-23b7ecc65698 None admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:34.981266 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2029f7-4000-433e-aaec-23b7ecc65698 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:34.981538 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2029f7-4000-433e-aaec-23b7ecc65698 None admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:34.982226 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2029f7-4000-433e-aaec-23b7ecc65698 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:34.983647 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2029f7-4000-433e-aaec-23b7ecc65698 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:35.004481 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 570/1138] 10.222.0.36 () {60 vars in 1132 bytes} [Tue Aug 9 10:12:34 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:12:37.020388 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f4eb94-1cb8-47c5-bb72-eb62f4cfca2b None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:37.020910 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f4eb94-1cb8-47c5-bb72-eb62f4cfca2b None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:37.020910 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f4eb94-1cb8-47c5-bb72-eb62f4cfca2b None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:37.022283 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 569/1139] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:12:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:12:37.027382 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812c5253-79f7-4a4e-98ed-ec277ed693d6 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:37.027813 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812c5253-79f7-4a4e-98ed-ec277ed693d6 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:37.027936 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812c5253-79f7-4a4e-98ed-ec277ed693d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:37.046110 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-812c5253-79f7-4a4e-98ed-ec277ed693d6 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:12:37.047284 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-812c5253-79f7-4a4e-98ed-ec277ed693d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:12:37.070667 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:37.114012 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 571/1140] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:12:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 10:12:37.137341 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f4eb94-1cb8-47c5-bb72-eb62f4cfca2b None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:37.155749 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:37.240047 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f4eb94-1cb8-47c5-bb72-eb62f4cfca2b None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:37.273675 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc6d084-1a8d-4e54-9162-c907a5c99abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:37.274314 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc6d084-1a8d-4e54-9162-c907a5c99abb None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:37.275426 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc6d084-1a8d-4e54-9162-c907a5c99abb None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:37.275699 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc6d084-1a8d-4e54-9162-c907a5c99abb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:37.285979 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc6d084-1a8d-4e54-9162-c907a5c99abb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 10:12:37.291122 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-ebc6d084-1a8d-4e54-9162-c907a5c99abb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 10:12:37.291122 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:12:37.291122 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:12:37.291122 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:12:37.291122 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:12:37.291122 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:12:37.291122 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:12:37.291122 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:12:37.291122 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:12:37.291122 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:12:37.291122 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:12:37.291122 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:12:37.291122 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 10:12:37.291122 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 10:12:37.291122 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 10:12:37.291122 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 10:12:37.292299 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 10:12:37.292299 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 10:12:37.292299 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 10:12:37.292299 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 10:12:37.292299 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:12:37.292299 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:12:37.292299 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:12:37.292299 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:12:37.292299 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:12:37.292299 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:12:37.292299 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:12:37.292299 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:12:37.292299 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:12:37.292299 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:12:37.292299 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:12:37.292299 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:12:37.293553 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:12:37.293553 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:12:37.293553 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:12:37.293553 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:12:37.293553 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 10:12:37.293553 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 10:12:37.293553 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 10:12:37.293553 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 10:12:37.293553 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 10:12:37.293553 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 10:12:37.293553 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 10:12:37.293553 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:12:37.293553 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 570/1141] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Aug 9 10:12:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:12:37.298207 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812c5253-79f7-4a4e-98ed-ec277ed693d6 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:37.391085 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812c5253-79f7-4a4e-98ed-ec277ed693d6 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:37.424017 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bae3715-4bb9-4feb-9888-fef02ef9c4ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:37.424595 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae3715-4bb9-4feb-9888-fef02ef9c4ed None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:37.424867 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae3715-4bb9-4feb-9888-fef02ef9c4ed None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:37.425131 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae3715-4bb9-4feb-9888-fef02ef9c4ed None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:37.425773 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bae3715-4bb9-4feb-9888-fef02ef9c4ed None admin] RBAC: Adding query filter params (name=admin) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:12:37.426219 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bae3715-4bb9-4feb-9888-fef02ef9c4ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:37.427563 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bae3715-4bb9-4feb-9888-fef02ef9c4ed None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:37.435642 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 572/1142] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Aug 9 10:12:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:12:37.441225 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc6d084-1a8d-4e54-9162-c907a5c99abb None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:37.518425 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:37.540003 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc6d084-1a8d-4e54-9162-c907a5c99abb None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:37.572921 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083474f9-ab0c-4bc9-9eac-fd5aa558e545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:37.573535 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083474f9-ab0c-4bc9-9eac-fd5aa558e545 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:37.573820 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083474f9-ab0c-4bc9-9eac-fd5aa558e545 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:37.574122 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083474f9-ab0c-4bc9-9eac-fd5aa558e545 None admin] PATH_INFO: `/v3/users/c2c84021f54548888945c17012bafa65` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:37.586729 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083474f9-ab0c-4bc9-9eac-fd5aa558e545 None admin] RBAC: Authorizing `identity:get_user(user_id=c2c84021f54548888945c17012bafa65)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:37.588800 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083474f9-ab0c-4bc9-9eac-fd5aa558e545 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:37.590448 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 571/1143] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Aug 9 10:12:37 2022] GET /identity/v3/users/c2c84021f54548888945c17012bafa65 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:12:37.596255 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bae3715-4bb9-4feb-9888-fef02ef9c4ed None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:37.621045 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:37.694435 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bae3715-4bb9-4feb-9888-fef02ef9c4ed None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:37.726497 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66e0899-917e-4b3a-a36a-8f03bea46ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:37.727088 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e0899-917e-4b3a-a36a-8f03bea46ee7 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:37.727367 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e0899-917e-4b3a-a36a-8f03bea46ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:37.727644 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e0899-917e-4b3a-a36a-8f03bea46ee7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:37.795184 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66e0899-917e-4b3a-a36a-8f03bea46ee7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:37.796560 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66e0899-917e-4b3a-a36a-8f03bea46ee7 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:37.820010 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:37.895424 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 573/1144] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Aug 9 10:12:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 10:12:37.901634 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083474f9-ab0c-4bc9-9eac-fd5aa558e545 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:38.005619 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083474f9-ab0c-4bc9-9eac-fd5aa558e545 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:38.038473 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccdc2ab-b339-467b-ab8c-eedd2f3bd30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:38.039075 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccdc2ab-b339-467b-ab8c-eedd2f3bd30f None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:38.039344 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccdc2ab-b339-467b-ab8c-eedd2f3bd30f None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:38.039611 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccdc2ab-b339-467b-ab8c-eedd2f3bd30f None admin] PATH_INFO: `/v3/projects/481293c5b42742eba6910828a0360f7c` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:38.041241 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccdc2ab-b339-467b-ab8c-eedd2f3bd30f None admin] RBAC: Authorizing `identity:get_project(project_id=481293c5b42742eba6910828a0360f7c)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:38.042661 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccdc2ab-b339-467b-ab8c-eedd2f3bd30f None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:38.044262 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 572/1145] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Aug 9 10:12:37 2022] GET /identity/v3/projects/481293c5b42742eba6910828a0360f7c => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:12:38.050434 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66e0899-917e-4b3a-a36a-8f03bea46ee7 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:38.146448 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66e0899-917e-4b3a-a36a-8f03bea46ee7 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:38.169437 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:38.181477 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2505b7d1-5394-492e-9a5b-4644bfd8c4f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:38.182117 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2505b7d1-5394-492e-9a5b-4644bfd8c4f1 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:38.182398 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2505b7d1-5394-492e-9a5b-4644bfd8c4f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:38.182672 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2505b7d1-5394-492e-9a5b-4644bfd8c4f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:38.183397 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2505b7d1-5394-492e-9a5b-4644bfd8c4f1 None admin] RBAC: Adding query filter params (role.id=89ca30cbbb634be8a96e9921aa56626b, scope.project.id=481293c5b42742eba6910828a0360f7c, user.id=c2c84021f54548888945c17012bafa65) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:12:38.183707 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2505b7d1-5394-492e-9a5b-4644bfd8c4f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:38.185127 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2505b7d1-5394-492e-9a5b-4644bfd8c4f1 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:38.190399 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 574/1146] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Aug 9 10:12:38 2022] GET /identity/v3/role_assignments?user.id=c2c84021f54548888945c17012bafa65&scope.project.id=481293c5b42742eba6910828a0360f7c&role.id=89ca30cbbb634be8a96e9921aa56626b => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:12:40.122254 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def685d4-afa6-4ecb-a87c-07d1794fea42 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:40.122817 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def685d4-afa6-4ecb-a87c-07d1794fea42 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:40.122817 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def685d4-afa6-4ecb-a87c-07d1794fea42 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:40.124129 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 573/1147] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:12:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:12:40.129309 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2969d-81e9-4c3f-84f2-d5489a7061d2 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:40.129718 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2969d-81e9-4c3f-84f2-d5489a7061d2 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:40.129870 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2969d-81e9-4c3f-84f2-d5489a7061d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:40.147789 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-a9e2969d-81e9-4c3f-84f2-d5489a7061d2 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:12:40.148957 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-a9e2969d-81e9-4c3f-84f2-d5489a7061d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:12:40.213934 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 575/1148] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:12:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 10:12:40.235451 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def685d4-afa6-4ecb-a87c-07d1794fea42 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:40.239203 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:40.334372 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def685d4-afa6-4ecb-a87c-07d1794fea42 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:40.367356 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b9b119-b152-4f55-858a-31d541a2f0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:40.367957 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b9b119-b152-4f55-858a-31d541a2f0a3 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:40.368258 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b9b119-b152-4f55-858a-31d541a2f0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:40.368594 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b9b119-b152-4f55-858a-31d541a2f0a3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:40.378399 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b9b119-b152-4f55-858a-31d541a2f0a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 10:12:40.382912 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-a6b9b119-b152-4f55-858a-31d541a2f0a3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 10:12:40.382912 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:12:40.382912 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:12:40.382912 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:12:40.382912 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:12:40.382912 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:12:40.382912 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:12:40.382912 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:12:40.382912 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:12:40.382912 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:12:40.382912 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:12:40.382912 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:12:40.382912 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 10:12:40.382912 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 10:12:40.382912 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 10:12:40.382912 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 10:12:40.384519 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 10:12:40.384519 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 10:12:40.384519 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 10:12:40.384519 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 10:12:40.384519 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:12:40.384519 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:12:40.384519 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:12:40.384519 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:12:40.384519 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:12:40.384519 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:12:40.384519 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:12:40.384519 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:12:40.384519 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:12:40.384519 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:12:40.384519 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:12:40.384519 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:12:40.385680 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:12:40.385680 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:12:40.385680 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:12:40.385680 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:12:40.385680 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 10:12:40.385680 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 10:12:40.385680 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 10:12:40.385680 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 10:12:40.385680 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 10:12:40.385680 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 10:12:40.385680 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 10:12:40.385680 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:12:40.385680 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 574/1149] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Aug 9 10:12:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:12:40.390561 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e2969d-81e9-4c3f-84f2-d5489a7061d2 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:40.486048 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e2969d-81e9-4c3f-84f2-d5489a7061d2 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:40.502154 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:40.519670 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee5a37d-4689-4881-be3b-a8fea0fdf743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:40.520256 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee5a37d-4689-4881-be3b-a8fea0fdf743 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:40.520533 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee5a37d-4689-4881-be3b-a8fea0fdf743 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:40.520803 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee5a37d-4689-4881-be3b-a8fea0fdf743 None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:40.521456 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee5a37d-4689-4881-be3b-a8fea0fdf743 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:12:40.521756 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee5a37d-4689-4881-be3b-a8fea0fdf743 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:40.523141 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee5a37d-4689-4881-be3b-a8fea0fdf743 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:40.530977 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 576/1150] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Aug 9 10:12:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:12:40.536821 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b9b119-b152-4f55-858a-31d541a2f0a3 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:40.596833 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:40.633392 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b9b119-b152-4f55-858a-31d541a2f0a3 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:40.666221 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1000d6df-a08a-40ab-ab88-07b57ba3fa9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:40.666823 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000d6df-a08a-40ab-ab88-07b57ba3fa9b None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:40.667097 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000d6df-a08a-40ab-ab88-07b57ba3fa9b None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:40.667365 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000d6df-a08a-40ab-ab88-07b57ba3fa9b None admin] PATH_INFO: `/v3/users/c2c84021f54548888945c17012bafa65` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:40.668457 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1000d6df-a08a-40ab-ab88-07b57ba3fa9b None admin] RBAC: Authorizing `identity:get_user(user_id=c2c84021f54548888945c17012bafa65)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:40.669895 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1000d6df-a08a-40ab-ab88-07b57ba3fa9b None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:40.671423 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 575/1151] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Aug 9 10:12:40 2022] GET /identity/v3/users/c2c84021f54548888945c17012bafa65 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:12:40.677017 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee5a37d-4689-4881-be3b-a8fea0fdf743 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:40.772920 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee5a37d-4689-4881-be3b-a8fea0fdf743 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:40.804950 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decebca7-2d65-4aee-b457-1abd4301c3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:40.805556 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decebca7-2d65-4aee-b457-1abd4301c3d9 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:40.805921 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decebca7-2d65-4aee-b457-1abd4301c3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:40.806197 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decebca7-2d65-4aee-b457-1abd4301c3d9 None admin] PATH_INFO: `/v3/projects/481293c5b42742eba6910828a0360f7c` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:40.807352 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decebca7-2d65-4aee-b457-1abd4301c3d9 None admin] RBAC: Authorizing `identity:get_project(project_id=481293c5b42742eba6910828a0360f7c)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:40.808771 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decebca7-2d65-4aee-b457-1abd4301c3d9 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:40.810384 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 577/1152] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Aug 9 10:12:40 2022] GET /identity/v3/projects/481293c5b42742eba6910828a0360f7c => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:12:40.816109 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1000d6df-a08a-40ab-ab88-07b57ba3fa9b None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:40.911340 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1000d6df-a08a-40ab-ab88-07b57ba3fa9b None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:40.938926 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:40.947876 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4495f60-78fa-4cd8-adff-52359c33876a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:40.948529 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4495f60-78fa-4cd8-adff-52359c33876a None admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:40.948809 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4495f60-78fa-4cd8-adff-52359c33876a None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:40.949082 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4495f60-78fa-4cd8-adff-52359c33876a None admin] PATH_INFO: `/v3/projects/481293c5b42742eba6910828a0360f7c/users/c2c84021f54548888945c17012bafa65/roles/89ca30cbbb634be8a96e9921aa56626b` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:40.950982 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4495f60-78fa-4cd8-adff-52359c33876a None admin] RBAC: Authorizing `identity:create_grant(project_id=481293c5b42742eba6910828a0360f7c, user_id=c2c84021f54548888945c17012bafa65, role_id=89ca30cbbb634be8a96e9921aa56626b)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:40.952400 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4495f60-78fa-4cd8-adff-52359c33876a None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:40.966332 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 576/1153] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Aug 9 10:12:40 2022] PUT /identity/v3/projects/481293c5b42742eba6910828a0360f7c/users/c2c84021f54548888945c17012bafa65/roles/89ca30cbbb634be8a96e9921aa56626b => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:12:42.942121 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f34a4bf-29a8-4b94-ba35-1253b8acd692 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:42.942653 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f34a4bf-29a8-4b94-ba35-1253b8acd692 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:42.942653 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f34a4bf-29a8-4b94-ba35-1253b8acd692 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:42.944014 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 578/1154] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:12:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:12:42.950172 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7a92fe-520a-47ce-adb3-17dc7a1dd9ec None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:42.950558 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7a92fe-520a-47ce-adb3-17dc7a1dd9ec None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:42.950713 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7a92fe-520a-47ce-adb3-17dc7a1dd9ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:42.968325 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-8d7a92fe-520a-47ce-adb3-17dc7a1dd9ec None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:12:42.969486 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-8d7a92fe-520a-47ce-adb3-17dc7a1dd9ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:12:43.033802 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 577/1155] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:12:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 10:12:43.056634 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f34a4bf-29a8-4b94-ba35-1253b8acd692 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:43.103628 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:43.156299 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f34a4bf-29a8-4b94-ba35-1253b8acd692 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:43.189160 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88225a5a-1f4f-4c5b-b610-8b80dadd8433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:43.189763 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88225a5a-1f4f-4c5b-b610-8b80dadd8433 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:43.190066 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88225a5a-1f4f-4c5b-b610-8b80dadd8433 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:43.190336 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88225a5a-1f4f-4c5b-b610-8b80dadd8433 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:43.200463 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88225a5a-1f4f-4c5b-b610-8b80dadd8433 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 10:12:43.205044 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-88225a5a-1f4f-4c5b-b610-8b80dadd8433 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 10:12:43.205044 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:12:43.205044 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:12:43.205044 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:12:43.205044 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:12:43.205044 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:12:43.205044 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:12:43.205044 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:12:43.205044 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:12:43.205044 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:12:43.205044 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:12:43.205044 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:12:43.205044 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 10:12:43.205044 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 10:12:43.205044 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 10:12:43.205044 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 10:12:43.206163 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 10:12:43.206163 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 10:12:43.206163 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 10:12:43.206163 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 10:12:43.206163 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:12:43.206163 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:12:43.206163 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:12:43.206163 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:12:43.206163 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:12:43.206163 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:12:43.206163 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:12:43.206163 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:12:43.206163 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:12:43.206163 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:12:43.206163 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:12:43.206163 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:12:43.207288 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:12:43.207288 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:12:43.207288 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:12:43.207288 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:12:43.207288 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 10:12:43.207288 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 10:12:43.207288 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 10:12:43.207288 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 10:12:43.207288 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 10:12:43.207288 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 10:12:43.207288 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 10:12:43.207288 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:12:43.207288 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 579/1156] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Aug 9 10:12:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:12:43.212321 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7a92fe-520a-47ce-adb3-17dc7a1dd9ec None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:43.306615 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7a92fe-520a-47ce-adb3-17dc7a1dd9ec None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:43.327947 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:43.340064 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aa1138-5347-4243-a2a2-13d8ed6f26a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:43.340657 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa1138-5347-4243-a2a2-13d8ed6f26a0 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:43.340933 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa1138-5347-4243-a2a2-13d8ed6f26a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:43.341201 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa1138-5347-4243-a2a2-13d8ed6f26a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:43.341858 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aa1138-5347-4243-a2a2-13d8ed6f26a0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:12:43.342163 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aa1138-5347-4243-a2a2-13d8ed6f26a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:43.343505 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aa1138-5347-4243-a2a2-13d8ed6f26a0 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:43.351156 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 578/1157] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Aug 9 10:12:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:12:43.357648 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88225a5a-1f4f-4c5b-b610-8b80dadd8433 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:43.453739 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88225a5a-1f4f-4c5b-b610-8b80dadd8433 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:43.460346 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:43.487689 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be58c4f-0434-4551-945e-2cae556711b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:43.488306 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be58c4f-0434-4551-945e-2cae556711b0 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:43.488586 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be58c4f-0434-4551-945e-2cae556711b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:43.488861 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be58c4f-0434-4551-945e-2cae556711b0 None admin] PATH_INFO: `/v3/users/c2c84021f54548888945c17012bafa65` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:43.490005 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be58c4f-0434-4551-945e-2cae556711b0 None admin] RBAC: Authorizing `identity:get_user(user_id=c2c84021f54548888945c17012bafa65)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:43.491436 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be58c4f-0434-4551-945e-2cae556711b0 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:43.493005 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 580/1158] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Aug 9 10:12:43 2022] GET /identity/v3/users/c2c84021f54548888945c17012bafa65 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:12:43.498934 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aa1138-5347-4243-a2a2-13d8ed6f26a0 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:43.596167 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aa1138-5347-4243-a2a2-13d8ed6f26a0 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:43.628618 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c33f52e-8f4d-4b3e-abc3-bf2ec0adb1cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:43.629200 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c33f52e-8f4d-4b3e-abc3-bf2ec0adb1cc None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:43.629474 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c33f52e-8f4d-4b3e-abc3-bf2ec0adb1cc None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:43.629742 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c33f52e-8f4d-4b3e-abc3-bf2ec0adb1cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:43.679851 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:43.695327 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c33f52e-8f4d-4b3e-abc3-bf2ec0adb1cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:43.696765 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c33f52e-8f4d-4b3e-abc3-bf2ec0adb1cc None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:43.791367 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 579/1159] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Aug 9 10:12:43 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 10:12:43.797216 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be58c4f-0434-4551-945e-2cae556711b0 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:43.896592 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be58c4f-0434-4551-945e-2cae556711b0 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:43.929662 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fb053c-be64-4d1c-b597-c5f54e589469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:43.930303 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb053c-be64-4d1c-b597-c5f54e589469 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:43.930623 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb053c-be64-4d1c-b597-c5f54e589469 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:43.930911 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb053c-be64-4d1c-b597-c5f54e589469 None admin] PATH_INFO: `/v3/projects/481293c5b42742eba6910828a0360f7c` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:43.932030 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fb053c-be64-4d1c-b597-c5f54e589469 None admin] RBAC: Authorizing `identity:get_project(project_id=481293c5b42742eba6910828a0360f7c)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:43.933463 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fb053c-be64-4d1c-b597-c5f54e589469 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:43.935096 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 581/1160] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Aug 9 10:12:43 2022] GET /identity/v3/projects/481293c5b42742eba6910828a0360f7c => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:12:43.941019 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c33f52e-8f4d-4b3e-abc3-bf2ec0adb1cc None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:44.021536 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:44.038151 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c33f52e-8f4d-4b3e-abc3-bf2ec0adb1cc None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:44.070900 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed8582d-4f80-4bd0-b899-9a8b4ca988b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:44.071946 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed8582d-4f80-4bd0-b899-9a8b4ca988b4 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:44.072221 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed8582d-4f80-4bd0-b899-9a8b4ca988b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:44.072492 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed8582d-4f80-4bd0-b899-9a8b4ca988b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:44.073204 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed8582d-4f80-4bd0-b899-9a8b4ca988b4 None admin] RBAC: Adding query filter params (role.id=89ca30cbbb634be8a96e9921aa56626b, scope.project.id=481293c5b42742eba6910828a0360f7c, user.id=c2c84021f54548888945c17012bafa65) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:12:44.073511 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed8582d-4f80-4bd0-b899-9a8b4ca988b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:44.074944 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed8582d-4f80-4bd0-b899-9a8b4ca988b4 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:44.080467 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 580/1161] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Aug 9 10:12:43 2022] GET /identity/v3/role_assignments?user.id=c2c84021f54548888945c17012bafa65&scope.project.id=481293c5b42742eba6910828a0360f7c&role.id=89ca30cbbb634be8a96e9921aa56626b => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:12:46.062732 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d90a2d-7963-45cf-944b-87809d631b44 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:46.063282 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d90a2d-7963-45cf-944b-87809d631b44 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:46.063282 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d90a2d-7963-45cf-944b-87809d631b44 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:46.064587 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 582/1162] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:12:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:12:46.069794 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f17be-eb82-4c95-825a-0fb10081d3db None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:46.070241 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f17be-eb82-4c95-825a-0fb10081d3db None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:46.070384 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f17be-eb82-4c95-825a-0fb10081d3db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:46.089351 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-399f17be-eb82-4c95-825a-0fb10081d3db None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:12:46.090560 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-399f17be-eb82-4c95-825a-0fb10081d3db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:12:46.155303 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 581/1163] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:12:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 10:12:46.176987 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d90a2d-7963-45cf-944b-87809d631b44 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:46.220115 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:46.276460 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d90a2d-7963-45cf-944b-87809d631b44 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:46.308888 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb2f5a5-ae62-47e7-b0fe-cc05783bcdb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:46.309467 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb2f5a5-ae62-47e7-b0fe-cc05783bcdb6 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:46.309738 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb2f5a5-ae62-47e7-b0fe-cc05783bcdb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:46.310030 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb2f5a5-ae62-47e7-b0fe-cc05783bcdb6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:46.373060 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb2f5a5-ae62-47e7-b0fe-cc05783bcdb6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:46.374514 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb2f5a5-ae62-47e7-b0fe-cc05783bcdb6 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:46.413084 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:46.467737 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 583/1164] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Aug 9 10:12:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 10:12:46.473753 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399f17be-eb82-4c95-825a-0fb10081d3db None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:46.547242 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:46.570397 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399f17be-eb82-4c95-825a-0fb10081d3db None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:46.602953 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c83b892-d9f9-47fd-bbb0-3495a9323b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:46.603558 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c83b892-d9f9-47fd-bbb0-3495a9323b8e None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:46.603830 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c83b892-d9f9-47fd-bbb0-3495a9323b8e None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:46.604093 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c83b892-d9f9-47fd-bbb0-3495a9323b8e None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:46.610440 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c83b892-d9f9-47fd-bbb0-3495a9323b8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:46.611845 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c83b892-d9f9-47fd-bbb0-3495a9323b8e None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:46.623144 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-2c83b892-d9f9-47fd-bbb0-3495a9323b8e None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 09 10:12:46.623144 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:12:46.623144 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 09 10:12:46.623144 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 09 10:12:46.623144 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 10:12:46.623144 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 10:12:46.623144 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 10:12:46.623144 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 10:12:46.623144 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 09 10:12:46.623144 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:12:46.623144 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 10:12:46.623144 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:12:46.623144 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:12:46.623144 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:12:46.623144 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:12:46.623144 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:12:46.623144 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:12:46.624299 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:12:46.624299 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:12:46.624299 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:12:46.624299 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:12:46.624299 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:12:46.624299 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:12:46.624299 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 10:12:46.624299 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 10:12:46.624299 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 10:12:46.624299 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 10:12:46.624299 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:12:46.624299 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:12:46.624299 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:12:46.624299 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:12:46.624299 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:12:46.624299 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:12:46.625323 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:12:46.625323 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:12:46.625323 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:12:46.625323 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:12:46.625323 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:12:46.625323 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:12:46.625323 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:12:46.625323 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:12:46.625323 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:12:46.625323 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:12:46.625323 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 09 10:12:46.625323 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 10:12:46.625323 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 09 10:12:46.625323 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:12:46.625323 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 582/1165] 10.222.0.36 () {56 vars in 1117 bytes} [Tue Aug 9 10:12:46 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:12:46.630104 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb2f5a5-ae62-47e7-b0fe-cc05783bcdb6 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:46.723439 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb2f5a5-ae62-47e7-b0fe-cc05783bcdb6 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:46.755279 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fca36ec-b202-4396-b40b-637e9d9ec570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:46.755800 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fca36ec-b202-4396-b40b-637e9d9ec570 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:46.756074 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fca36ec-b202-4396-b40b-637e9d9ec570 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:46.756339 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fca36ec-b202-4396-b40b-637e9d9ec570 None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:46.756960 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fca36ec-b202-4396-b40b-637e9d9ec570 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:12:46.757254 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fca36ec-b202-4396-b40b-637e9d9ec570 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:46.758861 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fca36ec-b202-4396-b40b-637e9d9ec570 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:46.765962 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 584/1166] 10.222.0.36 () {56 vars in 1115 bytes} [Tue Aug 9 10:12:46 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:12:48.737525 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c675942a-6a58-484d-8d70-26b63285d8e5 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:48.738113 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c675942a-6a58-484d-8d70-26b63285d8e5 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:48.738113 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c675942a-6a58-484d-8d70-26b63285d8e5 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:48.739401 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 583/1167] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:12:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:12:48.745134 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b68d9-4937-4cd9-9715-1e3ad7cd91d5 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:48.745556 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b68d9-4937-4cd9-9715-1e3ad7cd91d5 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:48.745672 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b68d9-4937-4cd9-9715-1e3ad7cd91d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:48.758237 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:48.764261 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-607b68d9-4937-4cd9-9715-1e3ad7cd91d5 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:12:48.765433 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-607b68d9-4937-4cd9-9715-1e3ad7cd91d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:12:48.829281 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 585/1168] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:12:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 10:12:48.851293 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c675942a-6a58-484d-8d70-26b63285d8e5 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:48.952710 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c675942a-6a58-484d-8d70-26b63285d8e5 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:48.986805 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f746254a-5229-48ec-ac79-29f0a093b987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:48.987388 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f746254a-5229-48ec-ac79-29f0a093b987 None admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:48.987709 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f746254a-5229-48ec-ac79-29f0a093b987 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:48.987929 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f746254a-5229-48ec-ac79-29f0a093b987 None admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:48.988577 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f746254a-5229-48ec-ac79-29f0a093b987 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:48.989955 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f746254a-5229-48ec-ac79-29f0a093b987 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:48.999897 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:49.007400 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 584/1169] 10.222.0.36 () {60 vars in 1138 bytes} [Tue Aug 9 10:12:48 2022] POST /identity/v3/domains => generated 267 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:12:51.107867 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0044d8-469e-4b8d-9360-7dac6322a430 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:51.108413 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0044d8-469e-4b8d-9360-7dac6322a430 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:51.108413 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0044d8-469e-4b8d-9360-7dac6322a430 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:51.109743 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 586/1170] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:12:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:12:51.115122 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e4a50b-d184-4153-9a31-82fdfa9f75c1 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:51.115517 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e4a50b-d184-4153-9a31-82fdfa9f75c1 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:51.115662 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e4a50b-d184-4153-9a31-82fdfa9f75c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:51.135162 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-b1e4a50b-d184-4153-9a31-82fdfa9f75c1 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:12:51.136333 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-b1e4a50b-d184-4153-9a31-82fdfa9f75c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:12:51.201832 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 585/1171] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:12:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 10:12:51.224714 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0044d8-469e-4b8d-9360-7dac6322a430 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:51.323606 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0044d8-469e-4b8d-9360-7dac6322a430 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:51.355656 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c91d35-37a1-4899-80ef-933b7086ae08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:51.356259 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c91d35-37a1-4899-80ef-933b7086ae08 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:51.356531 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c91d35-37a1-4899-80ef-933b7086ae08 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:51.356798 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c91d35-37a1-4899-80ef-933b7086ae08 None admin] PATH_INFO: `/v3/domains/cf1afa61af5d4a54a444e544f7fbacd1` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:51.359361 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:51.368114 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c91d35-37a1-4899-80ef-933b7086ae08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=cf1afa61af5d4a54a444e544f7fbacd1)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:51.369552 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c91d35-37a1-4899-80ef-933b7086ae08 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:51.371193 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 587/1172] 10.222.0.36 () {56 vars in 1183 bytes} [Tue Aug 9 10:12:51 2022] GET /identity/v3/domains/cf1afa61af5d4a54a444e544f7fbacd1 => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:12:51.377037 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e4a50b-d184-4153-9a31-82fdfa9f75c1 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:51.477276 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e4a50b-d184-4153-9a31-82fdfa9f75c1 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:51.503658 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:51.512412 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e62763-c54a-4133-871c-15d37f13aac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:51.513060 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e62763-c54a-4133-871c-15d37f13aac6 None admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:51.513371 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e62763-c54a-4133-871c-15d37f13aac6 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:51.513670 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e62763-c54a-4133-871c-15d37f13aac6 None admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:51.514407 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e62763-c54a-4133-871c-15d37f13aac6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:51.515962 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e62763-c54a-4133-871c-15d37f13aac6 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:51.543219 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 586/1173] 10.222.0.36 () {60 vars in 1141 bytes} [Tue Aug 9 10:12:51 2022] POST /identity/v3/projects => generated 361 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 10:12:53.609681 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea1e84f-2f7c-4d36-8202-865c82f20550 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:53.610296 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea1e84f-2f7c-4d36-8202-865c82f20550 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:53.610296 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea1e84f-2f7c-4d36-8202-865c82f20550 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:53.611595 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 588/1174] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:12:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 10:12:53.616589 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22d0059-c7a1-4ee6-8c1c-f382a9632174 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:53.617000 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22d0059-c7a1-4ee6-8c1c-f382a9632174 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:53.617125 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22d0059-c7a1-4ee6-8c1c-f382a9632174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:53.635200 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-b22d0059-c7a1-4ee6-8c1c-f382a9632174 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:12:53.636354 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-b22d0059-c7a1-4ee6-8c1c-f382a9632174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:12:53.700293 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 587/1175] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:12:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 10:12:53.725519 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea1e84f-2f7c-4d36-8202-865c82f20550 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:53.824438 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea1e84f-2f7c-4d36-8202-865c82f20550 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:53.856030 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97b78e1-8b1b-4dc8-a7cc-2fd8564706fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:53.856631 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b78e1-8b1b-4dc8-a7cc-2fd8564706fc None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:53.856907 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b78e1-8b1b-4dc8-a7cc-2fd8564706fc None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:53.857175 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b78e1-8b1b-4dc8-a7cc-2fd8564706fc None admin] PATH_INFO: `/v3/domains/cf1afa61af5d4a54a444e544f7fbacd1` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:53.858289 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97b78e1-8b1b-4dc8-a7cc-2fd8564706fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=cf1afa61af5d4a54a444e544f7fbacd1)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:53.859757 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97b78e1-8b1b-4dc8-a7cc-2fd8564706fc None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:53.861233 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 589/1176] 10.222.0.36 () {56 vars in 1183 bytes} [Tue Aug 9 10:12:53 2022] GET /identity/v3/domains/cf1afa61af5d4a54a444e544f7fbacd1 => generated 267 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:12:53.866989 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22d0059-c7a1-4ee6-8c1c-f382a9632174 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:53.965048 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22d0059-c7a1-4ee6-8c1c-f382a9632174 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:53.975287 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:53.998901 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53b5a6d-591a-407f-88d9-5d9ed360050a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:53.999494 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b5a6d-591a-407f-88d9-5d9ed360050a None admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:53.999771 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b5a6d-591a-407f-88d9-5d9ed360050a None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:54.000034 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b5a6d-591a-407f-88d9-5d9ed360050a None admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:54.000664 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53b5a6d-591a-407f-88d9-5d9ed360050a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:54.002087 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53b5a6d-591a-407f-88d9-5d9ed360050a None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:54.021918 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 588/1177] 10.222.0.36 () {60 vars in 1132 bytes} [Tue Aug 9 10:12:53 2022] POST /identity/v3/users => generated 311 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:12:56.043038 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15432a9-b804-4123-8a49-69c6f073b0ef None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:56.043545 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15432a9-b804-4123-8a49-69c6f073b0ef None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:56.043656 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15432a9-b804-4123-8a49-69c6f073b0ef None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:56.044922 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 590/1178] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:12:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:12:56.050482 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc9f7e6-74c6-49e4-8137-47b4709b78ae None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:56.050897 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc9f7e6-74c6-49e4-8137-47b4709b78ae None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:56.051117 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc9f7e6-74c6-49e4-8137-47b4709b78ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:56.070140 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-fdc9f7e6-74c6-49e4-8137-47b4709b78ae None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:12:56.072092 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-fdc9f7e6-74c6-49e4-8137-47b4709b78ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:12:56.140205 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 589/1179] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:12:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 10:12:56.164830 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15432a9-b804-4123-8a49-69c6f073b0ef None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:56.228569 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:56.268023 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15432a9-b804-4123-8a49-69c6f073b0ef None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:56.300355 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c256d4e-1775-435d-9c2d-5f57b4a05e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:56.300960 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c256d4e-1775-435d-9c2d-5f57b4a05e4a None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:56.301230 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c256d4e-1775-435d-9c2d-5f57b4a05e4a None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:56.304051 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c256d4e-1775-435d-9c2d-5f57b4a05e4a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:56.312348 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c256d4e-1775-435d-9c2d-5f57b4a05e4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 10:12:56.316939 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-3c256d4e-1775-435d-9c2d-5f57b4a05e4a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 10:12:56.316939 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:12:56.316939 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:12:56.316939 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:12:56.316939 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:12:56.316939 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:12:56.316939 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:12:56.316939 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:12:56.316939 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:12:56.316939 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:12:56.316939 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:12:56.316939 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:12:56.316939 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 10:12:56.316939 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 10:12:56.316939 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 10:12:56.316939 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 10:12:56.317840 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 10:12:56.317840 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 10:12:56.317840 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 10:12:56.317840 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 10:12:56.317840 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:12:56.317840 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:12:56.317840 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:12:56.317840 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:12:56.317840 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:12:56.317840 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:12:56.317840 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:12:56.317840 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:12:56.317840 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:12:56.317840 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:12:56.317840 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:12:56.317840 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:12:56.318783 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:12:56.318783 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:12:56.318783 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:12:56.318783 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:12:56.318783 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 10:12:56.318783 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 10:12:56.318783 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 10:12:56.318783 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 10:12:56.318783 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 10:12:56.318783 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 10:12:56.318783 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 10:12:56.318783 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:12:56.318783 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 591/1180] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Aug 9 10:12:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:12:56.324845 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc9f7e6-74c6-49e4-8137-47b4709b78ae None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:56.414846 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:56.421938 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc9f7e6-74c6-49e4-8137-47b4709b78ae None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:56.456687 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c0e76c-44db-482b-ab8b-2321ea7d9c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:56.457279 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c0e76c-44db-482b-ab8b-2321ea7d9c30 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:56.457553 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c0e76c-44db-482b-ab8b-2321ea7d9c30 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:56.457819 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c0e76c-44db-482b-ab8b-2321ea7d9c30 None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:56.458495 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c0e76c-44db-482b-ab8b-2321ea7d9c30 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:12:56.458790 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c0e76c-44db-482b-ab8b-2321ea7d9c30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:56.460123 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c0e76c-44db-482b-ab8b-2321ea7d9c30 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:56.468323 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 590/1181] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Aug 9 10:12:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:12:56.474063 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c256d4e-1775-435d-9c2d-5f57b4a05e4a None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:56.569373 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c256d4e-1775-435d-9c2d-5f57b4a05e4a None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:56.593435 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:56.604813 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16b711c-b316-4fdf-808d-632d6fa89336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:56.605467 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b711c-b316-4fdf-808d-632d6fa89336 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:56.605774 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b711c-b316-4fdf-808d-632d6fa89336 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:56.606101 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b711c-b316-4fdf-808d-632d6fa89336 None admin] PATH_INFO: `/v3/users/e7729590d74745129e8db70383ec7eb3` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:56.619701 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16b711c-b316-4fdf-808d-632d6fa89336 None admin] RBAC: Authorizing `identity:get_user(user_id=e7729590d74745129e8db70383ec7eb3)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:56.621130 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16b711c-b316-4fdf-808d-632d6fa89336 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:56.622777 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 592/1182] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Aug 9 10:12:56 2022] GET /identity/v3/users/e7729590d74745129e8db70383ec7eb3 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:12:56.628512 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c0e76c-44db-482b-ab8b-2321ea7d9c30 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:56.729045 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c0e76c-44db-482b-ab8b-2321ea7d9c30 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:56.761535 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c809af1-f77c-4a46-be46-005267f863f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:56.762159 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c809af1-f77c-4a46-be46-005267f863f4 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:56.762437 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c809af1-f77c-4a46-be46-005267f863f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:56.762706 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c809af1-f77c-4a46-be46-005267f863f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:56.792165 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:56.831913 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c809af1-f77c-4a46-be46-005267f863f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:56.833282 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c809af1-f77c-4a46-be46-005267f863f4 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:56.926889 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 591/1183] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Aug 9 10:12:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 10:12:56.933653 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16b711c-b316-4fdf-808d-632d6fa89336 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:57.038265 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16b711c-b316-4fdf-808d-632d6fa89336 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:57.074845 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53692d9f-71be-4e6a-8eef-2c55adaf1bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:57.075498 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53692d9f-71be-4e6a-8eef-2c55adaf1bd6 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:57.075725 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53692d9f-71be-4e6a-8eef-2c55adaf1bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:57.075987 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53692d9f-71be-4e6a-8eef-2c55adaf1bd6 None admin] PATH_INFO: `/v3/projects/c319f8feb82f4750af91692dddd41b73` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:57.077105 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53692d9f-71be-4e6a-8eef-2c55adaf1bd6 None admin] RBAC: Authorizing `identity:get_project(project_id=c319f8feb82f4750af91692dddd41b73)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:57.078551 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53692d9f-71be-4e6a-8eef-2c55adaf1bd6 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:57.080158 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 593/1184] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Aug 9 10:12:56 2022] GET /identity/v3/projects/c319f8feb82f4750af91692dddd41b73 => generated 361 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:12:57.086904 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c809af1-f77c-4a46-be46-005267f863f4 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:57.142898 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:57.183290 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c809af1-f77c-4a46-be46-005267f863f4 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:57.215689 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdb6b63-c43a-49b8-8d7d-c2ecd815e011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:57.216269 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdb6b63-c43a-49b8-8d7d-c2ecd815e011 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:57.216547 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdb6b63-c43a-49b8-8d7d-c2ecd815e011 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:57.216818 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdb6b63-c43a-49b8-8d7d-c2ecd815e011 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:57.217527 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdb6b63-c43a-49b8-8d7d-c2ecd815e011 None admin] RBAC: Adding query filter params (role.id=89ca30cbbb634be8a96e9921aa56626b, scope.project.id=c319f8feb82f4750af91692dddd41b73, user.id=e7729590d74745129e8db70383ec7eb3) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:12:57.217835 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdb6b63-c43a-49b8-8d7d-c2ecd815e011 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:57.219266 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdb6b63-c43a-49b8-8d7d-c2ecd815e011 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:57.224424 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 592/1185] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Aug 9 10:12:57 2022] GET /identity/v3/role_assignments?user.id=e7729590d74745129e8db70383ec7eb3&scope.project.id=c319f8feb82f4750af91692dddd41b73&role.id=89ca30cbbb634be8a96e9921aa56626b => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:12:59.254795 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fdba68-64fc-434b-acda-33e7769cf92b None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:59.255349 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fdba68-64fc-434b-acda-33e7769cf92b None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:59.255349 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fdba68-64fc-434b-acda-33e7769cf92b None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:59.256570 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 594/1186] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:12:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 10:12:59.261718 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f4b02-3a08-4eff-94de-23c9c23db3c9 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:59.262211 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f4b02-3a08-4eff-94de-23c9c23db3c9 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:59.262317 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f4b02-3a08-4eff-94de-23c9c23db3c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:59.280081 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-e33f4b02-3a08-4eff-94de-23c9c23db3c9 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:12:59.281245 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-e33f4b02-3a08-4eff-94de-23c9c23db3c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:12:59.344570 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 593/1187] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:12:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 10:12:59.366952 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fdba68-64fc-434b-acda-33e7769cf92b None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:59.421898 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:59.470351 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fdba68-64fc-434b-acda-33e7769cf92b None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:59.503145 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbac4d77-fcaf-4fca-b03f-41b08688a5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:59.503757 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac4d77-fcaf-4fca-b03f-41b08688a5bb None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:59.504034 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac4d77-fcaf-4fca-b03f-41b08688a5bb None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:59.504304 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac4d77-fcaf-4fca-b03f-41b08688a5bb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:59.513974 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbac4d77-fcaf-4fca-b03f-41b08688a5bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 10:12:59.518558 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-bbac4d77-fcaf-4fca-b03f-41b08688a5bb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 10:12:59.518558 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:12:59.518558 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:12:59.518558 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:12:59.518558 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:12:59.518558 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:12:59.518558 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:12:59.518558 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:12:59.518558 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:12:59.518558 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:12:59.518558 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:12:59.518558 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:12:59.518558 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 10:12:59.518558 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 10:12:59.518558 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 10:12:59.518558 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 10:12:59.519791 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 10:12:59.519791 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 10:12:59.519791 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 10:12:59.519791 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 10:12:59.519791 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:12:59.519791 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:12:59.519791 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:12:59.519791 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:12:59.519791 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:12:59.519791 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:12:59.519791 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:12:59.519791 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:12:59.519791 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:12:59.519791 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:12:59.519791 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:12:59.519791 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:12:59.520844 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:12:59.520844 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:12:59.520844 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:12:59.520844 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:12:59.520844 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 10:12:59.520844 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 10:12:59.520844 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 10:12:59.520844 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 10:12:59.520844 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 10:12:59.520844 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 10:12:59.520844 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 10:12:59.520844 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:12:59.520844 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 595/1188] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Aug 9 10:12:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:12:59.526272 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33f4b02-3a08-4eff-94de-23c9c23db3c9 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:59.577107 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:59.621730 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33f4b02-3a08-4eff-94de-23c9c23db3c9 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:59.654555 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcca01f-5775-4f51-b464-9b2ecc363637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:59.655164 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcca01f-5775-4f51-b464-9b2ecc363637 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:59.655440 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcca01f-5775-4f51-b464-9b2ecc363637 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:59.655710 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcca01f-5775-4f51-b464-9b2ecc363637 None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:59.656359 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcca01f-5775-4f51-b464-9b2ecc363637 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:12:59.656657 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcca01f-5775-4f51-b464-9b2ecc363637 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:59.658035 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcca01f-5775-4f51-b464-9b2ecc363637 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:59.666087 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 594/1189] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Aug 9 10:12:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:12:59.671794 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbac4d77-fcaf-4fca-b03f-41b08688a5bb None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:59.769641 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbac4d77-fcaf-4fca-b03f-41b08688a5bb None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:59.781517 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:59.804808 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501ea88b-a4c7-4de5-abd1-7e9ff21818d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:59.805901 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501ea88b-a4c7-4de5-abd1-7e9ff21818d3 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:59.806183 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501ea88b-a4c7-4de5-abd1-7e9ff21818d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:59.806454 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501ea88b-a4c7-4de5-abd1-7e9ff21818d3 None admin] PATH_INFO: `/v3/users/e7729590d74745129e8db70383ec7eb3` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:59.807578 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501ea88b-a4c7-4de5-abd1-7e9ff21818d3 None admin] RBAC: Authorizing `identity:get_user(user_id=e7729590d74745129e8db70383ec7eb3)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:59.808994 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501ea88b-a4c7-4de5-abd1-7e9ff21818d3 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:59.810582 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 596/1190] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Aug 9 10:12:59 2022] GET /identity/v3/users/e7729590d74745129e8db70383ec7eb3 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:12:59.816241 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcca01f-5775-4f51-b464-9b2ecc363637 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:12:59.913442 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcca01f-5775-4f51-b464-9b2ecc363637 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:12:59.926579 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:12:59.947894 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f6a7e2-929b-4697-add3-85ca852a32f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:12:59.948513 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f6a7e2-929b-4697-add3-85ca852a32f4 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:12:59.948790 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f6a7e2-929b-4697-add3-85ca852a32f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:12:59.949062 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f6a7e2-929b-4697-add3-85ca852a32f4 None admin] PATH_INFO: `/v3/projects/c319f8feb82f4750af91692dddd41b73` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:12:59.950185 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f6a7e2-929b-4697-add3-85ca852a32f4 None admin] RBAC: Authorizing `identity:get_project(project_id=c319f8feb82f4750af91692dddd41b73)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:12:59.951613 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f6a7e2-929b-4697-add3-85ca852a32f4 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:12:59.953205 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 595/1191] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Aug 9 10:12:59 2022] GET /identity/v3/projects/c319f8feb82f4750af91692dddd41b73 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:12:59.959277 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501ea88b-a4c7-4de5-abd1-7e9ff21818d3 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:13:00.054713 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501ea88b-a4c7-4de5-abd1-7e9ff21818d3 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:13:00.087804 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c0f519-156b-4384-9b1b-e6504d41b4b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:13:00.088439 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0f519-156b-4384-9b1b-e6504d41b4b8 None admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:13:00.088717 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0f519-156b-4384-9b1b-e6504d41b4b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:13:00.088989 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0f519-156b-4384-9b1b-e6504d41b4b8 None admin] PATH_INFO: `/v3/projects/c319f8feb82f4750af91692dddd41b73/users/e7729590d74745129e8db70383ec7eb3/roles/89ca30cbbb634be8a96e9921aa56626b` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:13:00.090863 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c0f519-156b-4384-9b1b-e6504d41b4b8 None admin] RBAC: Authorizing `identity:create_grant(project_id=c319f8feb82f4750af91692dddd41b73, user_id=e7729590d74745129e8db70383ec7eb3, role_id=89ca30cbbb634be8a96e9921aa56626b)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:13:00.092279 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c0f519-156b-4384-9b1b-e6504d41b4b8 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:13:00.104952 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 597/1192] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Aug 9 10:12:59 2022] PUT /identity/v3/projects/c319f8feb82f4750af91692dddd41b73/users/e7729590d74745129e8db70383ec7eb3/roles/89ca30cbbb634be8a96e9921aa56626b => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:13:02.167508 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9657c88-4fd4-4c1e-8f06-e51321a476c2 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:13:02.168029 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9657c88-4fd4-4c1e-8f06-e51321a476c2 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:13:02.168029 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9657c88-4fd4-4c1e-8f06-e51321a476c2 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:13:02.169362 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 596/1193] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:13:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:13:02.174679 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c92e5b-fc1c-4055-b4a1-1682b5849ca3 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:13:02.175120 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c92e5b-fc1c-4055-b4a1-1682b5849ca3 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:13:02.175214 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c92e5b-fc1c-4055-b4a1-1682b5849ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:13:02.192774 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-67c92e5b-fc1c-4055-b4a1-1682b5849ca3 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:13:02.193972 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-67c92e5b-fc1c-4055-b4a1-1682b5849ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:13:02.222705 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:13:02.259209 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 598/1194] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:13:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 10:13:02.282551 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9657c88-4fd4-4c1e-8f06-e51321a476c2 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:13:02.383805 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9657c88-4fd4-4c1e-8f06-e51321a476c2 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:13:02.415698 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206f9cdb-379c-40c7-997d-3c8c18458c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:13:02.416310 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f9cdb-379c-40c7-997d-3c8c18458c00 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:13:02.416585 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f9cdb-379c-40c7-997d-3c8c18458c00 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:13:02.416854 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f9cdb-379c-40c7-997d-3c8c18458c00 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:13:02.426537 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206f9cdb-379c-40c7-997d-3c8c18458c00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 10:13:02.431792 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-206f9cdb-379c-40c7-997d-3c8c18458c00 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 10:13:02.431792 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:13:02.431792 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:13:02.431792 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:13:02.431792 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:13:02.431792 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:13:02.431792 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:13:02.431792 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:13:02.431792 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:13:02.431792 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:13:02.431792 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:13:02.431792 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:13:02.431792 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 10:13:02.431792 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 10:13:02.431792 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 10:13:02.431792 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 10:13:02.432874 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 10:13:02.432874 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 10:13:02.432874 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 10:13:02.432874 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 10:13:02.432874 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:13:02.432874 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:13:02.432874 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:13:02.432874 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:13:02.432874 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:13:02.432874 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:13:02.432874 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:13:02.432874 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:13:02.432874 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:13:02.432874 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:13:02.432874 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:13:02.432874 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:13:02.434201 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:13:02.434201 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:13:02.434201 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:13:02.434201 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:13:02.434201 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 10:13:02.434201 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 10:13:02.434201 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 10:13:02.434201 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 10:13:02.434201 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 10:13:02.434201 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 10:13:02.434201 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 10:13:02.434201 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:13:02.434201 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 597/1195] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Aug 9 10:13:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:13:02.438830 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c92e5b-fc1c-4055-b4a1-1682b5849ca3 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:13:02.534837 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c92e5b-fc1c-4055-b4a1-1682b5849ca3 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:13:02.568104 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1296b335-17ba-4bed-b8e1-8f46786a842f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:13:02.568697 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1296b335-17ba-4bed-b8e1-8f46786a842f None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:13:02.568973 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1296b335-17ba-4bed-b8e1-8f46786a842f None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:13:02.569243 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1296b335-17ba-4bed-b8e1-8f46786a842f None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:13:02.569922 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1296b335-17ba-4bed-b8e1-8f46786a842f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:13:02.570225 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1296b335-17ba-4bed-b8e1-8f46786a842f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:13:02.571777 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1296b335-17ba-4bed-b8e1-8f46786a842f None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:13:02.579410 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 599/1196] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Aug 9 10:13:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:13:02.585510 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206f9cdb-379c-40c7-997d-3c8c18458c00 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:13:02.629456 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:13:02.685337 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206f9cdb-379c-40c7-997d-3c8c18458c00 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:13:02.718987 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879968a2-ccb7-4164-8f43-eecbdec1f7d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:13:02.719590 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879968a2-ccb7-4164-8f43-eecbdec1f7d6 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:13:02.719863 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879968a2-ccb7-4164-8f43-eecbdec1f7d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:13:02.720128 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879968a2-ccb7-4164-8f43-eecbdec1f7d6 None admin] PATH_INFO: `/v3/users/e7729590d74745129e8db70383ec7eb3` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:13:02.721214 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879968a2-ccb7-4164-8f43-eecbdec1f7d6 None admin] RBAC: Authorizing `identity:get_user(user_id=e7729590d74745129e8db70383ec7eb3)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:13:02.722654 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879968a2-ccb7-4164-8f43-eecbdec1f7d6 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:13:02.724185 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 598/1197] 10.222.0.36 () {56 vars in 1177 bytes} [Tue Aug 9 10:13:02 2022] GET /identity/v3/users/e7729590d74745129e8db70383ec7eb3 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:13:02.729891 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1296b335-17ba-4bed-b8e1-8f46786a842f None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:13:02.759664 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:13:02.846746 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1296b335-17ba-4bed-b8e1-8f46786a842f None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:13:02.879484 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48669cf5-2342-4721-9347-5d8fe66a8a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:13:02.880082 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48669cf5-2342-4721-9347-5d8fe66a8a35 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:13:02.880360 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48669cf5-2342-4721-9347-5d8fe66a8a35 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:13:02.880630 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48669cf5-2342-4721-9347-5d8fe66a8a35 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:13:02.948525 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48669cf5-2342-4721-9347-5d8fe66a8a35 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:13:02.950006 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48669cf5-2342-4721-9347-5d8fe66a8a35 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:13:02.980046 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:13:03.049403 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 600/1198] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Aug 9 10:13:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 10:13:03.055657 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879968a2-ccb7-4164-8f43-eecbdec1f7d6 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:13:03.152410 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879968a2-ccb7-4164-8f43-eecbdec1f7d6 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:13:03.162179 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:13:03.185928 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b2e0d4-6107-4dd7-bec0-083c4fcd6f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:13:03.186542 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b2e0d4-6107-4dd7-bec0-083c4fcd6f6d None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:13:03.186820 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b2e0d4-6107-4dd7-bec0-083c4fcd6f6d None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:13:03.187090 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b2e0d4-6107-4dd7-bec0-083c4fcd6f6d None admin] PATH_INFO: `/v3/projects/c319f8feb82f4750af91692dddd41b73` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:13:03.188183 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b2e0d4-6107-4dd7-bec0-083c4fcd6f6d None admin] RBAC: Authorizing `identity:get_project(project_id=c319f8feb82f4750af91692dddd41b73)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:13:03.189593 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b2e0d4-6107-4dd7-bec0-083c4fcd6f6d None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:13:03.191201 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 599/1199] 10.222.0.36 () {56 vars in 1186 bytes} [Tue Aug 9 10:13:03 2022] GET /identity/v3/projects/c319f8feb82f4750af91692dddd41b73 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:13:03.197609 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48669cf5-2342-4721-9347-5d8fe66a8a35 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:13:03.296696 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48669cf5-2342-4721-9347-5d8fe66a8a35 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:13:03.325121 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:13:03.330967 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726008a4-55b0-4760-838e-f4b3d3dab510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:13:03.331546 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726008a4-55b0-4760-838e-f4b3d3dab510 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:13:03.331822 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726008a4-55b0-4760-838e-f4b3d3dab510 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:13:03.332093 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726008a4-55b0-4760-838e-f4b3d3dab510 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:13:03.332805 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726008a4-55b0-4760-838e-f4b3d3dab510 None admin] RBAC: Adding query filter params (role.id=89ca30cbbb634be8a96e9921aa56626b, scope.project.id=c319f8feb82f4750af91692dddd41b73, user.id=e7729590d74745129e8db70383ec7eb3) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:13:03.333108 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726008a4-55b0-4760-838e-f4b3d3dab510 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:13:03.334573 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726008a4-55b0-4760-838e-f4b3d3dab510 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:13:03.340482 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 601/1200] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Aug 9 10:13:03 2022] GET /identity/v3/role_assignments?user.id=e7729590d74745129e8db70383ec7eb3&scope.project.id=c319f8feb82f4750af91692dddd41b73&role.id=89ca30cbbb634be8a96e9921aa56626b => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:13:13.181934 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=11 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:13:13.338137 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=3 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:13:58.343658 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d97e362-077b-4e93-9d4e-994b5b49b3ba None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:13:58.344215 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d97e362-077b-4e93-9d4e-994b5b49b3ba None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:13:58.344215 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d97e362-077b-4e93-9d4e-994b5b49b3ba None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:13:58.345662 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 600/1201] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:13:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:13:58.354625 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a65e7e7-c493-40f0-aa63-e693e8751cb9 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:13:58.354625 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a65e7e7-c493-40f0-aa63-e693e8751cb9 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:13:58.354625 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a65e7e7-c493-40f0-aa63-e693e8751cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:13:58.374745 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-9a65e7e7-c493-40f0-aa63-e693e8751cb9 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:13:58.376360 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-9a65e7e7-c493-40f0-aa63-e693e8751cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:13:58.469879 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 602/1202] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:13:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 10:13:58.493139 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d97e362-077b-4e93-9d4e-994b5b49b3ba None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:13:58.634984 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d97e362-077b-4e93-9d4e-994b5b49b3ba None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:13:58.681109 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eda7578-f9db-49c7-91b1-a6f63668aef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:13:58.681783 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda7578-f9db-49c7-91b1-a6f63668aef7 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:13:58.682063 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda7578-f9db-49c7-91b1-a6f63668aef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:13:58.682336 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda7578-f9db-49c7-91b1-a6f63668aef7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:13:58.694884 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eda7578-f9db-49c7-91b1-a6f63668aef7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:13:58.696347 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eda7578-f9db-49c7-91b1-a6f63668aef7 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:13:58.715502 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-3eda7578-f9db-49c7-91b1-a6f63668aef7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:13:58.715502 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:13:58.715502 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:13:58.715502 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:13:58.715502 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:13:58.715502 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:13:58.715502 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:13:58.715502 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:13:58.715502 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:13:58.715502 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:13:58.715502 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:13:58.715502 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:13:58.715502 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 10:13:58.715502 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 10:13:58.715502 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 10:13:58.715502 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 10:13:58.716692 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:13:58.716692 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:13:58.716692 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:13:58.716692 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:13:58.716692 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:13:58.716692 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:13:58.716692 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:13:58.716692 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:13:58.716692 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:13:58.716692 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:13:58.716692 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:13:58.716692 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:13:58.716692 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:13:58.716692 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:13:58.716692 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:13:58.716692 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:13:58.716692 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 10:13:58.717703 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 10:13:58.717703 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:13:58.717703 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:13:58.721632 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 601/1203] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:13:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:13:58.723307 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a65e7e7-c493-40f0-aa63-e693e8751cb9 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:13:58.857985 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a65e7e7-c493-40f0-aa63-e693e8751cb9 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:13:58.895109 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:13:58.903407 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bedadb-69de-46d5-9030-800fa908a375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:13:58.904230 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bedadb-69de-46d5-9030-800fa908a375 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:13:58.904509 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bedadb-69de-46d5-9030-800fa908a375 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:13:58.904780 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bedadb-69de-46d5-9030-800fa908a375 None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:13:58.905508 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bedadb-69de-46d5-9030-800fa908a375 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:13:58.906000 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bedadb-69de-46d5-9030-800fa908a375 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:13:58.907919 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bedadb-69de-46d5-9030-800fa908a375 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:13:58.926557 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 603/1204] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Aug 9 10:13:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:13:58.931081 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eda7578-f9db-49c7-91b1-a6f63668aef7 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:13:59.027497 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:13:59.085781 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eda7578-f9db-49c7-91b1-a6f63668aef7 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:13:59.131416 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a55aa9a-7919-482f-bc0b-58fbb274f10e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:13:59.132036 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a55aa9a-7919-482f-bc0b-58fbb274f10e None admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:13:59.132319 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a55aa9a-7919-482f-bc0b-58fbb274f10e None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:13:59.132633 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a55aa9a-7919-482f-bc0b-58fbb274f10e None admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:13:59.133303 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a55aa9a-7919-482f-bc0b-58fbb274f10e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:13:59.134783 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a55aa9a-7919-482f-bc0b-58fbb274f10e None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:13:59.163311 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 602/1205] 10.222.0.36 () {60 vars in 1132 bytes} [Tue Aug 9 10:13:58 2022] POST /identity/v3/users => generated 251 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:14:01.492999 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ae320-c65c-4682-8d42-668879d2b971 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:01.493905 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ae320-c65c-4682-8d42-668879d2b971 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:01.493905 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ae320-c65c-4682-8d42-668879d2b971 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:01.495198 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 604/1206] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:14:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:14:01.500973 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61759876-82ae-4771-af3e-c778fe26f4d1 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:01.501390 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61759876-82ae-4771-af3e-c778fe26f4d1 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:01.501541 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61759876-82ae-4771-af3e-c778fe26f4d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:01.520299 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-61759876-82ae-4771-af3e-c778fe26f4d1 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:14:01.522151 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-61759876-82ae-4771-af3e-c778fe26f4d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:14:01.595612 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 603/1207] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:14:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 10:14:01.623087 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1ae320-c65c-4682-8d42-668879d2b971 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:14:01.737609 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1ae320-c65c-4682-8d42-668879d2b971 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:14:01.773962 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ccccfe-648d-44e4-8c9c-6deebff37d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:14:01.774514 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ccccfe-648d-44e4-8c9c-6deebff37d33 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:01.774794 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ccccfe-648d-44e4-8c9c-6deebff37d33 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:01.775064 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ccccfe-648d-44e4-8c9c-6deebff37d33 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:01.786425 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ccccfe-648d-44e4-8c9c-6deebff37d33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 10:14:01.792158 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-83ccccfe-648d-44e4-8c9c-6deebff37d33 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 10:14:01.792158 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:14:01.792158 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:14:01.792158 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:14:01.792158 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:14:01.792158 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:14:01.792158 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:14:01.792158 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:14:01.792158 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:14:01.792158 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:14:01.792158 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:14:01.792158 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:14:01.792158 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 10:14:01.792158 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 10:14:01.792158 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 10:14:01.792158 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 10:14:01.793179 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 10:14:01.793179 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 10:14:01.793179 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 10:14:01.793179 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 10:14:01.793179 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:14:01.793179 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:14:01.793179 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:14:01.793179 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:14:01.793179 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:14:01.793179 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:14:01.793179 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:14:01.793179 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:14:01.793179 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:14:01.793179 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:14:01.793179 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:14:01.793179 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:14:01.794167 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:14:01.794167 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:14:01.794167 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:14:01.794167 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:14:01.794167 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 10:14:01.794167 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 10:14:01.794167 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 10:14:01.794167 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 10:14:01.794167 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 10:14:01.794167 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 10:14:01.794167 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 10:14:01.794167 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:14:01.798118 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 605/1208] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Aug 9 10:14:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:14:01.799398 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61759876-82ae-4771-af3e-c778fe26f4d1 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:14:01.843043 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:14:01.913220 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61759876-82ae-4771-af3e-c778fe26f4d1 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:14:01.959400 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbb154e-613e-47ce-bda0-50fc44f1db3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:14:01.960209 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbb154e-613e-47ce-bda0-50fc44f1db3e None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:01.960434 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbb154e-613e-47ce-bda0-50fc44f1db3e None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:01.960738 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbb154e-613e-47ce-bda0-50fc44f1db3e None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:01.961381 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbb154e-613e-47ce-bda0-50fc44f1db3e None admin] RBAC: Adding query filter params (name=service) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:14:01.961676 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbb154e-613e-47ce-bda0-50fc44f1db3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:14:01.963144 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbb154e-613e-47ce-bda0-50fc44f1db3e None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:14:01.973544 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 604/1209] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Aug 9 10:14:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:14:01.979994 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ccccfe-648d-44e4-8c9c-6deebff37d33 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:14:02.035420 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:14:02.094061 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ccccfe-648d-44e4-8c9c-6deebff37d33 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:14:02.139716 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0864e12e-87d3-4c6a-bc00-24c111593d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:14:02.139716 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0864e12e-87d3-4c6a-bc00-24c111593d2b None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:02.139716 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0864e12e-87d3-4c6a-bc00-24c111593d2b None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:02.140097 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0864e12e-87d3-4c6a-bc00-24c111593d2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:02.151960 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0864e12e-87d3-4c6a-bc00-24c111593d2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:14:02.153398 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0864e12e-87d3-4c6a-bc00-24c111593d2b None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:14:02.169226 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-0864e12e-87d3-4c6a-bc00-24c111593d2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:14:02.169226 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:14:02.169226 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:14:02.169226 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:14:02.169226 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:14:02.169226 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:14:02.169226 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:14:02.169226 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:14:02.169226 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:14:02.169226 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:14:02.169226 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:14:02.169226 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:14:02.169226 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 10:14:02.169226 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 10:14:02.169226 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 10:14:02.169226 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 10:14:02.170379 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:14:02.170379 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:14:02.170379 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:14:02.170379 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:14:02.170379 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:14:02.170379 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:14:02.170379 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:14:02.170379 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:14:02.170379 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:14:02.170379 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:14:02.170379 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:14:02.170379 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:14:02.170379 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:14:02.170379 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:14:02.170379 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:14:02.170379 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:14:02.170379 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 10:14:02.171309 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 10:14:02.171309 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:14:02.171309 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:14:02.171309 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 606/1210] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:14:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:14:02.176407 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbb154e-613e-47ce-bda0-50fc44f1db3e None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:14:02.294851 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:14:02.298797 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbb154e-613e-47ce-bda0-50fc44f1db3e None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:14:02.337665 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a262cd0e-f692-4d2e-9e6a-8f0a3f58e829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:14:02.338293 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262cd0e-f692-4d2e-9e6a-8f0a3f58e829 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:02.338576 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262cd0e-f692-4d2e-9e6a-8f0a3f58e829 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:02.338914 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262cd0e-f692-4d2e-9e6a-8f0a3f58e829 None admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:02.339574 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a262cd0e-f692-4d2e-9e6a-8f0a3f58e829 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:14:02.339906 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a262cd0e-f692-4d2e-9e6a-8f0a3f58e829 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:14:02.341464 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a262cd0e-f692-4d2e-9e6a-8f0a3f58e829 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:14:02.357897 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 605/1211] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Aug 9 10:14:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:14:02.361028 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0864e12e-87d3-4c6a-bc00-24c111593d2b None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:14:02.492728 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0864e12e-87d3-4c6a-bc00-24c111593d2b None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:14:02.494912 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:14:02.531437 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028598b6-4ea2-45d5-8eee-6eddd6cbb272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:14:02.532056 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028598b6-4ea2-45d5-8eee-6eddd6cbb272 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:02.532334 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028598b6-4ea2-45d5-8eee-6eddd6cbb272 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:02.532599 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028598b6-4ea2-45d5-8eee-6eddd6cbb272 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:02.541984 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028598b6-4ea2-45d5-8eee-6eddd6cbb272 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:14:02.543478 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028598b6-4ea2-45d5-8eee-6eddd6cbb272 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:14:02.556937 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-028598b6-4ea2-45d5-8eee-6eddd6cbb272 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 09 10:14:02.556937 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:14:02.556937 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:14:02.556937 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:14:02.556937 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:14:02.556937 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:14:02.556937 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:14:02.556937 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:14:02.556937 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:14:02.556937 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:14:02.556937 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:14:02.556937 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:14:02.556937 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 10:14:02.556937 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 10:14:02.556937 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 10:14:02.556937 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 10:14:02.558010 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:14:02.558010 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:14:02.558010 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 10:14:02.558010 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 10:14:02.558010 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 10:14:02.558010 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 10:14:02.558010 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:14:02.558010 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:14:02.558010 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:14:02.558010 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:14:02.558010 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:14:02.558010 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:14:02.558010 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:14:02.558010 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:14:02.558010 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:14:02.558010 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:14:02.558010 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:14:02.558010 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:14:02.558967 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:14:02.558967 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:14:02.558967 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 10:14:02.558967 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 10:14:02.558967 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 10:14:02.558967 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 10:14:02.558967 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 10:14:02.558967 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 10:14:02.558967 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 09 10:14:02.558967 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:14:02.558967 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 607/1212] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:14:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:14:02.564185 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a262cd0e-f692-4d2e-9e6a-8f0a3f58e829 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:14:02.693429 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a262cd0e-f692-4d2e-9e6a-8f0a3f58e829 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:14:02.737341 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20183c6d-1b45-45b7-b095-7fd2322b8e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:14:02.738005 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20183c6d-1b45-45b7-b095-7fd2322b8e7f None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:02.738254 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20183c6d-1b45-45b7-b095-7fd2322b8e7f None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:02.738527 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20183c6d-1b45-45b7-b095-7fd2322b8e7f None admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:02.739242 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20183c6d-1b45-45b7-b095-7fd2322b8e7f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:14:02.739545 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20183c6d-1b45-45b7-b095-7fd2322b8e7f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:14:02.741640 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20183c6d-1b45-45b7-b095-7fd2322b8e7f None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:14:02.760267 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 606/1213] 10.222.0.36 () {56 vars in 1143 bytes} [Tue Aug 9 10:14:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:14:02.766230 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028598b6-4ea2-45d5-8eee-6eddd6cbb272 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:14:02.888661 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028598b6-4ea2-45d5-8eee-6eddd6cbb272 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:14:02.936419 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7a176a-e8fa-48d5-8618-fa31924222c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:14:02.937050 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a176a-e8fa-48d5-8618-fa31924222c5 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:02.937328 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a176a-e8fa-48d5-8618-fa31924222c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:02.937597 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a176a-e8fa-48d5-8618-fa31924222c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:02.979568 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:14:03.023330 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7a176a-e8fa-48d5-8618-fa31924222c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:14:03.026646 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7a176a-e8fa-48d5-8618-fa31924222c5 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:14:03.140794 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 608/1214] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Aug 9 10:14:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 10:14:03.146814 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20183c6d-1b45-45b7-b095-7fd2322b8e7f None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:14:03.169392 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:14:03.264673 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20183c6d-1b45-45b7-b095-7fd2322b8e7f None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:14:03.310572 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2db39c-bcd7-4233-844a-c261526c2f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:14:03.311300 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2db39c-bcd7-4233-844a-c261526c2f72 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:03.311652 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2db39c-bcd7-4233-844a-c261526c2f72 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:03.311938 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2db39c-bcd7-4233-844a-c261526c2f72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:03.323938 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2db39c-bcd7-4233-844a-c261526c2f72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:14:03.325488 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2db39c-bcd7-4233-844a-c261526c2f72 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:14:03.343075 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-0f2db39c-bcd7-4233-844a-c261526c2f72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:14:03.343075 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:14:03.343075 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:14:03.343075 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:14:03.343075 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:14:03.343075 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:14:03.343075 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:14:03.343075 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:14:03.343075 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:14:03.343075 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:14:03.343075 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:14:03.343075 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:14:03.343075 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 10:14:03.343075 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 10:14:03.343075 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 10:14:03.343075 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 10:14:03.344143 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:14:03.344143 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:14:03.344143 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:14:03.344143 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:14:03.344143 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:14:03.344143 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:14:03.344143 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:14:03.344143 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:14:03.344143 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:14:03.344143 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:14:03.344143 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:14:03.344143 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:14:03.344143 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:14:03.344143 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:14:03.344143 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:14:03.344143 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:14:03.344143 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 10:14:03.345061 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 10:14:03.345061 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:14:03.345061 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:14:03.345061 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 607/1215] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:14:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:14:03.353872 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7a176a-e8fa-48d5-8618-fa31924222c5 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:14:03.429881 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:14:03.476328 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7a176a-e8fa-48d5-8618-fa31924222c5 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:14:03.515741 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c9035a-1262-459c-ade5-f8edba592540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:14:03.516436 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c9035a-1262-459c-ade5-f8edba592540 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:03.516672 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c9035a-1262-459c-ade5-f8edba592540 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:03.517040 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c9035a-1262-459c-ade5-f8edba592540 None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:03.517730 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c9035a-1262-459c-ade5-f8edba592540 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:14:03.518106 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c9035a-1262-459c-ade5-f8edba592540 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:14:03.519955 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c9035a-1262-459c-ade5-f8edba592540 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:14:03.535233 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 609/1216] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Aug 9 10:14:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:14:03.541908 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2db39c-bcd7-4233-844a-c261526c2f72 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:14:03.628114 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:14:03.661131 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2db39c-bcd7-4233-844a-c261526c2f72 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:14:03.697247 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6eb158-bdda-4ed7-8f01-a93d920e9af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:14:03.697890 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6eb158-bdda-4ed7-8f01-a93d920e9af2 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:03.698247 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6eb158-bdda-4ed7-8f01-a93d920e9af2 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:03.698606 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6eb158-bdda-4ed7-8f01-a93d920e9af2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:03.705830 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6eb158-bdda-4ed7-8f01-a93d920e9af2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:14:03.707336 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6eb158-bdda-4ed7-8f01-a93d920e9af2 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:14:03.719419 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-5e6eb158-bdda-4ed7-8f01-a93d920e9af2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 10:14:03.719419 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:14:03.719419 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:14:03.719419 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:14:03.719419 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:14:03.719419 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:14:03.719419 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:14:03.719419 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:14:03.719419 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:14:03.719419 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:14:03.719419 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:14:03.719419 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:14:03.719419 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 10:14:03.719419 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 10:14:03.719419 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 10:14:03.720460 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 10:14:03.720460 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:14:03.720460 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:14:03.720460 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:14:03.720460 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:14:03.720460 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:14:03.720460 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:14:03.720460 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:14:03.720460 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:14:03.720460 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:14:03.720460 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:14:03.720460 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:14:03.720460 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:14:03.720460 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:14:03.720460 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:14:03.720460 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:14:03.720460 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:14:03.721387 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 10:14:03.721387 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 10:14:03.721387 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 10:14:03.721387 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 10:14:03.721387 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 10:14:03.721387 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 10:14:03.721387 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 10:14:03.721387 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:14:03.721387 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 608/1217] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Aug 9 10:14:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 10:14:03.726874 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c9035a-1262-459c-ade5-f8edba592540 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:14:03.840213 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c9035a-1262-459c-ade5-f8edba592540 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:14:03.866260 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:14:03.879155 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cb292c-8fef-430d-9f44-1a800e8086e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:14:03.879892 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb292c-8fef-430d-9f44-1a800e8086e6 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:03.880264 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb292c-8fef-430d-9f44-1a800e8086e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:03.880758 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb292c-8fef-430d-9f44-1a800e8086e6 None admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:03.881524 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cb292c-8fef-430d-9f44-1a800e8086e6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:14:03.881944 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cb292c-8fef-430d-9f44-1a800e8086e6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:14:03.883558 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cb292c-8fef-430d-9f44-1a800e8086e6 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:14:03.898917 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 610/1218] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Aug 9 10:14:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:14:03.904698 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6eb158-bdda-4ed7-8f01-a93d920e9af2 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:14:04.030548 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6eb158-bdda-4ed7-8f01-a93d920e9af2 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:14:04.059681 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:14:04.066667 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c62a23-17f1-487c-a7cd-d5fcaae26db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:14:04.067375 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c62a23-17f1-487c-a7cd-d5fcaae26db4 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:04.067750 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c62a23-17f1-487c-a7cd-d5fcaae26db4 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:04.068621 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c62a23-17f1-487c-a7cd-d5fcaae26db4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:04.069499 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c62a23-17f1-487c-a7cd-d5fcaae26db4 None admin] RBAC: Adding query filter params (role.id=1252647548644b48900ef09f1df438fd, scope.project.id=28891cf6239a43469326a864fb0d216c, user.id=c4d3b6a332394adf9e1b81ee9c171c48) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:14:04.069973 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c62a23-17f1-487c-a7cd-d5fcaae26db4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:14:04.071484 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c62a23-17f1-487c-a7cd-d5fcaae26db4 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:14:04.077287 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 609/1219] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Aug 9 10:14:03 2022] GET /identity/v3/role_assignments?user.id=c4d3b6a332394adf9e1b81ee9c171c48&scope.project.id=28891cf6239a43469326a864fb0d216c&role.id=1252647548644b48900ef09f1df438fd => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:14:06.273088 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3086785-f4be-4382-8a8a-32914e4a616b None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:06.273629 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3086785-f4be-4382-8a8a-32914e4a616b None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:06.273629 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3086785-f4be-4382-8a8a-32914e4a616b None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:06.277965 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 611/1220] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:14:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:14:06.280975 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0152ba-91df-4110-80c2-b97d75b334be None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:06.281457 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0152ba-91df-4110-80c2-b97d75b334be None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:06.281617 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0152ba-91df-4110-80c2-b97d75b334be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:06.302869 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-ec0152ba-91df-4110-80c2-b97d75b334be None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:14:06.304168 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-ec0152ba-91df-4110-80c2-b97d75b334be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:14:06.375622 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 610/1221] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:14:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 10:14:06.406951 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3086785-f4be-4382-8a8a-32914e4a616b None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:14:06.535898 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3086785-f4be-4382-8a8a-32914e4a616b None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:14:06.574350 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a871a73f-295b-486f-9edf-58912f50fc19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:14:06.575179 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a871a73f-295b-486f-9edf-58912f50fc19 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:06.575460 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a871a73f-295b-486f-9edf-58912f50fc19 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:06.575737 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a871a73f-295b-486f-9edf-58912f50fc19 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:06.587022 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a871a73f-295b-486f-9edf-58912f50fc19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 10:14:06.592730 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-a871a73f-295b-486f-9edf-58912f50fc19 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 10:14:06.592730 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:14:06.592730 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:14:06.592730 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:14:06.592730 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:14:06.592730 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:14:06.592730 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:14:06.592730 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:14:06.592730 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:14:06.592730 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:14:06.592730 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:14:06.592730 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:14:06.592730 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 10:14:06.592730 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 10:14:06.592730 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 10:14:06.592730 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 10:14:06.594036 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 10:14:06.594036 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 10:14:06.594036 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 10:14:06.594036 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 10:14:06.594036 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:14:06.594036 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:14:06.594036 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:14:06.594036 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:14:06.594036 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:14:06.594036 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:14:06.594036 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:14:06.594036 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:14:06.594036 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:14:06.594036 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:14:06.594036 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:14:06.594036 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:14:06.600051 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:14:06.600051 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:14:06.600051 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:14:06.600051 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:14:06.600051 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 10:14:06.600051 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 10:14:06.600051 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 10:14:06.600051 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 10:14:06.600051 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 10:14:06.600051 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 10:14:06.600051 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 10:14:06.600051 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:14:06.600051 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 612/1222] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Aug 9 10:14:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:14:06.602258 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0152ba-91df-4110-80c2-b97d75b334be None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:14:06.717235 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0152ba-91df-4110-80c2-b97d75b334be None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:14:06.744843 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:14:06.757807 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b048c34-dd82-40fd-82e7-934b8f57885e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:14:06.758664 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b048c34-dd82-40fd-82e7-934b8f57885e None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:06.758942 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b048c34-dd82-40fd-82e7-934b8f57885e None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:06.759197 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b048c34-dd82-40fd-82e7-934b8f57885e None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:06.759845 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b048c34-dd82-40fd-82e7-934b8f57885e None admin] RBAC: Adding query filter params (name=service) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:14:06.760140 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b048c34-dd82-40fd-82e7-934b8f57885e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:14:06.761486 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b048c34-dd82-40fd-82e7-934b8f57885e None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:14:06.769194 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 611/1223] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Aug 9 10:14:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:14:06.775234 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a871a73f-295b-486f-9edf-58912f50fc19 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:14:06.828508 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:14:06.897211 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a871a73f-295b-486f-9edf-58912f50fc19 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:14:06.937696 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dbb3d4-ec3b-4c6c-a2bc-ce06352d3e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:14:06.938385 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dbb3d4-ec3b-4c6c-a2bc-ce06352d3e0e None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:06.938666 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dbb3d4-ec3b-4c6c-a2bc-ce06352d3e0e None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:06.938934 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dbb3d4-ec3b-4c6c-a2bc-ce06352d3e0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:06.950196 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dbb3d4-ec3b-4c6c-a2bc-ce06352d3e0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:14:06.951659 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dbb3d4-ec3b-4c6c-a2bc-ce06352d3e0e None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:14:06.966173 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-f1dbb3d4-ec3b-4c6c-a2bc-ce06352d3e0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:14:06.966173 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:14:06.966173 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:14:06.966173 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:14:06.966173 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:14:06.966173 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:14:06.966173 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:14:06.966173 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:14:06.966173 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:14:06.966173 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:14:06.966173 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:14:06.966173 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:14:06.966173 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 10:14:06.966173 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 10:14:06.966173 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 10:14:06.966173 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 10:14:06.967231 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:14:06.967231 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:14:06.967231 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:14:06.967231 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:14:06.967231 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:14:06.967231 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:14:06.967231 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:14:06.967231 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:14:06.967231 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:14:06.967231 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:14:06.967231 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:14:06.967231 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:14:06.967231 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:14:06.967231 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:14:06.967231 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:14:06.967231 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:14:06.967231 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 10:14:06.968147 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 10:14:06.968147 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:14:06.968147 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:14:06.968147 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 613/1224] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:14:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:14:06.973084 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b048c34-dd82-40fd-82e7-934b8f57885e None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:14:07.074664 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b048c34-dd82-40fd-82e7-934b8f57885e None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:14:07.122267 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deef6704-5e31-4520-a72a-bd62b59dd528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:14:07.122771 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef6704-5e31-4520-a72a-bd62b59dd528 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:07.123045 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef6704-5e31-4520-a72a-bd62b59dd528 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:07.123375 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef6704-5e31-4520-a72a-bd62b59dd528 None admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:07.123999 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deef6704-5e31-4520-a72a-bd62b59dd528 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:14:07.124333 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deef6704-5e31-4520-a72a-bd62b59dd528 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:14:07.125883 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deef6704-5e31-4520-a72a-bd62b59dd528 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:14:07.144209 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 612/1225] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Aug 9 10:14:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:14:07.150180 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dbb3d4-ec3b-4c6c-a2bc-ce06352d3e0e None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:14:07.253113 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:14:07.259884 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dbb3d4-ec3b-4c6c-a2bc-ce06352d3e0e None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:14:07.292903 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14be077-601f-4753-ba56-78955f40bbcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:14:07.293539 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14be077-601f-4753-ba56-78955f40bbcc None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:07.293790 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14be077-601f-4753-ba56-78955f40bbcc None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:07.294086 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14be077-601f-4753-ba56-78955f40bbcc None admin] PATH_INFO: `/v3/users/placement` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:07.302115 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14be077-601f-4753-ba56-78955f40bbcc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:14:07.304293 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14be077-601f-4753-ba56-78955f40bbcc None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:14:07.315207 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-a14be077-601f-4753-ba56-78955f40bbcc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 09 10:14:07.315207 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:14:07.315207 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:14:07.315207 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:14:07.315207 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:14:07.315207 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:14:07.315207 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:14:07.315207 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:14:07.315207 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:14:07.315207 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:14:07.315207 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:14:07.315207 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:14:07.315207 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 10:14:07.315207 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 10:14:07.315207 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 10:14:07.315207 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 10:14:07.316362 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:14:07.316362 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:14:07.316362 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 10:14:07.316362 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 10:14:07.316362 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 10:14:07.316362 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 10:14:07.316362 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:14:07.316362 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:14:07.316362 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:14:07.316362 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:14:07.316362 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:14:07.316362 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:14:07.316362 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:14:07.316362 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:14:07.316362 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:14:07.316362 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:14:07.316362 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:14:07.316362 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:14:07.318133 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:14:07.318133 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:14:07.318133 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 10:14:07.318133 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 10:14:07.318133 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 10:14:07.318133 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 10:14:07.318133 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 10:14:07.318133 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 10:14:07.318133 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 09 10:14:07.318133 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:14:07.318133 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 614/1226] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:14:07 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:14:07.322495 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deef6704-5e31-4520-a72a-bd62b59dd528 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:14:07.371545 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:14:07.431257 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deef6704-5e31-4520-a72a-bd62b59dd528 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:14:07.470607 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe99da3-06b0-4d2a-a8b9-50dec974d56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:14:07.471221 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe99da3-06b0-4d2a-a8b9-50dec974d56b None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:07.471501 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe99da3-06b0-4d2a-a8b9-50dec974d56b None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:07.471779 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe99da3-06b0-4d2a-a8b9-50dec974d56b None admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:07.472502 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe99da3-06b0-4d2a-a8b9-50dec974d56b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:14:07.472822 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe99da3-06b0-4d2a-a8b9-50dec974d56b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:14:07.474302 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe99da3-06b0-4d2a-a8b9-50dec974d56b None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:14:07.492537 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 613/1227] 10.222.0.36 () {56 vars in 1143 bytes} [Tue Aug 9 10:14:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:14:07.498391 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14be077-601f-4753-ba56-78955f40bbcc None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:14:07.615158 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14be077-601f-4753-ba56-78955f40bbcc None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:14:07.657245 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1714e615-fb52-4b31-9906-ea4dcfb5d5aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:14:07.657978 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1714e615-fb52-4b31-9906-ea4dcfb5d5aa None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:07.658294 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1714e615-fb52-4b31-9906-ea4dcfb5d5aa None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:07.658567 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1714e615-fb52-4b31-9906-ea4dcfb5d5aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:07.671808 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1714e615-fb52-4b31-9906-ea4dcfb5d5aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:14:07.673296 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1714e615-fb52-4b31-9906-ea4dcfb5d5aa None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:14:07.688890 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-1714e615-fb52-4b31-9906-ea4dcfb5d5aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:14:07.688890 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:14:07.688890 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:14:07.688890 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:14:07.688890 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:14:07.688890 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:14:07.688890 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:14:07.688890 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:14:07.688890 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:14:07.688890 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:14:07.688890 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:14:07.688890 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:14:07.688890 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 10:14:07.688890 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 10:14:07.688890 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 10:14:07.688890 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 10:14:07.690307 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:14:07.690307 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:14:07.690307 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:14:07.690307 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:14:07.690307 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:14:07.690307 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:14:07.690307 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:14:07.690307 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:14:07.690307 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:14:07.690307 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:14:07.690307 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:14:07.690307 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:14:07.690307 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:14:07.690307 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:14:07.690307 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:14:07.690307 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:14:07.690307 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 10:14:07.691573 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 10:14:07.691573 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:14:07.691573 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:14:07.691573 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 615/1228] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:14:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:14:07.696541 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe99da3-06b0-4d2a-a8b9-50dec974d56b None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:14:07.817278 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe99da3-06b0-4d2a-a8b9-50dec974d56b None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:14:07.820309 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:14:07.857680 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9879222e-b1e5-4cdb-8c7a-77faaf2f9c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:14:07.858289 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9879222e-b1e5-4cdb-8c7a-77faaf2f9c1c None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:07.858568 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9879222e-b1e5-4cdb-8c7a-77faaf2f9c1c None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:07.858849 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9879222e-b1e5-4cdb-8c7a-77faaf2f9c1c None admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:07.859567 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9879222e-b1e5-4cdb-8c7a-77faaf2f9c1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:14:07.859857 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9879222e-b1e5-4cdb-8c7a-77faaf2f9c1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:14:07.861386 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9879222e-b1e5-4cdb-8c7a-77faaf2f9c1c None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:14:07.874207 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 614/1229] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Aug 9 10:14:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:14:07.880733 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1714e615-fb52-4b31-9906-ea4dcfb5d5aa None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:14:07.890844 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:14:07.991347 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1714e615-fb52-4b31-9906-ea4dcfb5d5aa None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:14:08.026578 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e6e806-d481-4999-8dbc-acd7bcfed786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:14:08.027206 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e6e806-d481-4999-8dbc-acd7bcfed786 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:08.027475 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e6e806-d481-4999-8dbc-acd7bcfed786 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:08.027744 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e6e806-d481-4999-8dbc-acd7bcfed786 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:08.034547 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e6e806-d481-4999-8dbc-acd7bcfed786 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:14:08.035981 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e6e806-d481-4999-8dbc-acd7bcfed786 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:14:08.048912 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-18e6e806-d481-4999-8dbc-acd7bcfed786 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 10:14:08.048912 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:14:08.048912 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:14:08.048912 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:14:08.048912 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:14:08.048912 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:14:08.048912 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:14:08.048912 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:14:08.048912 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:14:08.048912 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:14:08.048912 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:14:08.048912 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:14:08.048912 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 10:14:08.048912 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 10:14:08.048912 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 10:14:08.050089 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 10:14:08.050089 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:14:08.050089 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:14:08.050089 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:14:08.050089 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:14:08.050089 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:14:08.050089 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:14:08.050089 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:14:08.050089 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:14:08.050089 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:14:08.050089 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:14:08.050089 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:14:08.050089 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:14:08.050089 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:14:08.050089 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:14:08.050089 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:14:08.050089 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:14:08.051192 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 10:14:08.051192 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 10:14:08.051192 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 10:14:08.051192 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 10:14:08.051192 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 10:14:08.051192 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 10:14:08.051192 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 10:14:08.051192 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:14:08.051192 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 616/1230] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Aug 9 10:14:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:14:08.058187 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9879222e-b1e5-4cdb-8c7a-77faaf2f9c1c None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:14:08.167650 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9879222e-b1e5-4cdb-8c7a-77faaf2f9c1c None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:14:08.206784 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656c9ed7-c3d6-4d4d-895d-1656eb8948fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:14:08.207465 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c9ed7-c3d6-4d4d-895d-1656eb8948fd None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:08.207848 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c9ed7-c3d6-4d4d-895d-1656eb8948fd None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:08.208185 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c9ed7-c3d6-4d4d-895d-1656eb8948fd None admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:08.209914 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656c9ed7-c3d6-4d4d-895d-1656eb8948fd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:14:08.210355 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656c9ed7-c3d6-4d4d-895d-1656eb8948fd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:14:08.212250 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656c9ed7-c3d6-4d4d-895d-1656eb8948fd None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:14:08.226081 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 615/1231] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Aug 9 10:14:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:14:08.232618 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e6e806-d481-4999-8dbc-acd7bcfed786 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:14:08.306550 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:14:08.346871 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e6e806-d481-4999-8dbc-acd7bcfed786 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:14:08.383138 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504e1df9-2796-4808-a3c4-7937f6825c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:14:08.383959 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e1df9-2796-4808-a3c4-7937f6825c7f None admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:08.384328 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e1df9-2796-4808-a3c4-7937f6825c7f None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:08.384720 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e1df9-2796-4808-a3c4-7937f6825c7f None admin] PATH_INFO: `/v3/projects/28891cf6239a43469326a864fb0d216c/users/c4d3b6a332394adf9e1b81ee9c171c48/roles/1252647548644b48900ef09f1df438fd` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:08.401405 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504e1df9-2796-4808-a3c4-7937f6825c7f None admin] RBAC: Authorizing `identity:create_grant(project_id=28891cf6239a43469326a864fb0d216c, user_id=c4d3b6a332394adf9e1b81ee9c171c48, role_id=1252647548644b48900ef09f1df438fd)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:14:08.402890 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504e1df9-2796-4808-a3c4-7937f6825c7f None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:14:08.416075 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 617/1232] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Aug 9 10:14:08 2022] PUT /identity/v3/projects/28891cf6239a43469326a864fb0d216c/users/c4d3b6a332394adf9e1b81ee9c171c48/roles/1252647548644b48900ef09f1df438fd => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:14:10.560610 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d84545-7055-420a-8f88-d1d172c9440a None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:10.561145 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d84545-7055-420a-8f88-d1d172c9440a None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:10.561145 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d84545-7055-420a-8f88-d1d172c9440a None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:10.562550 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 616/1233] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:14:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 10:14:10.567986 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85e5e85-e2db-4cca-a5e0-26937328946b None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:10.568423 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85e5e85-e2db-4cca-a5e0-26937328946b None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:10.568532 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85e5e85-e2db-4cca-a5e0-26937328946b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:10.586852 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-c85e5e85-e2db-4cca-a5e0-26937328946b None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:14:10.588062 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-c85e5e85-e2db-4cca-a5e0-26937328946b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:14:10.676897 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 618/1234] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:14:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 10:14:10.700840 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d84545-7055-420a-8f88-d1d172c9440a None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:14:10.730481 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:14:10.816674 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d84545-7055-420a-8f88-d1d172c9440a None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:14:10.852510 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60bfd29-6417-4363-a682-b35c4fd343fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:14:10.853137 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60bfd29-6417-4363-a682-b35c4fd343fa None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:10.853413 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60bfd29-6417-4363-a682-b35c4fd343fa None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:10.853678 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60bfd29-6417-4363-a682-b35c4fd343fa None admin] PATH_INFO: `/v3/roles/service` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:10.863629 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60bfd29-6417-4363-a682-b35c4fd343fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 10:14:10.868994 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-c60bfd29-6417-4363-a682-b35c4fd343fa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 09 10:14:10.868994 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:14:10.868994 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:14:10.868994 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:14:10.868994 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:14:10.868994 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:14:10.868994 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:14:10.868994 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:14:10.868994 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:14:10.868994 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:14:10.868994 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:14:10.868994 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:14:10.868994 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 10:14:10.868994 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 10:14:10.868994 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 10:14:10.868994 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 10:14:10.875557 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 10:14:10.875557 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 10:14:10.875557 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 10:14:10.875557 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 10:14:10.875557 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:14:10.875557 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:14:10.875557 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:14:10.875557 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:14:10.875557 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:14:10.875557 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:14:10.875557 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:14:10.875557 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:14:10.875557 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:14:10.875557 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:14:10.875557 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:14:10.875557 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:14:10.876417 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:14:10.876417 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:14:10.876417 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:14:10.876417 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:14:10.876417 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 10:14:10.876417 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 10:14:10.876417 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 10:14:10.876417 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 10:14:10.876417 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 10:14:10.876417 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 10:14:10.876417 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 09 10:14:10.876417 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:14:10.876417 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 617/1235] 10.222.0.36 () {56 vars in 1102 bytes} [Tue Aug 9 10:14:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:14:10.877101 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85e5e85-e2db-4cca-a5e0-26937328946b None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:14:10.927769 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:14:10.985060 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85e5e85-e2db-4cca-a5e0-26937328946b None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:14:11.021603 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be073de-e32c-4f22-a227-10688d831f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:14:11.022303 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be073de-e32c-4f22-a227-10688d831f5f None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:11.022577 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be073de-e32c-4f22-a227-10688d831f5f None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:11.022847 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be073de-e32c-4f22-a227-10688d831f5f None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:11.023503 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be073de-e32c-4f22-a227-10688d831f5f None admin] RBAC: Adding query filter params (name=service) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:14:11.023801 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be073de-e32c-4f22-a227-10688d831f5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:14:11.025163 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be073de-e32c-4f22-a227-10688d831f5f None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:14:11.033037 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 619/1236] 10.222.0.36 () {56 vars in 1103 bytes} [Tue Aug 9 10:14:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:14:11.040590 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60bfd29-6417-4363-a682-b35c4fd343fa None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:14:11.132575 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:14:11.152837 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60bfd29-6417-4363-a682-b35c4fd343fa None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:14:11.193856 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cacdfc-dd52-436d-8aa0-39805013ab1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:14:11.194513 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cacdfc-dd52-436d-8aa0-39805013ab1c None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:11.194794 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cacdfc-dd52-436d-8aa0-39805013ab1c None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:11.195064 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cacdfc-dd52-436d-8aa0-39805013ab1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:11.208323 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cacdfc-dd52-436d-8aa0-39805013ab1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:14:11.209762 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cacdfc-dd52-436d-8aa0-39805013ab1c None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:14:11.226738 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-d8cacdfc-dd52-436d-8aa0-39805013ab1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:14:11.226738 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:14:11.226738 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:14:11.226738 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:14:11.226738 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:14:11.226738 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:14:11.226738 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:14:11.226738 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:14:11.226738 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:14:11.226738 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:14:11.226738 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:14:11.226738 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:14:11.226738 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 10:14:11.226738 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 10:14:11.226738 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 10:14:11.226738 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 10:14:11.227865 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:14:11.227865 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:14:11.227865 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:14:11.227865 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:14:11.227865 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:14:11.227865 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:14:11.227865 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:14:11.227865 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:14:11.227865 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:14:11.227865 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:14:11.227865 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:14:11.227865 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:14:11.227865 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:14:11.227865 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:14:11.227865 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:14:11.227865 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:14:11.227865 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 10:14:11.229029 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 10:14:11.229029 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:14:11.229029 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:14:11.229029 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 618/1237] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:14:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:14:11.234662 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be073de-e32c-4f22-a227-10688d831f5f None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:14:11.351779 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be073de-e32c-4f22-a227-10688d831f5f None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:14:11.360731 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:14:11.388779 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead361f5-9f75-4dee-a64d-615feb850e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:14:11.389411 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead361f5-9f75-4dee-a64d-615feb850e0b None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:11.389750 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead361f5-9f75-4dee-a64d-615feb850e0b None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:11.390143 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead361f5-9f75-4dee-a64d-615feb850e0b None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:11.390789 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead361f5-9f75-4dee-a64d-615feb850e0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:14:11.391095 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead361f5-9f75-4dee-a64d-615feb850e0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:14:11.392480 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead361f5-9f75-4dee-a64d-615feb850e0b None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:14:11.406718 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 620/1238] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Aug 9 10:14:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:14:11.414610 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cacdfc-dd52-436d-8aa0-39805013ab1c None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:14:11.523538 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cacdfc-dd52-436d-8aa0-39805013ab1c None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:14:11.560432 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd058f0-175e-458f-af56-eee1bd9cfcd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:14:11.561340 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd058f0-175e-458f-af56-eee1bd9cfcd0 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:11.562298 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd058f0-175e-458f-af56-eee1bd9cfcd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:11.562298 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd058f0-175e-458f-af56-eee1bd9cfcd0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:11.565647 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:14:11.573155 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd058f0-175e-458f-af56-eee1bd9cfcd0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:14:11.575200 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd058f0-175e-458f-af56-eee1bd9cfcd0 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:14:11.589230 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-8cd058f0-175e-458f-af56-eee1bd9cfcd0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 09 10:14:11.589230 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:14:11.589230 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:14:11.589230 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:14:11.589230 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:14:11.589230 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:14:11.589230 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:14:11.589230 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:14:11.589230 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:14:11.589230 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:14:11.589230 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:14:11.589230 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:14:11.589230 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 10:14:11.589230 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 10:14:11.589230 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 10:14:11.589230 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 10:14:11.590506 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:14:11.590506 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:14:11.590506 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 10:14:11.590506 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 10:14:11.590506 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 10:14:11.590506 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 10:14:11.590506 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:14:11.590506 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:14:11.590506 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:14:11.590506 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:14:11.590506 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:14:11.590506 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:14:11.590506 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:14:11.590506 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:14:11.590506 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:14:11.590506 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:14:11.590506 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:14:11.590506 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:14:11.591945 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:14:11.591945 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:14:11.591945 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 10:14:11.591945 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 10:14:11.591945 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 10:14:11.591945 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 10:14:11.591945 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 10:14:11.591945 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 10:14:11.591945 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 09 10:14:11.591945 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:14:11.591945 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 619/1239] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:14:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:14:11.598021 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead361f5-9f75-4dee-a64d-615feb850e0b None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:14:11.723992 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead361f5-9f75-4dee-a64d-615feb850e0b None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:14:11.758469 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf2de75-dbc2-49f2-8ae9-2127897b1a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:14:11.759100 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf2de75-dbc2-49f2-8ae9-2127897b1a87 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:11.759347 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf2de75-dbc2-49f2-8ae9-2127897b1a87 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:11.759614 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf2de75-dbc2-49f2-8ae9-2127897b1a87 None admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:11.760404 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf2de75-dbc2-49f2-8ae9-2127897b1a87 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:14:11.760735 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf2de75-dbc2-49f2-8ae9-2127897b1a87 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:14:11.762216 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf2de75-dbc2-49f2-8ae9-2127897b1a87 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:14:11.780849 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 621/1240] 10.222.0.36 () {56 vars in 1143 bytes} [Tue Aug 9 10:14:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:14:11.787077 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd058f0-175e-458f-af56-eee1bd9cfcd0 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:14:11.902332 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd058f0-175e-458f-af56-eee1bd9cfcd0 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:14:11.939034 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7be4a6d-054d-4043-848c-de7bae34e462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:14:11.939628 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7be4a6d-054d-4043-848c-de7bae34e462 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:11.939906 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7be4a6d-054d-4043-848c-de7bae34e462 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:11.940175 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7be4a6d-054d-4043-848c-de7bae34e462 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:12.007839 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:14:12.017409 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7be4a6d-054d-4043-848c-de7bae34e462 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:14:12.019444 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7be4a6d-054d-4043-848c-de7bae34e462 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:14:12.142941 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 620/1241] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Aug 9 10:14:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 10:14:12.149490 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf2de75-dbc2-49f2-8ae9-2127897b1a87 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:14:12.183788 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:14:12.263718 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf2de75-dbc2-49f2-8ae9-2127897b1a87 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:14:12.300700 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d275bff8-6b83-4091-a922-b3ee4877b9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:14:12.301492 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d275bff8-6b83-4091-a922-b3ee4877b9d0 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:12.301786 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d275bff8-6b83-4091-a922-b3ee4877b9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:12.302173 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d275bff8-6b83-4091-a922-b3ee4877b9d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:12.313286 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d275bff8-6b83-4091-a922-b3ee4877b9d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:14:12.314908 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d275bff8-6b83-4091-a922-b3ee4877b9d0 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:14:12.329866 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-d275bff8-6b83-4091-a922-b3ee4877b9d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:14:12.329866 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:14:12.329866 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:14:12.329866 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:14:12.329866 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:14:12.329866 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:14:12.329866 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:14:12.329866 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:14:12.329866 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:14:12.329866 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:14:12.329866 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:14:12.329866 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:14:12.329866 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 10:14:12.329866 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 10:14:12.329866 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 10:14:12.329866 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 10:14:12.331032 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:14:12.331032 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:14:12.331032 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:14:12.331032 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:14:12.331032 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:14:12.331032 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:14:12.331032 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:14:12.331032 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:14:12.331032 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:14:12.331032 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:14:12.331032 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:14:12.331032 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:14:12.331032 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:14:12.331032 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:14:12.331032 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:14:12.331032 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:14:12.331032 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 10:14:12.331959 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 10:14:12.331959 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:14:12.331959 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:14:12.331959 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 622/1242] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:14:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:14:12.337409 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7be4a6d-054d-4043-848c-de7bae34e462 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:14:12.435286 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:14:12.443219 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7be4a6d-054d-4043-848c-de7bae34e462 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:14:12.492244 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b83b5f7-33bd-4fa4-a8a3-508631b48504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:14:12.493085 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83b5f7-33bd-4fa4-a8a3-508631b48504 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:12.493559 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83b5f7-33bd-4fa4-a8a3-508631b48504 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:12.494056 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83b5f7-33bd-4fa4-a8a3-508631b48504 None admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:12.494997 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b83b5f7-33bd-4fa4-a8a3-508631b48504 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:14:12.495464 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b83b5f7-33bd-4fa4-a8a3-508631b48504 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:14:12.496908 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b83b5f7-33bd-4fa4-a8a3-508631b48504 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:14:12.512610 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 621/1243] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Aug 9 10:14:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:14:12.521258 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d275bff8-6b83-4091-a922-b3ee4877b9d0 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:14:12.606712 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:14:12.632903 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d275bff8-6b83-4091-a922-b3ee4877b9d0 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:14:12.672974 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e1e3ea-c50f-4da6-821e-583cec104826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:14:12.673730 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e1e3ea-c50f-4da6-821e-583cec104826 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:12.674096 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e1e3ea-c50f-4da6-821e-583cec104826 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:12.674416 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e1e3ea-c50f-4da6-821e-583cec104826 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:12.681995 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e1e3ea-c50f-4da6-821e-583cec104826 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:14:12.683722 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e1e3ea-c50f-4da6-821e-583cec104826 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:14:12.697368 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-a6e1e3ea-c50f-4da6-821e-583cec104826 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 10:14:12.697368 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:14:12.697368 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:14:12.697368 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:14:12.697368 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:14:12.697368 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:14:12.697368 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:14:12.697368 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:14:12.697368 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:14:12.697368 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:14:12.697368 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:14:12.697368 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:14:12.697368 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 10:14:12.697368 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 10:14:12.697368 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 10:14:12.698549 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 10:14:12.698549 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:14:12.698549 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:14:12.698549 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:14:12.698549 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:14:12.698549 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:14:12.698549 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:14:12.698549 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:14:12.698549 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:14:12.698549 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:14:12.698549 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:14:12.698549 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:14:12.698549 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:14:12.698549 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:14:12.698549 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:14:12.698549 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:14:12.698549 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:14:12.699942 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 10:14:12.699942 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 10:14:12.699942 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 10:14:12.699942 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 10:14:12.699942 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 10:14:12.699942 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 10:14:12.699942 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 10:14:12.699942 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:14:12.699942 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 623/1244] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Aug 9 10:14:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:14:12.704693 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b83b5f7-33bd-4fa4-a8a3-508631b48504 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:14:12.819277 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b83b5f7-33bd-4fa4-a8a3-508631b48504 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:14:12.858964 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968cbb98-cb14-4b26-83bb-fd6eee3b4e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:14:12.859736 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968cbb98-cb14-4b26-83bb-fd6eee3b4e2e None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:12.859905 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968cbb98-cb14-4b26-83bb-fd6eee3b4e2e None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:12.860185 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968cbb98-cb14-4b26-83bb-fd6eee3b4e2e None admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:12.860890 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968cbb98-cb14-4b26-83bb-fd6eee3b4e2e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:14:12.861232 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968cbb98-cb14-4b26-83bb-fd6eee3b4e2e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:14:12.862761 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968cbb98-cb14-4b26-83bb-fd6eee3b4e2e None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:14:12.874913 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 622/1245] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Aug 9 10:14:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:14:12.881401 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e1e3ea-c50f-4da6-821e-583cec104826 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:14:12.987578 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e1e3ea-c50f-4da6-821e-583cec104826 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:14:13.023121 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b229e86-99ee-4501-b796-118520c899c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:14:13.023749 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b229e86-99ee-4501-b796-118520c899c8 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:13.024031 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b229e86-99ee-4501-b796-118520c899c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:13.024324 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b229e86-99ee-4501-b796-118520c899c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:13.025017 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b229e86-99ee-4501-b796-118520c899c8 None admin] RBAC: Adding query filter params (role.id=1252647548644b48900ef09f1df438fd, scope.project.id=28891cf6239a43469326a864fb0d216c, user.id=c4d3b6a332394adf9e1b81ee9c171c48) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:14:13.025324 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b229e86-99ee-4501-b796-118520c899c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:14:13.026784 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b229e86-99ee-4501-b796-118520c899c8 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:14:13.032897 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 624/1246] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Aug 9 10:14:12 2022] GET /identity/v3/role_assignments?user.id=c4d3b6a332394adf9e1b81ee9c171c48&scope.project.id=28891cf6239a43469326a864fb0d216c&role.id=1252647548644b48900ef09f1df438fd => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:14:15.487174 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4489b8c-5853-45dc-bc4a-5594e73163ae None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:15.487702 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4489b8c-5853-45dc-bc4a-5594e73163ae None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:15.487835 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4489b8c-5853-45dc-bc4a-5594e73163ae None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:15.489439 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 623/1247] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:14:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:14:15.495707 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f6ddd-60b7-45fe-8a63-0e91fb023554 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:15.496162 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f6ddd-60b7-45fe-8a63-0e91fb023554 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:15.496281 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f6ddd-60b7-45fe-8a63-0e91fb023554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:15.502550 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:14:15.517498 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-812f6ddd-60b7-45fe-8a63-0e91fb023554 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:14:15.518783 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-812f6ddd-60b7-45fe-8a63-0e91fb023554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:14:15.591839 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 625/1248] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:14:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 10:14:15.628486 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4489b8c-5853-45dc-bc4a-5594e73163ae None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:14:15.651631 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:14:15.753371 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4489b8c-5853-45dc-bc4a-5594e73163ae None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:14:15.793504 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac51221-a372-413c-aa57-e235dd7e6ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:14:15.794674 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac51221-a372-413c-aa57-e235dd7e6ab6 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:15.795262 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac51221-a372-413c-aa57-e235dd7e6ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:15.795737 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac51221-a372-413c-aa57-e235dd7e6ab6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:15.811421 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac51221-a372-413c-aa57-e235dd7e6ab6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 10:14:15.820928 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-aac51221-a372-413c-aa57-e235dd7e6ab6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 10:14:15.820928 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:14:15.820928 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:14:15.820928 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:14:15.820928 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:14:15.820928 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:14:15.820928 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:14:15.820928 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:14:15.820928 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:14:15.820928 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:14:15.820928 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:14:15.820928 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:14:15.820928 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 10:14:15.820928 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 10:14:15.820928 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 10:14:15.820928 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 10:14:15.822047 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 10:14:15.822047 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 10:14:15.822047 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 10:14:15.822047 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 10:14:15.822047 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:14:15.822047 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:14:15.822047 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:14:15.822047 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:14:15.822047 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:14:15.822047 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:14:15.822047 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:14:15.822047 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:14:15.822047 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:14:15.822047 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:14:15.822047 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:14:15.822047 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:14:15.822958 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:14:15.822958 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:14:15.822958 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:14:15.822958 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:14:15.822958 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 10:14:15.822958 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 10:14:15.822958 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 10:14:15.822958 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 10:14:15.822958 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 10:14:15.822958 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 10:14:15.822958 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 10:14:15.822958 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:14:15.823612 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 624/1249] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Aug 9 10:14:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:14:15.830781 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812f6ddd-60b7-45fe-8a63-0e91fb023554 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:14:15.953276 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812f6ddd-60b7-45fe-8a63-0e91fb023554 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:14:15.986765 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:14:15.993837 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891eece8-baa9-4e0b-8181-04390140fc16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:14:15.994510 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891eece8-baa9-4e0b-8181-04390140fc16 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:15.994782 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891eece8-baa9-4e0b-8181-04390140fc16 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:15.995116 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891eece8-baa9-4e0b-8181-04390140fc16 None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:15.995911 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891eece8-baa9-4e0b-8181-04390140fc16 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:14:15.996206 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891eece8-baa9-4e0b-8181-04390140fc16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:14:15.997584 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891eece8-baa9-4e0b-8181-04390140fc16 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:14:16.008479 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 626/1250] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Aug 9 10:14:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:14:16.014854 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac51221-a372-413c-aa57-e235dd7e6ab6 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:14:16.103450 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:14:16.132070 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac51221-a372-413c-aa57-e235dd7e6ab6 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:14:16.171777 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f51565a-06a5-4502-8a13-e3b1bf8f5ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:14:16.172399 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f51565a-06a5-4502-8a13-e3b1bf8f5ac9 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:16.172684 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f51565a-06a5-4502-8a13-e3b1bf8f5ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:16.172949 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f51565a-06a5-4502-8a13-e3b1bf8f5ac9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:16.186957 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f51565a-06a5-4502-8a13-e3b1bf8f5ac9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:14:16.188421 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f51565a-06a5-4502-8a13-e3b1bf8f5ac9 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:14:16.205632 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-6f51565a-06a5-4502-8a13-e3b1bf8f5ac9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:14:16.205632 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:14:16.205632 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:14:16.205632 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:14:16.205632 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:14:16.205632 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:14:16.205632 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:14:16.205632 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:14:16.205632 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:14:16.205632 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:14:16.205632 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:14:16.205632 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:14:16.205632 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 10:14:16.205632 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 10:14:16.205632 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 10:14:16.205632 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 10:14:16.206973 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:14:16.206973 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:14:16.206973 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:14:16.206973 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:14:16.206973 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:14:16.206973 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:14:16.206973 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:14:16.206973 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:14:16.206973 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:14:16.206973 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:14:16.206973 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:14:16.206973 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:14:16.206973 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:14:16.206973 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:14:16.206973 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:14:16.206973 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:14:16.206973 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 10:14:16.208425 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 10:14:16.208425 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:14:16.208425 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:14:16.208425 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 625/1251] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:14:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:14:16.213673 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891eece8-baa9-4e0b-8181-04390140fc16 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:14:16.331401 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891eece8-baa9-4e0b-8181-04390140fc16 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:14:16.370843 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c322cf-f7d3-401b-9fba-d028dc43d92d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:14:16.371461 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c322cf-f7d3-401b-9fba-d028dc43d92d None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:16.371728 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c322cf-f7d3-401b-9fba-d028dc43d92d None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:16.371998 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c322cf-f7d3-401b-9fba-d028dc43d92d None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:16.372668 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c322cf-f7d3-401b-9fba-d028dc43d92d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:14:16.372974 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c322cf-f7d3-401b-9fba-d028dc43d92d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:14:16.374537 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c322cf-f7d3-401b-9fba-d028dc43d92d None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:14:16.387350 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 627/1252] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Aug 9 10:14:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:14:16.393656 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f51565a-06a5-4502-8a13-e3b1bf8f5ac9 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:14:16.509591 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f51565a-06a5-4502-8a13-e3b1bf8f5ac9 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:14:16.540741 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:14:16.550873 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291f6856-2ad6-4a44-98e2-9deb00b0981f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:14:16.551520 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f6856-2ad6-4a44-98e2-9deb00b0981f None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:16.551866 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f6856-2ad6-4a44-98e2-9deb00b0981f None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:16.552227 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f6856-2ad6-4a44-98e2-9deb00b0981f None admin] PATH_INFO: `/v3/users/placement` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:16.560512 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291f6856-2ad6-4a44-98e2-9deb00b0981f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:14:16.561981 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291f6856-2ad6-4a44-98e2-9deb00b0981f None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:14:16.574767 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-291f6856-2ad6-4a44-98e2-9deb00b0981f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 09 10:14:16.574767 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:14:16.574767 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:14:16.574767 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:14:16.574767 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:14:16.574767 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:14:16.574767 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:14:16.574767 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:14:16.574767 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:14:16.574767 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:14:16.574767 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:14:16.574767 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:14:16.574767 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 10:14:16.574767 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 10:14:16.574767 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 10:14:16.574767 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 10:14:16.576573 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:14:16.576573 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:14:16.576573 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 10:14:16.576573 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 10:14:16.576573 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 10:14:16.576573 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 10:14:16.576573 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:14:16.576573 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:14:16.576573 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:14:16.576573 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:14:16.576573 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:14:16.576573 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:14:16.576573 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:14:16.576573 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:14:16.576573 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:14:16.576573 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:14:16.576573 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:14:16.576573 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:14:16.578678 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:14:16.578678 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:14:16.578678 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 10:14:16.578678 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 10:14:16.578678 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 10:14:16.578678 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 10:14:16.578678 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 10:14:16.578678 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 10:14:16.578678 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 09 10:14:16.578678 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:14:16.580612 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 626/1253] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:14:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:14:16.582685 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c322cf-f7d3-401b-9fba-d028dc43d92d None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:14:16.655841 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:14:16.706041 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c322cf-f7d3-401b-9fba-d028dc43d92d None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:14:16.748157 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b65139-d050-46d3-a5ff-c3fc42acc608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:14:16.749028 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b65139-d050-46d3-a5ff-c3fc42acc608 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:16.749344 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b65139-d050-46d3-a5ff-c3fc42acc608 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:16.749645 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b65139-d050-46d3-a5ff-c3fc42acc608 None admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:16.750684 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b65139-d050-46d3-a5ff-c3fc42acc608 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:14:16.751013 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b65139-d050-46d3-a5ff-c3fc42acc608 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:14:16.752674 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b65139-d050-46d3-a5ff-c3fc42acc608 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:14:16.773513 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 628/1254] 10.222.0.36 () {56 vars in 1143 bytes} [Tue Aug 9 10:14:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:14:16.779304 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291f6856-2ad6-4a44-98e2-9deb00b0981f None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:14:16.901994 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291f6856-2ad6-4a44-98e2-9deb00b0981f None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:14:16.948056 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a621fe77-bcc0-45c8-be60-06a80aa2d77d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:14:16.948668 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a621fe77-bcc0-45c8-be60-06a80aa2d77d None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:16.948944 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a621fe77-bcc0-45c8-be60-06a80aa2d77d None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:16.949210 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a621fe77-bcc0-45c8-be60-06a80aa2d77d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:17.012691 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:14:17.027139 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a621fe77-bcc0-45c8-be60-06a80aa2d77d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:14:17.028766 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a621fe77-bcc0-45c8-be60-06a80aa2d77d None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:14:17.137911 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 627/1255] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Aug 9 10:14:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 09 10:14:17.143655 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b65139-d050-46d3-a5ff-c3fc42acc608 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:14:17.258583 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b65139-d050-46d3-a5ff-c3fc42acc608 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:14:17.275631 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:14:17.302142 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85577a7-75fb-49e9-b80e-7602b4a24125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:14:17.302855 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85577a7-75fb-49e9-b80e-7602b4a24125 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:17.303172 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85577a7-75fb-49e9-b80e-7602b4a24125 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:17.303473 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85577a7-75fb-49e9-b80e-7602b4a24125 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:17.320619 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85577a7-75fb-49e9-b80e-7602b4a24125 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:14:17.322352 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85577a7-75fb-49e9-b80e-7602b4a24125 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:14:17.341244 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-a85577a7-75fb-49e9-b80e-7602b4a24125 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:14:17.341244 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:14:17.341244 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:14:17.341244 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:14:17.341244 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:14:17.341244 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:14:17.341244 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:14:17.341244 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:14:17.341244 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:14:17.341244 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:14:17.341244 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:14:17.341244 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:14:17.341244 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 10:14:17.341244 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 10:14:17.341244 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 10:14:17.341244 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 10:14:17.342563 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:14:17.342563 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:14:17.342563 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:14:17.342563 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:14:17.342563 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:14:17.342563 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:14:17.342563 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:14:17.342563 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:14:17.342563 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:14:17.342563 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:14:17.342563 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:14:17.342563 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:14:17.342563 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:14:17.342563 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:14:17.342563 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:14:17.342563 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:14:17.342563 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 10:14:17.343791 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 10:14:17.343791 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:14:17.343791 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:14:17.343791 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 629/1256] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:14:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:14:17.348598 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a621fe77-bcc0-45c8-be60-06a80aa2d77d None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:14:17.445257 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:14:17.457731 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a621fe77-bcc0-45c8-be60-06a80aa2d77d None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:14:17.494537 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75afbacc-1eda-4ca3-9c69-16ef53d0a4e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:14:17.495166 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75afbacc-1eda-4ca3-9c69-16ef53d0a4e6 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:17.495467 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75afbacc-1eda-4ca3-9c69-16ef53d0a4e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:17.495814 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75afbacc-1eda-4ca3-9c69-16ef53d0a4e6 None admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:17.496547 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75afbacc-1eda-4ca3-9c69-16ef53d0a4e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:14:17.496934 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75afbacc-1eda-4ca3-9c69-16ef53d0a4e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:14:17.498406 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75afbacc-1eda-4ca3-9c69-16ef53d0a4e6 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:14:17.517968 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 628/1257] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Aug 9 10:14:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:14:17.519113 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85577a7-75fb-49e9-b80e-7602b4a24125 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:14:17.635626 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85577a7-75fb-49e9-b80e-7602b4a24125 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:14:17.674121 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb5b1b8-c903-4b79-8a34-c86af8aaef5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:14:17.674756 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb5b1b8-c903-4b79-8a34-c86af8aaef5f None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:17.675053 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb5b1b8-c903-4b79-8a34-c86af8aaef5f None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:17.675319 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb5b1b8-c903-4b79-8a34-c86af8aaef5f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:17.682270 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb5b1b8-c903-4b79-8a34-c86af8aaef5f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:14:17.683710 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb5b1b8-c903-4b79-8a34-c86af8aaef5f None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:14:17.695683 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-4fb5b1b8-c903-4b79-8a34-c86af8aaef5f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 10:14:17.695683 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:14:17.695683 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:14:17.695683 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:14:17.695683 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:14:17.695683 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:14:17.695683 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:14:17.695683 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:14:17.695683 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:14:17.695683 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:14:17.695683 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:14:17.695683 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:14:17.695683 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 10:14:17.695683 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 10:14:17.695683 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 10:14:17.696610 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 10:14:17.696610 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:14:17.696610 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:14:17.696610 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:14:17.696610 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:14:17.696610 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:14:17.696610 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:14:17.696610 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:14:17.696610 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:14:17.696610 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:14:17.696610 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:14:17.696610 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:14:17.696610 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:14:17.696610 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:14:17.696610 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:14:17.696610 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:14:17.696610 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:14:17.697494 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 10:14:17.697494 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 10:14:17.697494 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 10:14:17.697494 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 10:14:17.697494 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 10:14:17.697494 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 10:14:17.697494 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 10:14:17.697494 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:14:17.697494 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 630/1258] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Aug 9 10:14:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:14:17.704165 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75afbacc-1eda-4ca3-9c69-16ef53d0a4e6 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:14:17.817764 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75afbacc-1eda-4ca3-9c69-16ef53d0a4e6 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:14:17.857503 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5bcdfa-ca65-4b2d-b04f-11b737ea23ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:14:17.858250 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5bcdfa-ca65-4b2d-b04f-11b737ea23ce None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:17.860045 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5bcdfa-ca65-4b2d-b04f-11b737ea23ce None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:17.860045 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5bcdfa-ca65-4b2d-b04f-11b737ea23ce None admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:17.860045 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5bcdfa-ca65-4b2d-b04f-11b737ea23ce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:14:17.860045 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5bcdfa-ca65-4b2d-b04f-11b737ea23ce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:14:17.861310 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5bcdfa-ca65-4b2d-b04f-11b737ea23ce None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:14:17.875113 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 629/1259] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Aug 9 10:14:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:14:17.881400 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb5b1b8-c903-4b79-8a34-c86af8aaef5f None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:14:17.908785 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:14:17.988392 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb5b1b8-c903-4b79-8a34-c86af8aaef5f None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:14:18.032617 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8a8d7a-7f9e-426f-be44-5b28effde93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:14:18.033598 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a8d7a-7f9e-426f-be44-5b28effde93e None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:18.034179 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a8d7a-7f9e-426f-be44-5b28effde93e None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:18.034589 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a8d7a-7f9e-426f-be44-5b28effde93e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:18.035861 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8a8d7a-7f9e-426f-be44-5b28effde93e None admin] RBAC: Adding query filter params (role.id=89ca30cbbb634be8a96e9921aa56626b, scope.project.id=28891cf6239a43469326a864fb0d216c, user.id=c4d3b6a332394adf9e1b81ee9c171c48) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:14:18.036995 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8a8d7a-7f9e-426f-be44-5b28effde93e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:14:18.039840 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8a8d7a-7f9e-426f-be44-5b28effde93e None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:14:18.046856 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 631/1260] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Aug 9 10:14:17 2022] GET /identity/v3/role_assignments?user.id=c4d3b6a332394adf9e1b81ee9c171c48&scope.project.id=28891cf6239a43469326a864fb0d216c&role.id=89ca30cbbb634be8a96e9921aa56626b => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:14:20.059250 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e464485-4576-493f-9db4-2bbef7e3d7fb None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:20.059792 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e464485-4576-493f-9db4-2bbef7e3d7fb None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:20.059792 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e464485-4576-493f-9db4-2bbef7e3d7fb None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:20.061129 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 630/1261] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:14:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:14:20.066253 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b177ac-23dc-4213-adb3-2e7d0251176f None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:20.066626 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b177ac-23dc-4213-adb3-2e7d0251176f None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:20.066838 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b177ac-23dc-4213-adb3-2e7d0251176f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:20.084529 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-66b177ac-23dc-4213-adb3-2e7d0251176f None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:14:20.085704 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-66b177ac-23dc-4213-adb3-2e7d0251176f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:14:20.150480 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 632/1262] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:14:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 10:14:20.173612 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e464485-4576-493f-9db4-2bbef7e3d7fb None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:14:20.184314 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:14:20.273918 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e464485-4576-493f-9db4-2bbef7e3d7fb None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:14:20.306941 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc0951e-dfe8-4e26-8f5e-b70c50e3a460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:14:20.307541 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc0951e-dfe8-4e26-8f5e-b70c50e3a460 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:20.307812 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc0951e-dfe8-4e26-8f5e-b70c50e3a460 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:20.308074 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc0951e-dfe8-4e26-8f5e-b70c50e3a460 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:20.318389 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc0951e-dfe8-4e26-8f5e-b70c50e3a460 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 10:14:20.322935 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-9dc0951e-dfe8-4e26-8f5e-b70c50e3a460 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 10:14:20.322935 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:14:20.322935 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:14:20.322935 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:14:20.322935 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:14:20.322935 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:14:20.322935 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:14:20.322935 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:14:20.322935 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:14:20.322935 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:14:20.322935 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:14:20.322935 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:14:20.322935 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 10:14:20.322935 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 10:14:20.322935 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 10:14:20.322935 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 10:14:20.324013 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 10:14:20.324013 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 10:14:20.324013 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 10:14:20.324013 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 10:14:20.324013 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:14:20.324013 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:14:20.324013 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:14:20.324013 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:14:20.324013 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:14:20.324013 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:14:20.324013 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:14:20.324013 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:14:20.324013 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:14:20.324013 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:14:20.324013 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:14:20.324013 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:14:20.324870 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:14:20.324870 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:14:20.324870 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:14:20.324870 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:14:20.324870 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 10:14:20.324870 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 10:14:20.324870 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 10:14:20.324870 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 10:14:20.324870 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 10:14:20.324870 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 10:14:20.324870 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 10:14:20.324870 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:14:20.324870 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 631/1263] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Aug 9 10:14:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:14:20.329922 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b177ac-23dc-4213-adb3-2e7d0251176f None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:14:20.347401 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:14:20.424789 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b177ac-23dc-4213-adb3-2e7d0251176f None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:14:20.458395 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4a70c5-33cc-40fc-aa5e-cb36f8b35db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:14:20.459063 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4a70c5-33cc-40fc-aa5e-cb36f8b35db1 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:20.459341 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4a70c5-33cc-40fc-aa5e-cb36f8b35db1 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:20.459612 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4a70c5-33cc-40fc-aa5e-cb36f8b35db1 None admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:20.460267 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4a70c5-33cc-40fc-aa5e-cb36f8b35db1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:14:20.460565 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4a70c5-33cc-40fc-aa5e-cb36f8b35db1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:14:20.461940 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4a70c5-33cc-40fc-aa5e-cb36f8b35db1 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:14:20.469646 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 633/1264] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Aug 9 10:14:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:14:20.476348 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc0951e-dfe8-4e26-8f5e-b70c50e3a460 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:14:20.540996 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:14:20.573182 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc0951e-dfe8-4e26-8f5e-b70c50e3a460 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:14:20.611019 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c43f6a4-eee4-4d64-97d0-503c6e171951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:14:20.611785 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c43f6a4-eee4-4d64-97d0-503c6e171951 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:20.612138 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c43f6a4-eee4-4d64-97d0-503c6e171951 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:20.612345 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c43f6a4-eee4-4d64-97d0-503c6e171951 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:20.624511 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c43f6a4-eee4-4d64-97d0-503c6e171951 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:14:20.626132 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c43f6a4-eee4-4d64-97d0-503c6e171951 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:14:20.643275 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-3c43f6a4-eee4-4d64-97d0-503c6e171951 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:14:20.643275 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:14:20.643275 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:14:20.643275 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:14:20.643275 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:14:20.643275 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:14:20.643275 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:14:20.643275 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:14:20.643275 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:14:20.643275 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:14:20.643275 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:14:20.643275 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:14:20.643275 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 10:14:20.643275 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 10:14:20.643275 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 10:14:20.643275 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 10:14:20.644414 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:14:20.644414 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:14:20.644414 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:14:20.644414 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:14:20.644414 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:14:20.644414 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:14:20.644414 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:14:20.644414 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:14:20.644414 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:14:20.644414 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:14:20.644414 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:14:20.644414 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:14:20.644414 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:14:20.644414 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:14:20.644414 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:14:20.644414 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:14:20.644414 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 10:14:20.647110 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 10:14:20.647110 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:14:20.647110 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:14:20.647110 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 632/1265] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:14:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:14:20.651186 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4a70c5-33cc-40fc-aa5e-cb36f8b35db1 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:14:20.733016 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:14:20.751611 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4a70c5-33cc-40fc-aa5e-cb36f8b35db1 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:14:20.784126 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8ed2a9-c984-4ca7-9ee7-490f48fa8d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:14:20.784708 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ed2a9-c984-4ca7-9ee7-490f48fa8d91 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:20.784985 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ed2a9-c984-4ca7-9ee7-490f48fa8d91 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:20.785252 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ed2a9-c984-4ca7-9ee7-490f48fa8d91 None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:20.786494 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8ed2a9-c984-4ca7-9ee7-490f48fa8d91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:14:20.786840 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8ed2a9-c984-4ca7-9ee7-490f48fa8d91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:14:20.788205 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8ed2a9-c984-4ca7-9ee7-490f48fa8d91 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:14:20.799615 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 634/1266] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Aug 9 10:14:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:14:20.805823 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c43f6a4-eee4-4d64-97d0-503c6e171951 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:14:20.900671 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c43f6a4-eee4-4d64-97d0-503c6e171951 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:14:20.919347 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:14:20.933683 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d17e3-58e6-4b70-aef3-e6ae35039d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:14:20.934314 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d17e3-58e6-4b70-aef3-e6ae35039d93 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:20.934588 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d17e3-58e6-4b70-aef3-e6ae35039d93 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:20.934853 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d17e3-58e6-4b70-aef3-e6ae35039d93 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:20.941893 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5d17e3-58e6-4b70-aef3-e6ae35039d93 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:14:20.944045 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5d17e3-58e6-4b70-aef3-e6ae35039d93 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:14:20.954936 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-2e5d17e3-58e6-4b70-aef3-e6ae35039d93 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 09 10:14:20.954936 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:14:20.954936 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:14:20.954936 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:14:20.954936 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:14:20.954936 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:14:20.954936 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:14:20.954936 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:14:20.954936 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:14:20.954936 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:14:20.954936 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:14:20.954936 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:14:20.954936 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 10:14:20.954936 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 10:14:20.954936 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 10:14:20.954936 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 10:14:20.956457 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:14:20.956457 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:14:20.956457 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 10:14:20.956457 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 10:14:20.956457 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 10:14:20.956457 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 10:14:20.956457 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:14:20.956457 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:14:20.956457 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:14:20.956457 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:14:20.956457 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:14:20.956457 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:14:20.956457 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:14:20.956457 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:14:20.956457 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:14:20.956457 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:14:20.956457 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:14:20.956457 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:14:20.957781 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:14:20.957781 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:14:20.957781 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 10:14:20.957781 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 10:14:20.957781 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 10:14:20.957781 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 10:14:20.957781 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 10:14:20.957781 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 10:14:20.957781 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 09 10:14:20.957781 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:14:20.957781 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 633/1267] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:14:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:14:20.962021 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8ed2a9-c984-4ca7-9ee7-490f48fa8d91 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:14:21.057558 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8ed2a9-c984-4ca7-9ee7-490f48fa8d91 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:14:21.089415 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51529cea-1a02-47be-a095-50bab79c9cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:14:21.090013 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51529cea-1a02-47be-a095-50bab79c9cf8 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:21.090288 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51529cea-1a02-47be-a095-50bab79c9cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:21.090559 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51529cea-1a02-47be-a095-50bab79c9cf8 None admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:21.091266 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51529cea-1a02-47be-a095-50bab79c9cf8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:14:21.091563 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51529cea-1a02-47be-a095-50bab79c9cf8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:14:21.092965 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51529cea-1a02-47be-a095-50bab79c9cf8 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:14:21.101747 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:14:21.109968 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 635/1268] 10.222.0.36 () {56 vars in 1143 bytes} [Tue Aug 9 10:14:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:14:21.115706 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d17e3-58e6-4b70-aef3-e6ae35039d93 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:14:21.212326 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d17e3-58e6-4b70-aef3-e6ae35039d93 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:14:21.244146 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7c8ac1-191f-4bec-a01a-6b53d07123bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:14:21.244745 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c8ac1-191f-4bec-a01a-6b53d07123bf None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:21.245023 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c8ac1-191f-4bec-a01a-6b53d07123bf None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:21.245293 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c8ac1-191f-4bec-a01a-6b53d07123bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:21.255337 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7c8ac1-191f-4bec-a01a-6b53d07123bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:14:21.256772 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7c8ac1-191f-4bec-a01a-6b53d07123bf None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:14:21.270635 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-bf7c8ac1-191f-4bec-a01a-6b53d07123bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:14:21.270635 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:14:21.270635 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:14:21.270635 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:14:21.270635 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:14:21.270635 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:14:21.270635 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:14:21.270635 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:14:21.270635 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:14:21.270635 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:14:21.270635 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:14:21.270635 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:14:21.270635 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 10:14:21.270635 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 10:14:21.270635 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 10:14:21.270635 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 10:14:21.271854 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:14:21.271854 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:14:21.271854 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:14:21.271854 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:14:21.271854 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:14:21.271854 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:14:21.271854 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:14:21.271854 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:14:21.271854 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:14:21.271854 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:14:21.271854 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:14:21.271854 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:14:21.271854 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:14:21.271854 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:14:21.271854 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:14:21.271854 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:14:21.271854 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 10:14:21.273025 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 10:14:21.273025 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:14:21.273025 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:14:21.273025 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 634/1269] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:14:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 09 10:14:21.277290 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51529cea-1a02-47be-a095-50bab79c9cf8 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:14:21.373809 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51529cea-1a02-47be-a095-50bab79c9cf8 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:14:21.407193 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda64c2b-31c3-4b13-8942-ec5d24a3d4c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:14:21.407788 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda64c2b-31c3-4b13-8942-ec5d24a3d4c4 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:21.408070 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda64c2b-31c3-4b13-8942-ec5d24a3d4c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:21.408339 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda64c2b-31c3-4b13-8942-ec5d24a3d4c4 None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:21.408977 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda64c2b-31c3-4b13-8942-ec5d24a3d4c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:14:21.409278 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda64c2b-31c3-4b13-8942-ec5d24a3d4c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:14:21.410698 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda64c2b-31c3-4b13-8942-ec5d24a3d4c4 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:14:21.421962 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 636/1270] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Aug 9 10:14:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:14:21.427393 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7c8ac1-191f-4bec-a01a-6b53d07123bf None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:14:21.458733 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:14:21.525379 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7c8ac1-191f-4bec-a01a-6b53d07123bf None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:14:21.557708 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c367ca4c-bfe3-4a73-8eed-1a8b7e61d9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:14:21.558336 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c367ca4c-bfe3-4a73-8eed-1a8b7e61d9b4 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:21.558616 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c367ca4c-bfe3-4a73-8eed-1a8b7e61d9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:21.558887 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c367ca4c-bfe3-4a73-8eed-1a8b7e61d9b4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:21.565413 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c367ca4c-bfe3-4a73-8eed-1a8b7e61d9b4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:14:21.566851 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c367ca4c-bfe3-4a73-8eed-1a8b7e61d9b4 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:14:21.578235 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-c367ca4c-bfe3-4a73-8eed-1a8b7e61d9b4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 10:14:21.578235 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:14:21.578235 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:14:21.578235 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:14:21.578235 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:14:21.578235 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:14:21.578235 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:14:21.578235 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:14:21.578235 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:14:21.578235 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:14:21.578235 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:14:21.578235 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:14:21.578235 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 10:14:21.578235 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 10:14:21.578235 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 10:14:21.579270 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 10:14:21.579270 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:14:21.579270 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:14:21.579270 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:14:21.579270 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:14:21.579270 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:14:21.579270 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:14:21.579270 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:14:21.579270 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:14:21.579270 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:14:21.579270 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:14:21.579270 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:14:21.579270 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:14:21.579270 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:14:21.579270 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:14:21.579270 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:14:21.579270 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:14:21.580571 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 10:14:21.580571 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 10:14:21.580571 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 10:14:21.580571 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 10:14:21.580571 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 10:14:21.580571 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 10:14:21.580571 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 10:14:21.580571 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:14:21.580571 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 635/1271] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Aug 9 10:14:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:14:21.586152 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda64c2b-31c3-4b13-8942-ec5d24a3d4c4 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:14:21.650454 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:14:21.691482 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda64c2b-31c3-4b13-8942-ec5d24a3d4c4 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:14:21.724492 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ece267-60f4-462f-a871-0fc701011857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:14:21.725086 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ece267-60f4-462f-a871-0fc701011857 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:21.725365 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ece267-60f4-462f-a871-0fc701011857 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:21.725638 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ece267-60f4-462f-a871-0fc701011857 None admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:21.726364 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ece267-60f4-462f-a871-0fc701011857 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:14:21.726671 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ece267-60f4-462f-a871-0fc701011857 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:14:21.728097 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ece267-60f4-462f-a871-0fc701011857 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:14:21.740026 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 637/1272] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Aug 9 10:14:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:14:21.746007 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c367ca4c-bfe3-4a73-8eed-1a8b7e61d9b4 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:14:21.833996 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:14:21.842802 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c367ca4c-bfe3-4a73-8eed-1a8b7e61d9b4 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:14:21.879462 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a72892-c677-431e-8a3d-8e555d2abbfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:14:21.880659 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a72892-c677-431e-8a3d-8e555d2abbfa None admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:21.880940 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a72892-c677-431e-8a3d-8e555d2abbfa None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:21.881217 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a72892-c677-431e-8a3d-8e555d2abbfa None admin] PATH_INFO: `/v3/projects/28891cf6239a43469326a864fb0d216c/users/c4d3b6a332394adf9e1b81ee9c171c48/roles/89ca30cbbb634be8a96e9921aa56626b` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:21.883116 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a72892-c677-431e-8a3d-8e555d2abbfa None admin] RBAC: Authorizing `identity:create_grant(project_id=28891cf6239a43469326a864fb0d216c, user_id=c4d3b6a332394adf9e1b81ee9c171c48, role_id=89ca30cbbb634be8a96e9921aa56626b)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:14:21.884533 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a72892-c677-431e-8a3d-8e555d2abbfa None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:14:21.897061 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 636/1273] 10.222.0.36 () {58 vars in 1439 bytes} [Tue Aug 9 10:14:21 2022] PUT /identity/v3/projects/28891cf6239a43469326a864fb0d216c/users/c4d3b6a332394adf9e1b81ee9c171c48/roles/89ca30cbbb634be8a96e9921aa56626b => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:14:23.875418 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a763ad6-1bbb-4f49-8654-6e713ef5439c None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:23.875957 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a763ad6-1bbb-4f49-8654-6e713ef5439c None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:23.875957 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a763ad6-1bbb-4f49-8654-6e713ef5439c None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:23.877293 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 638/1274] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:14:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:14:23.883036 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c92cf-d7a5-49a3-b067-e27adc77820e None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:23.883485 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c92cf-d7a5-49a3-b067-e27adc77820e None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:23.883580 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c92cf-d7a5-49a3-b067-e27adc77820e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:23.901534 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-4b2c92cf-d7a5-49a3-b067-e27adc77820e None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:14:23.902761 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-4b2c92cf-d7a5-49a3-b067-e27adc77820e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:14:23.967706 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 637/1275] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:14:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 10:14:23.992035 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a763ad6-1bbb-4f49-8654-6e713ef5439c None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:14:24.090636 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a763ad6-1bbb-4f49-8654-6e713ef5439c None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:14:24.107353 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:14:24.124133 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccab7ff-ae96-46b3-971f-0b4313975e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:14:24.124737 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccab7ff-ae96-46b3-971f-0b4313975e69 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:24.125013 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccab7ff-ae96-46b3-971f-0b4313975e69 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:24.125280 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccab7ff-ae96-46b3-971f-0b4313975e69 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:24.135510 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccab7ff-ae96-46b3-971f-0b4313975e69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 09 10:14:24.140067 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-0ccab7ff-ae96-46b3-971f-0b4313975e69 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 10:14:24.140067 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:14:24.140067 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:14:24.140067 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:14:24.140067 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:14:24.140067 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:14:24.140067 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:14:24.140067 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:14:24.140067 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:14:24.140067 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:14:24.140067 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:14:24.140067 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:14:24.140067 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 09 10:14:24.140067 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 09 10:14:24.140067 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 09 10:14:24.140067 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 09 10:14:24.141113 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 09 10:14:24.141113 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 09 10:14:24.141113 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 09 10:14:24.141113 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 09 10:14:24.141113 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:14:24.141113 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:14:24.141113 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:14:24.141113 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:14:24.141113 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:14:24.141113 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:14:24.141113 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:14:24.141113 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:14:24.141113 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:14:24.141113 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:14:24.141113 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:14:24.141113 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:14:24.142042 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:14:24.142042 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:14:24.142042 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:14:24.142042 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:14:24.142042 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 09 10:14:24.142042 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 09 10:14:24.142042 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 09 10:14:24.142042 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 09 10:14:24.142042 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 09 10:14:24.142042 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 09 10:14:24.142042 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 09 10:14:24.142042 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:14:24.142042 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 639/1276] 10.222.0.36 () {56 vars in 1096 bytes} [Tue Aug 9 10:14:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:14:24.147492 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2c92cf-d7a5-49a3-b067-e27adc77820e None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:14:24.225039 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:14:24.243314 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2c92cf-d7a5-49a3-b067-e27adc77820e None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:14:24.276067 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c818dfc-86aa-4135-8f12-512a02fdccf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:14:24.276663 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c818dfc-86aa-4135-8f12-512a02fdccf2 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:24.276940 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c818dfc-86aa-4135-8f12-512a02fdccf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:24.277212 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c818dfc-86aa-4135-8f12-512a02fdccf2 None admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:24.277888 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c818dfc-86aa-4135-8f12-512a02fdccf2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:14:24.278196 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c818dfc-86aa-4135-8f12-512a02fdccf2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:14:24.279549 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c818dfc-86aa-4135-8f12-512a02fdccf2 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:14:24.287865 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 638/1277] 10.222.0.36 () {56 vars in 1099 bytes} [Tue Aug 9 10:14:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:14:24.293708 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccab7ff-ae96-46b3-971f-0b4313975e69 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:14:24.390839 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccab7ff-ae96-46b3-971f-0b4313975e69 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:14:24.423676 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecfaf75-4a2a-43a4-90b8-5b8e0a9dad7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:14:24.424276 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecfaf75-4a2a-43a4-90b8-5b8e0a9dad7a None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:24.424549 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecfaf75-4a2a-43a4-90b8-5b8e0a9dad7a None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:24.424815 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecfaf75-4a2a-43a4-90b8-5b8e0a9dad7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:24.434897 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecfaf75-4a2a-43a4-90b8-5b8e0a9dad7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:14:24.436322 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecfaf75-4a2a-43a4-90b8-5b8e0a9dad7a None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:14:24.450133 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-9ecfaf75-4a2a-43a4-90b8-5b8e0a9dad7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:14:24.450133 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:14:24.450133 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:14:24.450133 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:14:24.450133 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:14:24.450133 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:14:24.450133 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:14:24.450133 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:14:24.450133 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:14:24.450133 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:14:24.450133 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:14:24.450133 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:14:24.450133 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 10:14:24.450133 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 10:14:24.450133 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 10:14:24.450133 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 10:14:24.451268 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:14:24.451268 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:14:24.451268 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:14:24.451268 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:14:24.451268 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:14:24.451268 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:14:24.451268 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:14:24.451268 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:14:24.451268 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:14:24.451268 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:14:24.451268 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:14:24.451268 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:14:24.451268 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:14:24.451268 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:14:24.451268 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:14:24.451268 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:14:24.451268 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 10:14:24.452311 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 10:14:24.452311 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:14:24.452311 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:14:24.452311 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 640/1278] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:14:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:14:24.456798 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c818dfc-86aa-4135-8f12-512a02fdccf2 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:14:24.554889 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c818dfc-86aa-4135-8f12-512a02fdccf2 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:14:24.588036 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f9d775-c0ff-4a9a-a20c-5125391f67e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:14:24.588686 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f9d775-c0ff-4a9a-a20c-5125391f67e8 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:24.588992 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f9d775-c0ff-4a9a-a20c-5125391f67e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:24.589336 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f9d775-c0ff-4a9a-a20c-5125391f67e8 None admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:24.590009 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f9d775-c0ff-4a9a-a20c-5125391f67e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:14:24.590349 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f9d775-c0ff-4a9a-a20c-5125391f67e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:14:24.591848 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f9d775-c0ff-4a9a-a20c-5125391f67e8 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:14:24.605134 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 639/1279] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Aug 9 10:14:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:14:24.610982 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecfaf75-4a2a-43a4-90b8-5b8e0a9dad7a None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:14:24.644038 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:14:24.713810 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecfaf75-4a2a-43a4-90b8-5b8e0a9dad7a None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:14:24.746463 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1806390e-839b-40d1-bb10-4a8f387ec270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:14:24.747078 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1806390e-839b-40d1-bb10-4a8f387ec270 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:24.747356 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1806390e-839b-40d1-bb10-4a8f387ec270 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:24.747631 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1806390e-839b-40d1-bb10-4a8f387ec270 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:24.755366 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1806390e-839b-40d1-bb10-4a8f387ec270 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:14:24.756865 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1806390e-839b-40d1-bb10-4a8f387ec270 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:14:24.767573 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-1806390e-839b-40d1-bb10-4a8f387ec270 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 09 10:14:24.767573 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:14:24.767573 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:14:24.767573 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:14:24.767573 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:14:24.767573 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:14:24.767573 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:14:24.767573 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:14:24.767573 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:14:24.767573 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:14:24.767573 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:14:24.767573 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:14:24.767573 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 09 10:14:24.767573 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 09 10:14:24.767573 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 09 10:14:24.767573 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 09 10:14:24.768648 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:14:24.768648 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:14:24.768648 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 09 10:14:24.768648 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 10:14:24.768648 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 09 10:14:24.768648 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 09 10:14:24.768648 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:14:24.768648 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:14:24.768648 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:14:24.768648 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:14:24.768648 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:14:24.768648 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:14:24.768648 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:14:24.768648 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:14:24.768648 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:14:24.768648 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:14:24.768648 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:14:24.768648 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:14:24.769826 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:14:24.769826 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:14:24.769826 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 09 10:14:24.769826 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 09 10:14:24.769826 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 09 10:14:24.769826 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 09 10:14:24.769826 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 09 10:14:24.769826 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 09 10:14:24.769826 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 09 10:14:24.769826 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:14:24.769826 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 641/1280] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:14:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:14:24.774669 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f9d775-c0ff-4a9a-a20c-5125391f67e8 None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:14:24.778397 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:14:24.870926 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f9d775-c0ff-4a9a-a20c-5125391f67e8 None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:14:24.902970 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eade9617-4b0e-4060-afb4-e698536816cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:14:24.903547 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade9617-4b0e-4060-afb4-e698536816cf None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:24.903754 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade9617-4b0e-4060-afb4-e698536816cf None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:24.904021 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade9617-4b0e-4060-afb4-e698536816cf None admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:24.904721 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eade9617-4b0e-4060-afb4-e698536816cf None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:14:24.905020 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eade9617-4b0e-4060-afb4-e698536816cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:14:24.906446 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eade9617-4b0e-4060-afb4-e698536816cf None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:14:24.922956 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 640/1281] 10.222.0.36 () {56 vars in 1143 bytes} [Tue Aug 9 10:14:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:14:24.929239 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1806390e-839b-40d1-bb10-4a8f387ec270 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:14:25.018951 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:14:25.029330 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1806390e-839b-40d1-bb10-4a8f387ec270 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:14:25.063200 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef82f287-f9c0-4075-a941-7ba4e4a9e6ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:14:25.063796 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef82f287-f9c0-4075-a941-7ba4e4a9e6ad None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:25.064076 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef82f287-f9c0-4075-a941-7ba4e4a9e6ad None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:25.064347 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef82f287-f9c0-4075-a941-7ba4e4a9e6ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:25.128747 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef82f287-f9c0-4075-a941-7ba4e4a9e6ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:14:25.130775 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef82f287-f9c0-4075-a941-7ba4e4a9e6ad None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:14:25.218703 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:14:25.229035 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 642/1282] 10.222.0.36 () {58 vars in 1282 bytes} [Tue Aug 9 10:14:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 09 10:14:25.234817 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eade9617-4b0e-4060-afb4-e698536816cf None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:14:25.295895 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:14:25.333897 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eade9617-4b0e-4060-afb4-e698536816cf None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:14:25.367500 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af941d9d-2f7e-47d8-9ab2-0de73f1281ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:14:25.368113 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af941d9d-2f7e-47d8-9ab2-0de73f1281ce None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:25.368391 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af941d9d-2f7e-47d8-9ab2-0de73f1281ce None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:25.368661 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af941d9d-2f7e-47d8-9ab2-0de73f1281ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:25.378363 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af941d9d-2f7e-47d8-9ab2-0de73f1281ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:14:25.380448 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af941d9d-2f7e-47d8-9ab2-0de73f1281ce None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:14:25.394494 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-af941d9d-2f7e-47d8-9ab2-0de73f1281ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:14:25.394494 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:14:25.394494 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:14:25.394494 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:14:25.394494 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:14:25.394494 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:14:25.394494 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:14:25.394494 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:14:25.394494 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:14:25.394494 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:14:25.394494 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:14:25.394494 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:14:25.394494 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 09 10:14:25.394494 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 09 10:14:25.394494 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 09 10:14:25.394494 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 09 10:14:25.396122 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:14:25.396122 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:14:25.396122 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:14:25.396122 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:14:25.396122 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:14:25.396122 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:14:25.396122 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:14:25.396122 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:14:25.396122 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:14:25.396122 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:14:25.396122 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:14:25.396122 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:14:25.396122 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:14:25.396122 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:14:25.396122 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:14:25.396122 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:14:25.396122 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 09 10:14:25.397350 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 09 10:14:25.397350 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 09 10:14:25.397350 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:14:25.397350 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 641/1283] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:14:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:14:25.402017 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef82f287-f9c0-4075-a941-7ba4e4a9e6ad None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:14:25.496678 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef82f287-f9c0-4075-a941-7ba4e4a9e6ad None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:14:25.529650 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64d8c01-67d0-4be1-ada8-00b66aee03c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:14:25.530260 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d8c01-67d0-4be1-ada8-00b66aee03c8 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:25.530536 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d8c01-67d0-4be1-ada8-00b66aee03c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:25.530804 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d8c01-67d0-4be1-ada8-00b66aee03c8 None admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:25.531433 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64d8c01-67d0-4be1-ada8-00b66aee03c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:14:25.531729 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64d8c01-67d0-4be1-ada8-00b66aee03c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:14:25.533078 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64d8c01-67d0-4be1-ada8-00b66aee03c8 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:14:25.544024 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 643/1284] 10.222.0.36 () {56 vars in 1109 bytes} [Tue Aug 9 10:14:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:14:25.549569 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af941d9d-2f7e-47d8-9ab2-0de73f1281ce None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:14:25.654163 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af941d9d-2f7e-47d8-9ab2-0de73f1281ce None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:14:25.668152 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:14:25.687970 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cdabb3-311f-48a9-bb1a-eb68fa9bcb6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:14:25.688581 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cdabb3-311f-48a9-bb1a-eb68fa9bcb6c None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:25.688856 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cdabb3-311f-48a9-bb1a-eb68fa9bcb6c None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:25.689123 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cdabb3-311f-48a9-bb1a-eb68fa9bcb6c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:25.695949 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cdabb3-311f-48a9-bb1a-eb68fa9bcb6c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:14:25.697373 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cdabb3-311f-48a9-bb1a-eb68fa9bcb6c None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:14:25.709170 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application [None req-a5cdabb3-311f-48a9-bb1a-eb68fa9bcb6c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 10:14:25.709170 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:14:25.709170 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:14:25.709170 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:14:25.709170 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:14:25.709170 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:14:25.709170 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:14:25.709170 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:14:25.709170 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:14:25.709170 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:14:25.709170 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:14:25.709170 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:14:25.709170 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 09 10:14:25.709170 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 09 10:14:25.709170 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 09 10:14:25.710225 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 09 10:14:25.710225 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:14:25.710225 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:14:25.710225 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:14:25.710225 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:14:25.710225 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:14:25.710225 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:14:25.710225 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:14:25.710225 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application with Lock( Aug 09 10:14:25.710225 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:14:25.710225 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:14:25.710225 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:14:25.710225 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:14:25.710225 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:14:25.710225 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:14:25.710225 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:14:25.710225 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:14:25.711442 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 09 10:14:25.711442 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 09 10:14:25.711442 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 09 10:14:25.711442 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 09 10:14:25.711442 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 09 10:14:25.711442 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 09 10:14:25.711442 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 09 10:14:25.711442 dv-cinder-852364-2-smb devstack@keystone.service[80105]: ERROR keystone.server.flask.application Aug 09 10:14:25.711442 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 642/1285] 10.222.0.36 () {56 vars in 1111 bytes} [Tue Aug 9 10:14:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:14:25.716105 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64d8c01-67d0-4be1-ada8-00b66aee03c8 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:14:25.763813 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:14:25.811595 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64d8c01-67d0-4be1-ada8-00b66aee03c8 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:14:25.843923 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75231e30-c97f-40e0-b61a-c81d7eb8bb26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:14:25.844508 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75231e30-c97f-40e0-b61a-c81d7eb8bb26 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:25.844780 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75231e30-c97f-40e0-b61a-c81d7eb8bb26 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:25.845049 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75231e30-c97f-40e0-b61a-c81d7eb8bb26 None admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:25.845721 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75231e30-c97f-40e0-b61a-c81d7eb8bb26 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:14:25.846048 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75231e30-c97f-40e0-b61a-c81d7eb8bb26 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:14:25.847454 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75231e30-c97f-40e0-b61a-c81d7eb8bb26 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:14:25.858875 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 644/1286] 10.222.0.36 () {56 vars in 1148 bytes} [Tue Aug 9 10:14:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:14:25.864869 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cdabb3-311f-48a9-bb1a-eb68fa9bcb6c None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:14:25.963298 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cdabb3-311f-48a9-bb1a-eb68fa9bcb6c None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:14:25.995675 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41437295-2d5f-4491-ab8d-b3d91fc55bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:14:25.996268 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41437295-2d5f-4491-ab8d-b3d91fc55bbd None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:25.996546 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41437295-2d5f-4491-ab8d-b3d91fc55bbd None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:25.996814 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41437295-2d5f-4491-ab8d-b3d91fc55bbd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:25.997521 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41437295-2d5f-4491-ab8d-b3d91fc55bbd None admin] RBAC: Adding query filter params (role.id=89ca30cbbb634be8a96e9921aa56626b, scope.project.id=28891cf6239a43469326a864fb0d216c, user.id=c4d3b6a332394adf9e1b81ee9c171c48) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:14:25.997830 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41437295-2d5f-4491-ab8d-b3d91fc55bbd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:14:25.999287 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41437295-2d5f-4491-ab8d-b3d91fc55bbd None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:14:26.005338 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 643/1287] 10.222.0.36 () {56 vars in 1374 bytes} [Tue Aug 9 10:14:25 2022] GET /identity/v3/role_assignments?user.id=c4d3b6a332394adf9e1b81ee9c171c48&scope.project.id=28891cf6239a43469326a864fb0d216c&role.id=89ca30cbbb634be8a96e9921aa56626b => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:14:28.004221 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4574624-046c-43ea-ad6d-7f57b4d60e52 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:28.004716 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4574624-046c-43ea-ad6d-7f57b4d60e52 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:28.004805 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4574624-046c-43ea-ad6d-7f57b4d60e52 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:28.006210 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 645/1288] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:14:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:14:28.011180 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314ccace-432f-47d5-b956-9d326d90947d None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:28.011615 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314ccace-432f-47d5-b956-9d326d90947d None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:28.011719 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314ccace-432f-47d5-b956-9d326d90947d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:28.029739 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-314ccace-432f-47d5-b956-9d326d90947d None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:14:28.030933 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-314ccace-432f-47d5-b956-9d326d90947d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:14:28.059745 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:14:28.096141 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 644/1289] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:14:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 10:14:28.117747 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4574624-046c-43ea-ad6d-7f57b4d60e52 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:14:28.215186 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4574624-046c-43ea-ad6d-7f57b4d60e52 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:14:28.225152 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:14:28.247430 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade37dd8-52f3-42f6-bcf2-4bf66d5bca6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:14:28.248030 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade37dd8-52f3-42f6-bcf2-4bf66d5bca6d None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:28.248303 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade37dd8-52f3-42f6-bcf2-4bf66d5bca6d None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:28.248567 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade37dd8-52f3-42f6-bcf2-4bf66d5bca6d None admin] PATH_INFO: `/v3/services/placement` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:28.249134 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade37dd8-52f3-42f6-bcf2-4bf66d5bca6d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:14:28.250515 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade37dd8-52f3-42f6-bcf2-4bf66d5bca6d None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:14:28.259629 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-ade37dd8-52f3-42f6-bcf2-4bf66d5bca6d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 09 10:14:28.259629 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:14:28.259629 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 10:14:28.259629 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 10:14:28.259629 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 10:14:28.259629 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 10:14:28.259629 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 10:14:28.259629 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 10:14:28.259629 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 09 10:14:28.259629 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:14:28.259629 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 10:14:28.259629 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:14:28.259629 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:14:28.259629 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:14:28.259629 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:14:28.259629 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:14:28.259629 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:14:28.260785 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:14:28.260785 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:14:28.260785 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:14:28.260785 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:14:28.260785 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:14:28.260785 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:14:28.260785 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 10:14:28.260785 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 10:14:28.260785 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 10:14:28.260785 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 10:14:28.260785 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:14:28.260785 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:14:28.260785 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:14:28.260785 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:14:28.260785 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:14:28.260785 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:14:28.262063 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:14:28.262063 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:14:28.262063 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:14:28.262063 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:14:28.262063 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:14:28.262063 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:14:28.262063 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:14:28.262063 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:14:28.262063 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:14:28.262063 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:14:28.262063 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 10:14:28.262063 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 10:14:28.262063 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 09 10:14:28.262063 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:14:28.262063 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 646/1290] 10.222.0.36 () {56 vars in 1117 bytes} [Tue Aug 9 10:14:28 2022] GET /identity/v3/services/placement => generated 90 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:14:28.266561 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314ccace-432f-47d5-b956-9d326d90947d None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:14:28.361031 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314ccace-432f-47d5-b956-9d326d90947d None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:14:28.393090 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4ea936-aa27-49b2-b66b-83f9622b85bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:14:28.393677 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4ea936-aa27-49b2-b66b-83f9622b85bb None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:28.393986 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4ea936-aa27-49b2-b66b-83f9622b85bb None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:28.394254 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4ea936-aa27-49b2-b66b-83f9622b85bb None admin] PATH_INFO: `/v3/services` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:28.394952 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4ea936-aa27-49b2-b66b-83f9622b85bb None admin] RBAC: Adding query filter params (name=placement) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:14:28.395253 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4ea936-aa27-49b2-b66b-83f9622b85bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:14:28.396581 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4ea936-aa27-49b2-b66b-83f9622b85bb None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:14:28.401151 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 645/1291] 10.222.0.36 () {56 vars in 1116 bytes} [Tue Aug 9 10:14:28 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:14:28.406752 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade37dd8-52f3-42f6-bcf2-4bf66d5bca6d None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:14:28.504002 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade37dd8-52f3-42f6-bcf2-4bf66d5bca6d None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:14:28.536207 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab7d531-6b3a-4162-b045-ec788def1c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:14:28.536787 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab7d531-6b3a-4162-b045-ec788def1c79 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:28.537063 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab7d531-6b3a-4162-b045-ec788def1c79 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:28.537332 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab7d531-6b3a-4162-b045-ec788def1c79 None admin] PATH_INFO: `/v3/services` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:28.537973 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab7d531-6b3a-4162-b045-ec788def1c79 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:14:28.538277 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab7d531-6b3a-4162-b045-ec788def1c79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:14:28.539876 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab7d531-6b3a-4162-b045-ec788def1c79 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:14:28.544071 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 647/1292] 10.222.0.36 () {56 vars in 1116 bytes} [Tue Aug 9 10:14:28 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:14:30.537112 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b7f0c3-db86-4fb9-ac2b-6efc9ef79bbe None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:30.537703 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b7f0c3-db86-4fb9-ac2b-6efc9ef79bbe None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:30.537703 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b7f0c3-db86-4fb9-ac2b-6efc9ef79bbe None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:30.539270 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 646/1293] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:14:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:14:30.544179 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df396c53-1d59-4b6b-a67b-8a2603f49a4f None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:30.544599 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df396c53-1d59-4b6b-a67b-8a2603f49a4f None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:30.544719 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df396c53-1d59-4b6b-a67b-8a2603f49a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:30.562882 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-df396c53-1d59-4b6b-a67b-8a2603f49a4f None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:14:30.564052 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-df396c53-1d59-4b6b-a67b-8a2603f49a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:14:30.592745 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:14:30.642073 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 648/1294] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:14:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 10:14:30.667154 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b7f0c3-db86-4fb9-ac2b-6efc9ef79bbe None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:14:30.698479 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:14:30.765602 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b7f0c3-db86-4fb9-ac2b-6efc9ef79bbe None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:14:30.798024 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f5d6b3-d7f2-4bd5-878a-38b7ba37a783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:14:30.798545 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5d6b3-d7f2-4bd5-878a-38b7ba37a783 None admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:30.798818 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5d6b3-d7f2-4bd5-878a-38b7ba37a783 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:30.799085 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5d6b3-d7f2-4bd5-878a-38b7ba37a783 None admin] PATH_INFO: `/v3/services` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:30.799698 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f5d6b3-d7f2-4bd5-878a-38b7ba37a783 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:14:30.801551 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f5d6b3-d7f2-4bd5-878a-38b7ba37a783 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:14:30.815336 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 647/1295] 10.222.0.36 () {60 vars in 1141 bytes} [Tue Aug 9 10:14:30 2022] POST /identity/v3/services => generated 246 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:14:32.796000 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6293b8-8526-4dd7-9ebd-efefc178af1d None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:32.796559 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6293b8-8526-4dd7-9ebd-efefc178af1d None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:32.796559 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6293b8-8526-4dd7-9ebd-efefc178af1d None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:32.797903 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 649/1296] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:14:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:14:32.803148 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba669977-2348-4194-bbfe-3577b4bcbe44 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:32.803558 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba669977-2348-4194-bbfe-3577b4bcbe44 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:32.803692 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba669977-2348-4194-bbfe-3577b4bcbe44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:32.821561 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-ba669977-2348-4194-bbfe-3577b4bcbe44 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:14:32.822750 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-ba669977-2348-4194-bbfe-3577b4bcbe44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:14:32.892494 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 648/1297] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:14:32 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 09 10:14:32.915498 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6293b8-8526-4dd7-9ebd-efefc178af1d None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:14:33.015121 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6293b8-8526-4dd7-9ebd-efefc178af1d None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:14:33.047860 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab801e5a-6a9d-4c8f-bc4c-523b2db5939a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:14:33.048403 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab801e5a-6a9d-4c8f-bc4c-523b2db5939a None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:33.048676 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab801e5a-6a9d-4c8f-bc4c-523b2db5939a None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:33.048941 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab801e5a-6a9d-4c8f-bc4c-523b2db5939a None admin] PATH_INFO: `/v3/services/placement` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:33.049509 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab801e5a-6a9d-4c8f-bc4c-523b2db5939a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:14:33.051412 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab801e5a-6a9d-4c8f-bc4c-523b2db5939a None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:14:33.059849 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-ab801e5a-6a9d-4c8f-bc4c-523b2db5939a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 09 10:14:33.059849 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:14:33.059849 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 10:14:33.059849 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 10:14:33.059849 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 10:14:33.059849 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 10:14:33.059849 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 10:14:33.059849 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 10:14:33.059849 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 09 10:14:33.059849 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:14:33.059849 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 10:14:33.059849 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:14:33.059849 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:14:33.059849 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:14:33.059849 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:14:33.059849 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:14:33.059849 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:14:33.061073 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:14:33.061073 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:14:33.061073 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:14:33.061073 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:14:33.061073 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:14:33.061073 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:14:33.061073 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 10:14:33.061073 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 10:14:33.061073 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 10:14:33.061073 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 10:14:33.061073 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:14:33.061073 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:14:33.061073 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:14:33.061073 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:14:33.061073 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:14:33.061073 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:14:33.062180 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:14:33.062180 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:14:33.062180 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:14:33.062180 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:14:33.062180 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:14:33.062180 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:14:33.062180 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:14:33.062180 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:14:33.062180 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:14:33.062180 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:14:33.062180 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 10:14:33.062180 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 10:14:33.062180 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 09 10:14:33.062180 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:14:33.062180 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 650/1298] 10.222.0.36 () {56 vars in 1117 bytes} [Tue Aug 9 10:14:32 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:14:33.067536 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba669977-2348-4194-bbfe-3577b4bcbe44 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:14:33.085637 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:14:33.163726 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba669977-2348-4194-bbfe-3577b4bcbe44 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:14:33.196680 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b28de41-433a-4aae-8baa-24c7709b63de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:14:33.197268 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b28de41-433a-4aae-8baa-24c7709b63de None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:33.197545 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b28de41-433a-4aae-8baa-24c7709b63de None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:33.197818 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b28de41-433a-4aae-8baa-24c7709b63de None admin] PATH_INFO: `/v3/services` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:33.198469 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b28de41-433a-4aae-8baa-24c7709b63de None admin] RBAC: Adding query filter params (name=placement) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:14:33.198771 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b28de41-433a-4aae-8baa-24c7709b63de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:14:33.200112 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b28de41-433a-4aae-8baa-24c7709b63de None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:14:33.205010 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 649/1299] 10.222.0.36 () {56 vars in 1116 bytes} [Tue Aug 9 10:14:33 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:14:33.211338 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab801e5a-6a9d-4c8f-bc4c-523b2db5939a None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:14:33.242568 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:14:33.309864 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab801e5a-6a9d-4c8f-bc4c-523b2db5939a None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:14:33.342962 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a58847d-83c8-44cc-ae7b-f81e71cb80fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:14:33.343548 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a58847d-83c8-44cc-ae7b-f81e71cb80fe None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:33.343820 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a58847d-83c8-44cc-ae7b-f81e71cb80fe None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:33.344087 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a58847d-83c8-44cc-ae7b-f81e71cb80fe None admin] PATH_INFO: `/v3/endpoints` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:33.344774 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a58847d-83c8-44cc-ae7b-f81e71cb80fe None admin] RBAC: Adding query filter params (interface=public, service_id=bac1b3c257f6416c8186b4c43506899a, region_id=RegionOne) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:14:33.345078 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a58847d-83c8-44cc-ae7b-f81e71cb80fe None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:14:33.346460 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a58847d-83c8-44cc-ae7b-f81e71cb80fe None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:14:33.351742 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 651/1300] 10.222.0.36 () {56 vars in 1251 bytes} [Tue Aug 9 10:14:33 2022] GET /identity/v3/endpoints?service_id=bac1b3c257f6416c8186b4c43506899a&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:14:33.357243 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b28de41-433a-4aae-8baa-24c7709b63de None admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:14:33.435532 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:14:33.453592 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b28de41-433a-4aae-8baa-24c7709b63de None admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:14:33.486159 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf02918-8539-46ef-90d9-155e10dad250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:14:33.486748 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf02918-8539-46ef-90d9-155e10dad250 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:33.487025 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf02918-8539-46ef-90d9-155e10dad250 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:33.487296 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf02918-8539-46ef-90d9-155e10dad250 None admin] PATH_INFO: `/v3/services` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:33.487891 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf02918-8539-46ef-90d9-155e10dad250 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:14:33.489978 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf02918-8539-46ef-90d9-155e10dad250 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:14:33.496541 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 650/1301] 10.222.0.36 () {56 vars in 1087 bytes} [Tue Aug 9 10:14:33 2022] GET /identity/v3/services => generated 2191 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:14:35.512236 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c714944-fa05-4419-99d8-f5ea70465f3a None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:35.512788 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c714944-fa05-4419-99d8-f5ea70465f3a None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:35.512788 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c714944-fa05-4419-99d8-f5ea70465f3a None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:35.514132 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 652/1302] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:14:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:14:35.519196 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86faab1f-155c-4e95-a445-09fd0398380c None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:35.520127 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86faab1f-155c-4e95-a445-09fd0398380c None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:35.520428 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86faab1f-155c-4e95-a445-09fd0398380c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:35.538488 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-86faab1f-155c-4e95-a445-09fd0398380c None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:14:35.539896 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-86faab1f-155c-4e95-a445-09fd0398380c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:14:35.605910 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 651/1303] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:14:35 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 09 10:14:35.634562 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c714944-fa05-4419-99d8-f5ea70465f3a None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:14:35.726830 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:14:35.733552 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c714944-fa05-4419-99d8-f5ea70465f3a None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:14:35.765523 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeecdcb-2c54-4116-9957-056ef3bbaf12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:14:35.766090 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeecdcb-2c54-4116-9957-056ef3bbaf12 None admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:35.766363 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeecdcb-2c54-4116-9957-056ef3bbaf12 None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:35.766627 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeecdcb-2c54-4116-9957-056ef3bbaf12 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:35.767195 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeecdcb-2c54-4116-9957-056ef3bbaf12 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:14:35.768537 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeecdcb-2c54-4116-9957-056ef3bbaf12 None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:14:35.777458 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application [None req-8eeecdcb-2c54-4116-9957-056ef3bbaf12 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 09 10:14:35.777458 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:14:35.777458 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 09 10:14:35.777458 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 09 10:14:35.777458 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 09 10:14:35.777458 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 09 10:14:35.777458 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 09 10:14:35.777458 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 10:14:35.777458 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 09 10:14:35.777458 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:14:35.777458 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 09 10:14:35.777458 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:14:35.777458 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 09 10:14:35.777458 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 09 10:14:35.777458 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 09 10:14:35.777458 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 09 10:14:35.777458 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 09 10:14:35.778630 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 09 10:14:35.778630 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 09 10:14:35.778630 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 09 10:14:35.778630 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 09 10:14:35.778630 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 09 10:14:35.778630 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 09 10:14:35.778630 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 09 10:14:35.778630 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 09 10:14:35.778630 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 09 10:14:35.778630 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 09 10:14:35.778630 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 09 10:14:35.778630 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 09 10:14:35.778630 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 09 10:14:35.778630 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 09 10:14:35.778630 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 09 10:14:35.778630 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.get_or_create( Aug 09 10:14:35.779478 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 09 10:14:35.779478 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application with Lock( Aug 09 10:14:35.779478 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 09 10:14:35.779478 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self._enter() Aug 09 10:14:35.779478 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 09 10:14:35.779478 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 09 10:14:35.779478 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 09 10:14:35.779478 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application return self.creator() Aug 09 10:14:35.779478 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 09 10:14:35.779478 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application created_value = creator( Aug 09 10:14:35.779478 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 09 10:14:35.779478 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 09 10:14:35.779478 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 09 10:14:35.779478 dv-cinder-852364-2-smb devstack@keystone.service[80106]: ERROR keystone.server.flask.application Aug 09 10:14:35.779478 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 653/1304] 10.222.0.36 () {56 vars in 1117 bytes} [Tue Aug 9 10:14:35 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 09 10:14:35.784612 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86faab1f-155c-4e95-a445-09fd0398380c None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:14:35.860034 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:14:35.883483 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86faab1f-155c-4e95-a445-09fd0398380c None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:14:35.916570 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb47721-ca90-4c55-8bf7-fa30f5ec5e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:14:35.917166 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb47721-ca90-4c55-8bf7-fa30f5ec5e60 None admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:35.917444 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb47721-ca90-4c55-8bf7-fa30f5ec5e60 None admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:35.917717 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb47721-ca90-4c55-8bf7-fa30f5ec5e60 None admin] PATH_INFO: `/v3/services` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:35.918365 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb47721-ca90-4c55-8bf7-fa30f5ec5e60 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:14:35.918671 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb47721-ca90-4c55-8bf7-fa30f5ec5e60 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:14:35.920013 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb47721-ca90-4c55-8bf7-fa30f5ec5e60 None admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:14:35.925030 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 652/1305] 10.222.0.36 () {56 vars in 1116 bytes} [Tue Aug 9 10:14:35 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:14:35.931409 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeecdcb-2c54-4116-9957-056ef3bbaf12 None admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:14:36.031709 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeecdcb-2c54-4116-9957-056ef3bbaf12 None admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:14:36.065251 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e80cc4-9f96-4e23-84ad-157da88d538a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:14:36.065868 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e80cc4-9f96-4e23-84ad-157da88d538a None admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:14:36.066148 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e80cc4-9f96-4e23-84ad-157da88d538a None admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:14:36.066420 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e80cc4-9f96-4e23-84ad-157da88d538a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:14:36.067642 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e80cc4-9f96-4e23-84ad-157da88d538a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:14:36.069003 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e80cc4-9f96-4e23-84ad-157da88d538a None admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:14:36.088295 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 654/1306] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:14:35 2022] POST /identity/v3/endpoints => generated 331 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:14:45.922178 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=30 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:14:46.084552 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:15:39.054214 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a296bb-3127-48a5-978d-ad1b38de22c7 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:15:39.055217 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a296bb-3127-48a5-978d-ad1b38de22c7 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:15:39.055502 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a296bb-3127-48a5-978d-ad1b38de22c7 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:15:39.057045 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 653/1307] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:15:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:15:39.062507 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da56bbc8-3cf9-41ce-8f10-10dfcf10c5af None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:15:39.063429 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da56bbc8-3cf9-41ce-8f10-10dfcf10c5af None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:15:39.063919 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da56bbc8-3cf9-41ce-8f10-10dfcf10c5af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:15:39.257941 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-da56bbc8-3cf9-41ce-8f10-10dfcf10c5af None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:15:39.259510 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-da56bbc8-3cf9-41ce-8f10-10dfcf10c5af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:15:39.535538 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 655/1308] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:15:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 465 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:15:39.568970 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d7900b-d8c3-4a52-ae55-178a8fb6279d None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:15:39.569630 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d7900b-d8c3-4a52-ae55-178a8fb6279d None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:15:39.570164 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d7900b-d8c3-4a52-ae55-178a8fb6279d None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:15:39.571578 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 654/1309] 10.222.0.36 () {54 vars in 965 bytes} [Tue Aug 9 10:15:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:15:39.577922 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b49d55-4f8f-49c3-b7b0-b05ea89ea9b7 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:15:39.578219 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b49d55-4f8f-49c3-b7b0-b05ea89ea9b7 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:15:39.578496 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b49d55-4f8f-49c3-b7b0-b05ea89ea9b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:15:39.667219 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-19b49d55-4f8f-49c3-b7b0-b05ea89ea9b7 None None] MFA Rules not processed for user `9169847a16764da3a2a1dbb5f5f56438`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:15:39.668416 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-19b49d55-4f8f-49c3-b7b0-b05ea89ea9b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:15:39.691137 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:15:39.752331 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 656/1310] 10.222.0.36 () {58 vars in 1062 bytes} [Tue Aug 9 10:15:39 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:15:39.761636 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d7900b-d8c3-4a52-ae55-178a8fb6279d None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:15:39.763528 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-b5d7900b-d8c3-4a52-ae55-178a8fb6279d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:15:39.892090 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d7900b-d8c3-4a52-ae55-178a8fb6279d None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:15:39.977129 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0f8b3e-b919-4253-b471-13db23168ef2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:15:39.977863 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f8b3e-b919-4253-b471-13db23168ef2 service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:15:39.978206 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f8b3e-b919-4253-b471-13db23168ef2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:15:39.978544 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f8b3e-b919-4253-b471-13db23168ef2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:15:39.980228 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-aa0f8b3e-b919-4253-b471-13db23168ef2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:15:40.043430 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:15:40.111001 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0f8b3e-b919-4253-b471-13db23168ef2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:15:40.113167 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0f8b3e-b919-4253-b471-13db23168ef2 service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:15:40.134423 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 655/1311] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:15:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:15:42.478647 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e799d9-2d46-48a3-813c-d4d2309abc2a None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:15:42.479231 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e799d9-2d46-48a3-813c-d4d2309abc2a None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:15:42.479231 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e799d9-2d46-48a3-813c-d4d2309abc2a None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:15:42.480708 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 657/1312] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:15:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:15:42.489058 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e0716a-5b36-4ded-9e42-d9fc5f76265b None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:15:42.489058 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e0716a-5b36-4ded-9e42-d9fc5f76265b None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:15:42.489058 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e0716a-5b36-4ded-9e42-d9fc5f76265b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:15:42.585174 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-55e0716a-5b36-4ded-9e42-d9fc5f76265b None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:15:42.586438 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-55e0716a-5b36-4ded-9e42-d9fc5f76265b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:15:42.687791 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 656/1313] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:15:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:15:42.727086 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e799d9-2d46-48a3-813c-d4d2309abc2a None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:15:42.728676 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-d5e799d9-2d46-48a3-813c-d4d2309abc2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:15:42.844553 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e799d9-2d46-48a3-813c-d4d2309abc2a None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:15:42.921200 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:15:42.924018 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc6d664-8dbf-4ce6-ad77-144ff68bd3c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:15:42.924620 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc6d664-8dbf-4ce6-ad77-144ff68bd3c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:15:42.925080 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc6d664-8dbf-4ce6-ad77-144ff68bd3c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:15:42.925522 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc6d664-8dbf-4ce6-ad77-144ff68bd3c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:15:42.927331 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-bcc6d664-8dbf-4ce6-ad77-144ff68bd3c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:15:43.056801 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc6d664-8dbf-4ce6-ad77-144ff68bd3c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:15:43.058629 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc6d664-8dbf-4ce6-ad77-144ff68bd3c6 service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:15:43.082298 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 658/1314] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:15:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:15:45.410625 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a790bbba-f00f-46fd-9bff-2e2a96175a46 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:15:45.411270 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a790bbba-f00f-46fd-9bff-2e2a96175a46 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:15:45.411270 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a790bbba-f00f-46fd-9bff-2e2a96175a46 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:15:45.412521 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 657/1315] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:15:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:15:45.418067 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f38791-fe40-448c-abb2-6f6083c1f897 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:15:45.418494 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f38791-fe40-448c-abb2-6f6083c1f897 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:15:45.418606 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f38791-fe40-448c-abb2-6f6083c1f897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:15:45.485365 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-48f38791-fe40-448c-abb2-6f6083c1f897 None None] MFA Rules not processed for user `bdb286c28efa42b5a3fd021d0345a5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:15:45.486669 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-48f38791-fe40-448c-abb2-6f6083c1f897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:15:45.538479 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:15:45.583323 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 659/1316] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:15:45 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:15:45.625069 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a790bbba-f00f-46fd-9bff-2e2a96175a46 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:15:45.627188 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-a790bbba-f00f-46fd-9bff-2e2a96175a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:15:45.637048 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:15:45.735398 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a790bbba-f00f-46fd-9bff-2e2a96175a46 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:15:45.810021 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be66794-22db-4202-ab04-284541c11f32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:15:45.810618 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be66794-22db-4202-ab04-284541c11f32 service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:15:45.810894 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be66794-22db-4202-ab04-284541c11f32 service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:15:45.811166 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be66794-22db-4202-ab04-284541c11f32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:15:45.812755 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-9be66794-22db-4202-ab04-284541c11f32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:15:45.873459 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:15:45.919607 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be66794-22db-4202-ab04-284541c11f32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:15:45.921015 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be66794-22db-4202-ab04-284541c11f32 service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:15:45.938881 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 658/1317] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:15:45 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:15:48.512798 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea1c5c-d862-42e5-834b-efb4c27ade16 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:15:48.513358 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea1c5c-d862-42e5-834b-efb4c27ade16 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:15:48.513358 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea1c5c-d862-42e5-834b-efb4c27ade16 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:15:48.514691 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 660/1318] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:15:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:15:48.519949 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96040d9c-947e-47da-b433-1a830a92bfb4 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:15:48.520374 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96040d9c-947e-47da-b433-1a830a92bfb4 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:15:48.520524 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96040d9c-947e-47da-b433-1a830a92bfb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:15:48.585296 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-96040d9c-947e-47da-b433-1a830a92bfb4 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:15:48.586503 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-96040d9c-947e-47da-b433-1a830a92bfb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:15:48.681535 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 659/1319] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:15:48 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:15:48.720743 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ea1c5c-d862-42e5-834b-efb4c27ade16 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:15:48.722326 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-15ea1c5c-d862-42e5-834b-efb4c27ade16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:15:48.824440 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ea1c5c-d862-42e5-834b-efb4c27ade16 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:15:48.896822 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7f42b3-2ead-4cef-885b-7c5e7026aac0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:15:48.897412 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f42b3-2ead-4cef-885b-7c5e7026aac0 service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:15:48.897687 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f42b3-2ead-4cef-885b-7c5e7026aac0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:15:48.897982 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f42b3-2ead-4cef-885b-7c5e7026aac0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:15:48.899572 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-5c7f42b3-2ead-4cef-885b-7c5e7026aac0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:15:48.907390 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:15:49.014622 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7f42b3-2ead-4cef-885b-7c5e7026aac0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:15:49.017354 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7f42b3-2ead-4cef-885b-7c5e7026aac0 service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:15:49.042168 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 661/1320] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:15:48 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:15:51.704640 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca6a871-9139-4d3a-aff6-7f7a8768e6d0 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:15:51.705213 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca6a871-9139-4d3a-aff6-7f7a8768e6d0 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:15:51.705213 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca6a871-9139-4d3a-aff6-7f7a8768e6d0 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:15:51.706743 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 660/1321] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:15:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:15:51.711786 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89a9162-6a9f-41e8-b481-d753cae82786 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:15:51.712196 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89a9162-6a9f-41e8-b481-d753cae82786 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:15:51.712326 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89a9162-6a9f-41e8-b481-d753cae82786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:15:51.776894 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-f89a9162-6a9f-41e8-b481-d753cae82786 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:15:51.778106 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-f89a9162-6a9f-41e8-b481-d753cae82786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:15:51.836292 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:15:51.883387 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 662/1322] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:15:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:15:51.920483 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca6a871-9139-4d3a-aff6-7f7a8768e6d0 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:15:51.922063 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-4ca6a871-9139-4d3a-aff6-7f7a8768e6d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:15:51.944145 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:15:52.036599 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca6a871-9139-4d3a-aff6-7f7a8768e6d0 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:15:52.111439 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52016e22-ff12-4881-a306-9173e4e8f058 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:15:52.112075 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52016e22-ff12-4881-a306-9173e4e8f058 service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:15:52.112357 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52016e22-ff12-4881-a306-9173e4e8f058 service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:15:52.112630 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52016e22-ff12-4881-a306-9173e4e8f058 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:15:52.114272 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-52016e22-ff12-4881-a306-9173e4e8f058 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:15:52.185864 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:15:52.225266 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52016e22-ff12-4881-a306-9173e4e8f058 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:15:52.226759 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52016e22-ff12-4881-a306-9173e4e8f058 service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:15:52.245016 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 661/1323] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:15:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:15:54.303422 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eae932-f226-4635-a2ca-18a81c40c71a None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:15:54.303976 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eae932-f226-4635-a2ca-18a81c40c71a None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:15:54.303976 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eae932-f226-4635-a2ca-18a81c40c71a None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:15:54.305363 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 663/1324] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:15:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:15:54.310589 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e2de54-63ab-462f-b538-65912362409e None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:15:54.310984 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e2de54-63ab-462f-b538-65912362409e None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:15:54.311254 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e2de54-63ab-462f-b538-65912362409e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:15:54.377917 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-77e2de54-63ab-462f-b538-65912362409e None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:15:54.379147 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-77e2de54-63ab-462f-b538-65912362409e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:15:54.477240 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 662/1325] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:15:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:15:54.514385 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eae932-f226-4635-a2ca-18a81c40c71a None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:15:54.516624 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-12eae932-f226-4635-a2ca-18a81c40c71a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:15:54.620464 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eae932-f226-4635-a2ca-18a81c40c71a None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:15:54.699623 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1656d9ed-269f-480b-b5a6-bedf44094aa2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:15:54.699831 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1656d9ed-269f-480b-b5a6-bedf44094aa2 service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:15:54.700109 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1656d9ed-269f-480b-b5a6-bedf44094aa2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:15:54.700380 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1656d9ed-269f-480b-b5a6-bedf44094aa2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:15:54.702043 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-1656d9ed-269f-480b-b5a6-bedf44094aa2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:15:54.719454 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:15:54.816165 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1656d9ed-269f-480b-b5a6-bedf44094aa2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:15:54.817624 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1656d9ed-269f-480b-b5a6-bedf44094aa2 service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:15:54.836176 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 664/1326] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:15:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:15:56.949789 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3311d0-e7a4-40f9-a9ea-2519f656b415 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:15:56.950240 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3311d0-e7a4-40f9-a9ea-2519f656b415 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:15:56.950364 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3311d0-e7a4-40f9-a9ea-2519f656b415 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:15:56.951705 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 663/1327] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:15:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:15:56.958154 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02501bbc-7233-4b1a-9f99-59141d15ae4a None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:15:56.958571 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02501bbc-7233-4b1a-9f99-59141d15ae4a None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:15:56.958737 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02501bbc-7233-4b1a-9f99-59141d15ae4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:15:57.025824 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-02501bbc-7233-4b1a-9f99-59141d15ae4a None None] MFA Rules not processed for user `bdb286c28efa42b5a3fd021d0345a5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:15:57.027091 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-02501bbc-7233-4b1a-9f99-59141d15ae4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:15:57.090923 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:15:57.127664 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 665/1328] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:15:56 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:15:57.165262 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3311d0-e7a4-40f9-a9ea-2519f656b415 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:15:57.166833 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-8a3311d0-e7a4-40f9-a9ea-2519f656b415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:15:57.201096 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:15:57.278891 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3311d0-e7a4-40f9-a9ea-2519f656b415 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:15:57.353675 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a7f572-6d29-4110-a0a6-f10e0bd0992b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:15:57.354322 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a7f572-6d29-4110-a0a6-f10e0bd0992b service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:15:57.354601 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a7f572-6d29-4110-a0a6-f10e0bd0992b service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:15:57.354873 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a7f572-6d29-4110-a0a6-f10e0bd0992b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:15:57.356485 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-92a7f572-6d29-4110-a0a6-f10e0bd0992b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:15:57.436309 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:15:57.468624 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a7f572-6d29-4110-a0a6-f10e0bd0992b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:15:57.470615 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a7f572-6d29-4110-a0a6-f10e0bd0992b service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:15:57.489500 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 664/1329] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:15:57 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:15:59.777548 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40126094-cb04-4849-8037-9e2910efa750 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:15:59.778076 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40126094-cb04-4849-8037-9e2910efa750 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:15:59.778076 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40126094-cb04-4849-8037-9e2910efa750 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:15:59.779372 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 666/1330] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:15:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:15:59.785115 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da36ff45-ef64-412f-b06f-7f0d93fb20fc None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:15:59.785521 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da36ff45-ef64-412f-b06f-7f0d93fb20fc None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:15:59.785672 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da36ff45-ef64-412f-b06f-7f0d93fb20fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:15:59.850621 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-da36ff45-ef64-412f-b06f-7f0d93fb20fc None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:15:59.851839 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-da36ff45-ef64-412f-b06f-7f0d93fb20fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:15:59.946343 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 665/1331] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:15:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:15:59.994975 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b04c06-4a16-43e9-8161-6993859f5d48 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:15:59.995252 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b04c06-4a16-43e9-8161-6993859f5d48 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:15:59.995519 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b04c06-4a16-43e9-8161-6993859f5d48 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:15:59.996925 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 667/1332] 10.222.0.36 () {54 vars in 965 bytes} [Tue Aug 9 10:15:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:16:00.002828 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd5172-5ec3-4b61-b252-389cfc3e72f5 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:16:00.003115 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd5172-5ec3-4b61-b252-389cfc3e72f5 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:16:00.003388 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd5172-5ec3-4b61-b252-389cfc3e72f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:16:00.048403 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:16:00.079048 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-34bd5172-5ec3-4b61-b252-389cfc3e72f5 None None] MFA Rules not processed for user `9169847a16764da3a2a1dbb5f5f56438`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:16:00.080239 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-34bd5172-5ec3-4b61-b252-389cfc3e72f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:16:00.160948 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 666/1333] 10.222.0.36 () {58 vars in 1062 bytes} [Tue Aug 9 10:16:00 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:16:00.170375 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b04c06-4a16-43e9-8161-6993859f5d48 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:16:00.171919 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-61b04c06-4a16-43e9-8161-6993859f5d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:16:00.285692 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b04c06-4a16-43e9-8161-6993859f5d48 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:16:00.359544 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e3a93f-bd82-4aa0-a21c-5bde011a3b19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:16:00.360142 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e3a93f-bd82-4aa0-a21c-5bde011a3b19 service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:16:00.360425 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e3a93f-bd82-4aa0-a21c-5bde011a3b19 service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:16:00.360702 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e3a93f-bd82-4aa0-a21c-5bde011a3b19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:16:00.362355 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-56e3a93f-bd82-4aa0-a21c-5bde011a3b19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:16:00.392079 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:16:00.477755 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e3a93f-bd82-4aa0-a21c-5bde011a3b19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:16:00.479235 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e3a93f-bd82-4aa0-a21c-5bde011a3b19 service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:16:00.498524 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 668/1334] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:16:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:16:02.804863 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ce8bf-f950-41af-9b71-be83fb87e270 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:16:02.805403 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ce8bf-f950-41af-9b71-be83fb87e270 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:16:02.805403 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ce8bf-f950-41af-9b71-be83fb87e270 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:16:02.806817 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 667/1335] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:16:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:16:02.811943 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a6790b-39fc-4a68-85fc-843ff2176f30 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:16:02.812986 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a6790b-39fc-4a68-85fc-843ff2176f30 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:16:02.813436 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a6790b-39fc-4a68-85fc-843ff2176f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:16:02.879671 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-c1a6790b-39fc-4a68-85fc-843ff2176f30 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:16:02.880859 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-c1a6790b-39fc-4a68-85fc-843ff2176f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:16:02.955611 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:16:02.978438 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 669/1336] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:16:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:16:03.019494 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8ce8bf-f950-41af-9b71-be83fb87e270 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:16:03.021030 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-fb8ce8bf-f950-41af-9b71-be83fb87e270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:16:03.122375 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8ce8bf-f950-41af-9b71-be83fb87e270 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:16:03.151102 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:16:03.200009 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c39502-ec7b-4f85-b2e8-d60bc846e4d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:16:03.200613 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c39502-ec7b-4f85-b2e8-d60bc846e4d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:16:03.200887 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c39502-ec7b-4f85-b2e8-d60bc846e4d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:16:03.201155 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c39502-ec7b-4f85-b2e8-d60bc846e4d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:16:03.202826 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-c1c39502-ec7b-4f85-b2e8-d60bc846e4d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:16:03.429083 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c39502-ec7b-4f85-b2e8-d60bc846e4d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:16:03.430543 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c39502-ec7b-4f85-b2e8-d60bc846e4d1 service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:16:03.447894 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 668/1337] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:16:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:16:06.123284 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9cd5a3-e14c-4bb3-9da8-88ab2d8de912 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:16:06.123831 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9cd5a3-e14c-4bb3-9da8-88ab2d8de912 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:16:06.123831 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9cd5a3-e14c-4bb3-9da8-88ab2d8de912 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:16:06.125390 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 670/1338] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:16:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:16:06.130626 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a2d722-2b62-404c-80eb-a7a7366e536d None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:16:06.131034 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a2d722-2b62-404c-80eb-a7a7366e536d None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:16:06.131171 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a2d722-2b62-404c-80eb-a7a7366e536d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:16:06.197410 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-18a2d722-2b62-404c-80eb-a7a7366e536d None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:16:06.198544 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-18a2d722-2b62-404c-80eb-a7a7366e536d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:16:06.207639 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:16:06.299488 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 669/1339] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:16:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:16:06.343041 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9cd5a3-e14c-4bb3-9da8-88ab2d8de912 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:16:06.345647 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-1d9cd5a3-e14c-4bb3-9da8-88ab2d8de912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:16:06.446947 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9cd5a3-e14c-4bb3-9da8-88ab2d8de912 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:16:06.518740 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4042f198-e56f-4510-b321-673ebef803f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:16:06.519265 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4042f198-e56f-4510-b321-673ebef803f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:16:06.519539 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4042f198-e56f-4510-b321-673ebef803f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:16:06.519808 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4042f198-e56f-4510-b321-673ebef803f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:16:06.521397 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-4042f198-e56f-4510-b321-673ebef803f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:16:06.558272 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:16:06.632289 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4042f198-e56f-4510-b321-673ebef803f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:16:06.633726 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4042f198-e56f-4510-b321-673ebef803f0 service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:16:06.651726 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 671/1340] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:16:06 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:16:10.716470 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a04379e-8675-4cd6-b6df-32d5f76448b2 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:16:10.717073 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a04379e-8675-4cd6-b6df-32d5f76448b2 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:16:10.717073 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a04379e-8675-4cd6-b6df-32d5f76448b2 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:16:10.719090 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 670/1341] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:16:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:16:10.724373 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dcadeb-2aea-4933-904e-9ec94bec4008 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:16:10.724817 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dcadeb-2aea-4933-904e-9ec94bec4008 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:16:10.724914 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dcadeb-2aea-4933-904e-9ec94bec4008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:16:10.790268 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-63dcadeb-2aea-4933-904e-9ec94bec4008 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:16:10.791383 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-63dcadeb-2aea-4933-904e-9ec94bec4008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:16:10.875183 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:16:10.887119 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 672/1342] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:16:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:16:10.929501 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a04379e-8675-4cd6-b6df-32d5f76448b2 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:16:10.930745 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-7a04379e-8675-4cd6-b6df-32d5f76448b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:16:11.043154 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a04379e-8675-4cd6-b6df-32d5f76448b2 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:16:11.081906 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:16:11.120055 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ee2f06-1467-47df-a970-6fac5a23ab9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:16:11.120649 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee2f06-1467-47df-a970-6fac5a23ab9a service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:16:11.120922 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee2f06-1467-47df-a970-6fac5a23ab9a service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:16:11.121186 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee2f06-1467-47df-a970-6fac5a23ab9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:16:11.122809 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-e1ee2f06-1467-47df-a970-6fac5a23ab9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:16:11.231394 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ee2f06-1467-47df-a970-6fac5a23ab9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:16:11.232657 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ee2f06-1467-47df-a970-6fac5a23ab9a service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:16:11.253697 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 671/1343] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:16:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:16:13.880286 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5c5fa7-b6cb-4dcc-9a78-49ac48c6c326 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:16:13.880872 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5c5fa7-b6cb-4dcc-9a78-49ac48c6c326 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:16:13.880872 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5c5fa7-b6cb-4dcc-9a78-49ac48c6c326 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:16:13.882435 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 673/1344] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:16:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:16:13.887764 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310553df-7dab-4f18-a7e7-a19469c4a20c None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:16:13.888258 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310553df-7dab-4f18-a7e7-a19469c4a20c None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:16:13.888335 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310553df-7dab-4f18-a7e7-a19469c4a20c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:16:13.961061 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-310553df-7dab-4f18-a7e7-a19469c4a20c None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:16:13.962276 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-310553df-7dab-4f18-a7e7-a19469c4a20c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:16:13.981479 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:16:14.060831 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 672/1345] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:16:13 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:16:14.098716 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5c5fa7-b6cb-4dcc-9a78-49ac48c6c326 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:16:14.100243 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-4c5c5fa7-b6cb-4dcc-9a78-49ac48c6c326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:16:14.204132 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5c5fa7-b6cb-4dcc-9a78-49ac48c6c326 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:16:14.277308 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36cd87a-b661-4956-bced-18478c5edcd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:16:14.277935 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36cd87a-b661-4956-bced-18478c5edcd4 service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:16:14.278213 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36cd87a-b661-4956-bced-18478c5edcd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:16:14.278482 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36cd87a-b661-4956-bced-18478c5edcd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:16:14.280077 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-f36cd87a-b661-4956-bced-18478c5edcd4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:16:14.323300 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:16:14.389547 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36cd87a-b661-4956-bced-18478c5edcd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:16:14.391729 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36cd87a-b661-4956-bced-18478c5edcd4 service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:16:14.410277 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 674/1346] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:16:14 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:16:18.384580 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24567b3f-d146-4b45-8838-6a41083d4831 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:16:18.385169 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24567b3f-d146-4b45-8838-6a41083d4831 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:16:18.385169 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24567b3f-d146-4b45-8838-6a41083d4831 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:16:18.386486 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 673/1347] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:16:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:16:18.392285 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6832537a-4772-4c8b-9036-bdaa7647e3c2 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:16:18.392756 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6832537a-4772-4c8b-9036-bdaa7647e3c2 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:16:18.392871 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6832537a-4772-4c8b-9036-bdaa7647e3c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:16:18.459968 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-6832537a-4772-4c8b-9036-bdaa7647e3c2 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:16:18.461163 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-6832537a-4772-4c8b-9036-bdaa7647e3c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:16:18.555164 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:16:18.557778 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 675/1348] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:16:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:16:18.596501 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24567b3f-d146-4b45-8838-6a41083d4831 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:16:18.598129 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-24567b3f-d146-4b45-8838-6a41083d4831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:16:18.709767 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24567b3f-d146-4b45-8838-6a41083d4831 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:16:18.772019 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:16:18.799684 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c505ed2-dd50-45dd-94b3-603a38cea370 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:16:18.800284 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c505ed2-dd50-45dd-94b3-603a38cea370 service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:16:18.800562 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c505ed2-dd50-45dd-94b3-603a38cea370 service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:16:18.800830 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c505ed2-dd50-45dd-94b3-603a38cea370 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:16:18.803219 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-9c505ed2-dd50-45dd-94b3-603a38cea370 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:16:18.932729 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c505ed2-dd50-45dd-94b3-603a38cea370 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:16:18.934230 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c505ed2-dd50-45dd-94b3-603a38cea370 service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:16:18.956049 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 674/1349] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:16:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:16:23.883977 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad7715-c52f-45af-b13c-4deaebaf9fff None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:16:23.884439 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad7715-c52f-45af-b13c-4deaebaf9fff None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:16:23.884570 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad7715-c52f-45af-b13c-4deaebaf9fff None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:16:23.885901 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 676/1350] 10.222.0.36 () {54 vars in 921 bytes} [Tue Aug 9 10:16:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:16:23.891826 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fae2d0-a0e4-423c-9c1f-077cd8672098 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:16:23.892660 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fae2d0-a0e4-423c-9c1f-077cd8672098 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:16:23.893150 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fae2d0-a0e4-423c-9c1f-077cd8672098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:16:24.052290 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-72fae2d0-a0e4-423c-9c1f-077cd8672098 None None] MFA Rules not processed for user `c4d3b6a332394adf9e1b81ee9c171c48`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:16:24.053483 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-72fae2d0-a0e4-423c-9c1f-077cd8672098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:16:24.072902 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:16:24.167573 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 675/1351] 10.222.0.36 () {58 vars in 1018 bytes} [Tue Aug 9 10:16:23 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:16:28.497419 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9807154-de75-4528-8cdd-6fefeb880918 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:16:28.498125 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9807154-de75-4528-8cdd-6fefeb880918 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:16:28.498125 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9807154-de75-4528-8cdd-6fefeb880918 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:16:28.500315 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 677/1352] 10.222.0.36 () {54 vars in 921 bytes} [Tue Aug 9 10:16:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:16:28.505171 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0a5f22-a7b6-4642-958d-987d882da09b None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:16:28.506035 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0a5f22-a7b6-4642-958d-987d882da09b None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:16:28.506896 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0a5f22-a7b6-4642-958d-987d882da09b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:16:28.602947 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-9f0a5f22-a7b6-4642-958d-987d882da09b None None] MFA Rules not processed for user `c4d3b6a332394adf9e1b81ee9c171c48`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:16:28.604803 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-9f0a5f22-a7b6-4642-958d-987d882da09b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:16:28.690193 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:16:28.734065 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 676/1353] 10.222.0.36 () {58 vars in 1018 bytes} [Tue Aug 9 10:16:28 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:16:29.806626 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36758f56-5ae1-4eed-835a-6f259dc91c56 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:16:29.807435 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36758f56-5ae1-4eed-835a-6f259dc91c56 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:16:29.807435 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36758f56-5ae1-4eed-835a-6f259dc91c56 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:16:29.808739 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 678/1354] 10.222.0.36 () {54 vars in 921 bytes} [Tue Aug 9 10:16:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:16:29.814245 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92d0e76-0604-4697-9a99-845ea2a48292 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:16:29.814670 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92d0e76-0604-4697-9a99-845ea2a48292 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:16:29.814866 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92d0e76-0604-4697-9a99-845ea2a48292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:16:29.895490 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-c92d0e76-0604-4697-9a99-845ea2a48292 None None] MFA Rules not processed for user `c4d3b6a332394adf9e1b81ee9c171c48`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:16:29.896726 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-c92d0e76-0604-4697-9a99-845ea2a48292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:16:30.006808 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 677/1355] 10.222.0.36 () {58 vars in 1018 bytes} [Tue Aug 9 10:16:29 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:16:33.466151 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18430d91-abe1-4706-8767-d1ea8904b63f None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:16:33.467130 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18430d91-abe1-4706-8767-d1ea8904b63f None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:16:33.467603 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18430d91-abe1-4706-8767-d1ea8904b63f None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:16:33.470301 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 679/1356] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:16:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:16:33.476556 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16784d53-bfe3-44c7-969d-7123348bdcdb None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:16:33.477443 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16784d53-bfe3-44c7-969d-7123348bdcdb None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:16:33.477963 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16784d53-bfe3-44c7-969d-7123348bdcdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:16:33.537329 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:16:33.573568 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-16784d53-bfe3-44c7-969d-7123348bdcdb None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:16:33.574993 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-16784d53-bfe3-44c7-969d-7123348bdcdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:16:33.678913 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 678/1357] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:16:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:16:33.730791 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65a08d5-7b1f-46ef-9ee4-8800355f2e10 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:16:33.731320 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65a08d5-7b1f-46ef-9ee4-8800355f2e10 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:16:33.731791 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65a08d5-7b1f-46ef-9ee4-8800355f2e10 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:16:33.733376 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 680/1358] 10.222.0.36 () {54 vars in 962 bytes} [Tue Aug 9 10:16:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:16:33.742601 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d82552-33a4-4a22-b81a-465cabd327fd None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:16:33.742891 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d82552-33a4-4a22-b81a-465cabd327fd None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:16:33.743178 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d82552-33a4-4a22-b81a-465cabd327fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:16:33.836557 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-b2d82552-33a4-4a22-b81a-465cabd327fd None None] MFA Rules not processed for user `eb863beaaa9f495c8b64655996c061f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:16:33.837748 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-b2d82552-33a4-4a22-b81a-465cabd327fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:16:33.891299 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:16:33.965576 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 679/1359] 10.222.0.36 () {58 vars in 1059 bytes} [Tue Aug 9 10:16:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:16:33.974086 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65a08d5-7b1f-46ef-9ee4-8800355f2e10 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:16:33.975763 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-e65a08d5-7b1f-46ef-9ee4-8800355f2e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:16:34.125270 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65a08d5-7b1f-46ef-9ee4-8800355f2e10 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:16:34.212851 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:16:34.246350 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51090a1d-7c36-49c8-9af9-a9f4b28195ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb863beaaa9f495c8b64655996c061f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:16:34.246959 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51090a1d-7c36-49c8-9af9-a9f4b28195ae service nova] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:16:34.247242 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51090a1d-7c36-49c8-9af9-a9f4b28195ae service nova] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:16:34.247519 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51090a1d-7c36-49c8-9af9-a9f4b28195ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:16:34.249589 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-51090a1d-7c36-49c8-9af9-a9f4b28195ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:16:34.350487 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51090a1d-7c36-49c8-9af9-a9f4b28195ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:16:34.352071 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51090a1d-7c36-49c8-9af9-a9f4b28195ae service nova] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:16:34.372167 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 681/1360] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:16:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:16:36.606489 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b3a0d-952c-4806-86dc-46cb41650202 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:16:36.606985 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b3a0d-952c-4806-86dc-46cb41650202 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:16:36.607163 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b3a0d-952c-4806-86dc-46cb41650202 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:16:36.608901 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 680/1361] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:16:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:16:36.614567 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbbbdac-e890-4f98-b788-a9d247340d89 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:16:36.615275 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbbbdac-e890-4f98-b788-a9d247340d89 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:16:36.615275 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbbbdac-e890-4f98-b788-a9d247340d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:16:36.684377 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-adbbbdac-e890-4f98-b788-a9d247340d89 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:16:36.685486 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-adbbbdac-e890-4f98-b788-a9d247340d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:16:36.725167 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:16:36.792030 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 682/1362] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:16:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:16:36.838175 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56b3a0d-952c-4806-86dc-46cb41650202 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:16:36.839876 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-c56b3a0d-952c-4806-86dc-46cb41650202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:16:37.036786 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56b3a0d-952c-4806-86dc-46cb41650202 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:16:37.048022 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:16:37.179928 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a6152d-8561-4f9a-b213-05b061b7026a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb863beaaa9f495c8b64655996c061f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:16:37.180603 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a6152d-8561-4f9a-b213-05b061b7026a service nova] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:16:37.180945 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a6152d-8561-4f9a-b213-05b061b7026a service nova] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:16:37.181280 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a6152d-8561-4f9a-b213-05b061b7026a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:16:37.182955 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-c8a6152d-8561-4f9a-b213-05b061b7026a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:16:37.285039 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a6152d-8561-4f9a-b213-05b061b7026a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:16:37.286683 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a6152d-8561-4f9a-b213-05b061b7026a service nova] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:16:37.307918 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 681/1363] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:16:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:16:39.680705 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee0fdb-67be-4af1-bd34-850b23041251 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:16:39.681312 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee0fdb-67be-4af1-bd34-850b23041251 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:16:39.681312 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee0fdb-67be-4af1-bd34-850b23041251 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:16:39.685447 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 683/1364] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:16:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:16:39.693565 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac8dd15-3953-41c8-ace9-3a5054487884 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:16:39.694114 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac8dd15-3953-41c8-ace9-3a5054487884 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:16:39.694342 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac8dd15-3953-41c8-ace9-3a5054487884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:16:39.711840 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:16:39.775460 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-8ac8dd15-3953-41c8-ace9-3a5054487884 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:16:39.777044 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-8ac8dd15-3953-41c8-ace9-3a5054487884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:16:39.891653 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 682/1365] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:16:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:16:39.936808 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa9837d-d097-46c4-aa6e-1b871aa2ceca None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:16:39.937165 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa9837d-d097-46c4-aa6e-1b871aa2ceca None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:16:39.937657 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa9837d-d097-46c4-aa6e-1b871aa2ceca None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:16:39.939141 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 684/1366] 10.222.0.36 () {54 vars in 962 bytes} [Tue Aug 9 10:16:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:16:39.945694 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7a0b80-f5be-4193-b9f3-fcc489bb2442 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:16:39.946788 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7a0b80-f5be-4193-b9f3-fcc489bb2442 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:16:39.947071 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7a0b80-f5be-4193-b9f3-fcc489bb2442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:16:40.027553 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-8b7a0b80-f5be-4193-b9f3-fcc489bb2442 None None] MFA Rules not processed for user `eb863beaaa9f495c8b64655996c061f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:16:40.028757 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-8b7a0b80-f5be-4193-b9f3-fcc489bb2442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:16:40.066919 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:16:40.152941 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 683/1367] 10.222.0.36 () {58 vars in 1059 bytes} [Tue Aug 9 10:16:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:16:40.161058 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa9837d-d097-46c4-aa6e-1b871aa2ceca None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:16:40.162867 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-2aa9837d-d097-46c4-aa6e-1b871aa2ceca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:16:40.319716 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa9837d-d097-46c4-aa6e-1b871aa2ceca None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:16:40.341475 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:16:40.441502 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6b9c3a-ecdb-44a9-b62a-f3013cb9fa21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb863beaaa9f495c8b64655996c061f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:16:40.442036 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b9c3a-ecdb-44a9-b62a-f3013cb9fa21 service nova] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:16:40.442314 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b9c3a-ecdb-44a9-b62a-f3013cb9fa21 service nova] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:16:40.442584 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b9c3a-ecdb-44a9-b62a-f3013cb9fa21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:16:40.444210 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-ba6b9c3a-ecdb-44a9-b62a-f3013cb9fa21 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:16:40.538836 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6b9c3a-ecdb-44a9-b62a-f3013cb9fa21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:16:40.540440 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6b9c3a-ecdb-44a9-b62a-f3013cb9fa21 service nova] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:16:40.559925 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 685/1368] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:16:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:16:41.673065 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950bc5f9-f820-4dcf-bf28-03d613eefbb7 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:16:41.673622 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950bc5f9-f820-4dcf-bf28-03d613eefbb7 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:16:41.673622 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950bc5f9-f820-4dcf-bf28-03d613eefbb7 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:16:41.675151 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 684/1369] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:16:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 10:16:41.680158 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d651c5-7f50-4679-9e62-6bb47379292d None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:16:41.680576 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d651c5-7f50-4679-9e62-6bb47379292d None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:16:41.680752 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d651c5-7f50-4679-9e62-6bb47379292d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:16:41.715776 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:16:41.756144 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-53d651c5-7f50-4679-9e62-6bb47379292d None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:16:41.757364 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-53d651c5-7f50-4679-9e62-6bb47379292d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:16:41.869895 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 686/1370] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:16:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:16:42.216620 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9e88c-9844-418f-8ee3-459f62d39481 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:16:42.218140 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9e88c-9844-418f-8ee3-459f62d39481 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:16:42.218140 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9e88c-9844-418f-8ee3-459f62d39481 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:16:42.219430 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 685/1371] 10.222.0.36 () {54 vars in 964 bytes} [Tue Aug 9 10:16:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:16:42.224331 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303b976-c5d5-45f9-8c79-7ee178e149d7 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:16:42.224691 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303b976-c5d5-45f9-8c79-7ee178e149d7 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:16:42.225028 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303b976-c5d5-45f9-8c79-7ee178e149d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:16:42.316741 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-4303b976-c5d5-45f9-8c79-7ee178e149d7 None None] MFA Rules not processed for user `1f6c687a38524de0bf23d87ae91d3b0f`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:16:42.317964 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-4303b976-c5d5-45f9-8c79-7ee178e149d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:16:42.367933 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:16:42.403013 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 687/1372] 10.222.0.36 () {58 vars in 1061 bytes} [Tue Aug 9 10:16:42 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:16:42.412320 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b9e88c-9844-418f-8ee3-459f62d39481 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:16:42.414068 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-78b9e88c-9844-418f-8ee3-459f62d39481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:16:42.523357 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b9e88c-9844-418f-8ee3-459f62d39481 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:16:42.565505 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:16:42.606047 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d10d66-72fe-45eb-8c65-a5e767f8fc58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6c687a38524de0bf23d87ae91d3b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:16:42.606652 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d10d66-72fe-45eb-8c65-a5e767f8fc58 service cinder] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:16:42.606927 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d10d66-72fe-45eb-8c65-a5e767f8fc58 service cinder] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:16:42.607260 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d10d66-72fe-45eb-8c65-a5e767f8fc58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:16:42.608958 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-70d10d66-72fe-45eb-8c65-a5e767f8fc58 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:16:42.657660 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaef5cf-42ad-4034-afe7-148c011eda3b None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:16:42.657996 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaef5cf-42ad-4034-afe7-148c011eda3b None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:16:42.658271 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaef5cf-42ad-4034-afe7-148c011eda3b None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:16:42.659960 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 688/1373] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:16:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:16:42.665403 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a94bc-8e09-4041-89e4-c14ac9fdc60d None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:16:42.665694 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a94bc-8e09-4041-89e4-c14ac9fdc60d None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:16:42.665998 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a94bc-8e09-4041-89e4-c14ac9fdc60d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:16:42.741036 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d10d66-72fe-45eb-8c65-a5e767f8fc58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:16:42.742533 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d10d66-72fe-45eb-8c65-a5e767f8fc58 service cinder] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:16:42.757302 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-0c9a94bc-8e09-4041-89e4-c14ac9fdc60d None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:16:42.758957 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-0c9a94bc-8e09-4041-89e4-c14ac9fdc60d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:16:42.763067 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 686/1374] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:16:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 10:16:42.869891 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 689/1375] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:16:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 10:16:42.924881 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d10d66-72fe-45eb-8c65-a5e767f8fc58 service cinder] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:16:42.924881 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-70d10d66-72fe-45eb-8c65-a5e767f8fc58 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:16:43.024319 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:16:43.057936 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d10d66-72fe-45eb-8c65-a5e767f8fc58 service cinder] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:16:43.175737 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f390aba-6a0b-4a3c-a977-d1710a705d55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb863beaaa9f495c8b64655996c061f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:16:43.176346 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f390aba-6a0b-4a3c-a977-d1710a705d55 service nova] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:16:43.176606 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f390aba-6a0b-4a3c-a977-d1710a705d55 service nova] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:16:43.176875 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f390aba-6a0b-4a3c-a977-d1710a705d55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:16:43.178482 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-5f390aba-6a0b-4a3c-a977-d1710a705d55 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:16:43.256234 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:16:43.269096 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f390aba-6a0b-4a3c-a977-d1710a705d55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:16:43.270729 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f390aba-6a0b-4a3c-a977-d1710a705d55 service nova] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:16:43.289596 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 687/1376] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:16:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:16:45.320191 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b76fa-656b-401a-9e31-2e1890a1ac1b None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:16:45.320708 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b76fa-656b-401a-9e31-2e1890a1ac1b None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:16:45.320708 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b76fa-656b-401a-9e31-2e1890a1ac1b None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:16:45.322481 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 690/1377] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:16:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:16:45.328098 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be28825-2e43-4ea5-acaf-e8a9344e7204 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:16:45.328510 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be28825-2e43-4ea5-acaf-e8a9344e7204 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:16:45.328651 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be28825-2e43-4ea5-acaf-e8a9344e7204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:16:45.417111 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-7be28825-2e43-4ea5-acaf-e8a9344e7204 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:16:45.418261 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-7be28825-2e43-4ea5-acaf-e8a9344e7204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:16:45.517789 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 688/1378] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:16:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 10:16:45.559226 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50b76fa-656b-401a-9e31-2e1890a1ac1b None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:16:45.561196 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-e50b76fa-656b-401a-9e31-2e1890a1ac1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:16:45.624896 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:16:45.725002 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50b76fa-656b-401a-9e31-2e1890a1ac1b None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:16:45.858438 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0e516f-382e-4352-bcf1-fa1b3b498962 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb863beaaa9f495c8b64655996c061f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:16:45.858957 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e516f-382e-4352-bcf1-fa1b3b498962 service nova] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:16:45.859232 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e516f-382e-4352-bcf1-fa1b3b498962 service nova] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:16:45.859498 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e516f-382e-4352-bcf1-fa1b3b498962 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:16:45.861085 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-9d0e516f-382e-4352-bcf1-fa1b3b498962 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:16:45.872560 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:16:45.950111 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0e516f-382e-4352-bcf1-fa1b3b498962 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:16:45.952527 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0e516f-382e-4352-bcf1-fa1b3b498962 service nova] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:16:45.972440 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 691/1379] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:16:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:16:48.021616 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e418fbfc-c7e2-43ef-a04a-50eadc23e88f None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:16:48.022213 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e418fbfc-c7e2-43ef-a04a-50eadc23e88f None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:16:48.022213 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e418fbfc-c7e2-43ef-a04a-50eadc23e88f None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:16:48.023678 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 689/1380] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:16:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:16:48.028790 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dfa2a2-a40f-4778-9bb7-d95f3b4563aa None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:16:48.029313 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dfa2a2-a40f-4778-9bb7-d95f3b4563aa None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:16:48.029313 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dfa2a2-a40f-4778-9bb7-d95f3b4563aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:16:48.100473 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-46dfa2a2-a40f-4778-9bb7-d95f3b4563aa None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:16:48.101927 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-46dfa2a2-a40f-4778-9bb7-d95f3b4563aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:16:48.191811 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:16:48.206780 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 692/1381] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:16:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:16:48.250507 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e418fbfc-c7e2-43ef-a04a-50eadc23e88f None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:16:48.252005 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-e418fbfc-c7e2-43ef-a04a-50eadc23e88f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:16:48.329296 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:16:48.419256 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e418fbfc-c7e2-43ef-a04a-50eadc23e88f None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:16:48.537925 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9b26aa-2cb1-453e-970f-1c4e3b0ba9f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb863beaaa9f495c8b64655996c061f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:16:48.538596 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b26aa-2cb1-453e-970f-1c4e3b0ba9f8 service nova] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:16:48.538937 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b26aa-2cb1-453e-970f-1c4e3b0ba9f8 service nova] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:16:48.539271 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b26aa-2cb1-453e-970f-1c4e3b0ba9f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:16:48.540929 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-2e9b26aa-2cb1-453e-970f-1c4e3b0ba9f8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:16:48.563366 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:16:48.646459 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9b26aa-2cb1-453e-970f-1c4e3b0ba9f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:16:48.648043 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9b26aa-2cb1-453e-970f-1c4e3b0ba9f8 service nova] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:16:48.667604 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 690/1382] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:16:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:16:50.879386 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34eb747-e54f-4cc1-83e1-e8bd191f5304 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:16:50.879928 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34eb747-e54f-4cc1-83e1-e8bd191f5304 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:16:50.880085 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34eb747-e54f-4cc1-83e1-e8bd191f5304 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:16:50.882765 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 693/1383] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:16:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:16:50.889778 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3038ba3-a993-491c-9463-cb803a0daea1 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:16:50.890273 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3038ba3-a993-491c-9463-cb803a0daea1 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:16:50.890370 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3038ba3-a993-491c-9463-cb803a0daea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:16:50.957908 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-f3038ba3-a993-491c-9463-cb803a0daea1 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:16:50.959120 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-f3038ba3-a993-491c-9463-cb803a0daea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:16:51.063350 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:16:51.067643 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 691/1384] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:16:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:16:51.118910 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34eb747-e54f-4cc1-83e1-e8bd191f5304 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:16:51.120944 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-c34eb747-e54f-4cc1-83e1-e8bd191f5304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:16:51.288125 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34eb747-e54f-4cc1-83e1-e8bd191f5304 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:16:51.351468 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:16:51.402158 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6a2159-8522-4d89-980e-19f9be453b44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb863beaaa9f495c8b64655996c061f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:16:51.402760 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6a2159-8522-4d89-980e-19f9be453b44 service nova] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:16:51.403036 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6a2159-8522-4d89-980e-19f9be453b44 service nova] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:16:51.403302 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6a2159-8522-4d89-980e-19f9be453b44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:16:51.406000 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-1d6a2159-8522-4d89-980e-19f9be453b44 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:16:51.495220 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6a2159-8522-4d89-980e-19f9be453b44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:16:51.496740 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6a2159-8522-4d89-980e-19f9be453b44 service nova] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:16:51.516182 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 694/1385] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:16:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:16:53.563478 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b6a18-4a24-4611-a0e4-25b39130d8c2 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:16:53.564037 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b6a18-4a24-4611-a0e4-25b39130d8c2 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:16:53.564261 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b6a18-4a24-4611-a0e4-25b39130d8c2 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:16:53.566030 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 692/1386] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:16:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:16:53.571261 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f2f34b-a7ef-4b5f-b83d-de8b314403ed None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:16:53.571706 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f2f34b-a7ef-4b5f-b83d-de8b314403ed None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:16:53.571831 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f2f34b-a7ef-4b5f-b83d-de8b314403ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:16:53.643285 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-c1f2f34b-a7ef-4b5f-b83d-de8b314403ed None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:16:53.644487 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-c1f2f34b-a7ef-4b5f-b83d-de8b314403ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:16:53.670922 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:16:53.744211 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 695/1387] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:16:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:16:53.789161 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460b6a18-4a24-4611-a0e4-25b39130d8c2 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:16:53.790742 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-460b6a18-4a24-4611-a0e4-25b39130d8c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:16:53.951575 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460b6a18-4a24-4611-a0e4-25b39130d8c2 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:16:54.028549 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:16:54.081328 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9129fa48-8f55-4830-9fba-092dceb3e0e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb863beaaa9f495c8b64655996c061f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:16:54.082378 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9129fa48-8f55-4830-9fba-092dceb3e0e6 service nova] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:16:54.082783 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9129fa48-8f55-4830-9fba-092dceb3e0e6 service nova] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:16:54.083054 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9129fa48-8f55-4830-9fba-092dceb3e0e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:16:54.085455 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-9129fa48-8f55-4830-9fba-092dceb3e0e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:16:54.186587 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9129fa48-8f55-4830-9fba-092dceb3e0e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:16:54.188160 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9129fa48-8f55-4830-9fba-092dceb3e0e6 service nova] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:16:54.207665 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 693/1388] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:16:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:16:56.446680 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd91121d-725f-47f5-a737-1ebdd5dee6c6 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:16:56.447252 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd91121d-725f-47f5-a737-1ebdd5dee6c6 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:16:56.447252 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd91121d-725f-47f5-a737-1ebdd5dee6c6 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:16:56.448543 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 696/1389] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:16:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:16:56.454502 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d1fef-ca2a-4383-a3e3-431013187738 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:16:56.454940 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d1fef-ca2a-4383-a3e3-431013187738 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:16:56.455055 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d1fef-ca2a-4383-a3e3-431013187738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:16:56.521917 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-2b7d1fef-ca2a-4383-a3e3-431013187738 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:16:56.523115 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-2b7d1fef-ca2a-4383-a3e3-431013187738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:16:56.558793 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:16:56.624623 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 694/1390] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:16:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:16:56.670182 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd91121d-725f-47f5-a737-1ebdd5dee6c6 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:16:56.671653 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-cd91121d-725f-47f5-a737-1ebdd5dee6c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:16:56.819490 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd91121d-725f-47f5-a737-1ebdd5dee6c6 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:16:56.829147 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:16:56.942057 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270795e1-14c4-4454-9f52-4db60bc16af4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb863beaaa9f495c8b64655996c061f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:16:56.942685 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270795e1-14c4-4454-9f52-4db60bc16af4 service nova] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:16:56.942967 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270795e1-14c4-4454-9f52-4db60bc16af4 service nova] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:16:56.943240 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270795e1-14c4-4454-9f52-4db60bc16af4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:16:56.944983 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-270795e1-14c4-4454-9f52-4db60bc16af4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:16:57.035403 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270795e1-14c4-4454-9f52-4db60bc16af4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:16:57.037243 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270795e1-14c4-4454-9f52-4db60bc16af4 service nova] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:16:57.054866 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 697/1391] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:16:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:16:57.871503 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a61051d-0226-474b-b0ad-9ad63b6f2079 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:16:57.872576 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a61051d-0226-474b-b0ad-9ad63b6f2079 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:16:57.872576 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a61051d-0226-474b-b0ad-9ad63b6f2079 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:16:57.873942 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 695/1392] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:16:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:16:57.879264 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42997cb-6d5c-4ac9-b1d1-f2726d6606cd None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:16:57.879715 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42997cb-6d5c-4ac9-b1d1-f2726d6606cd None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:16:57.879936 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42997cb-6d5c-4ac9-b1d1-f2726d6606cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:16:57.895797 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:16:57.946522 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-f42997cb-6d5c-4ac9-b1d1-f2726d6606cd None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:16:57.947724 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-f42997cb-6d5c-4ac9-b1d1-f2726d6606cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:16:58.050438 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 698/1393] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:16:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:16:58.108503 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a0ce7-f552-4282-bebe-acf2adb856ab None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:16:58.108860 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a0ce7-f552-4282-bebe-acf2adb856ab None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:16:58.109214 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a0ce7-f552-4282-bebe-acf2adb856ab None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:16:58.110654 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 696/1394] 10.222.0.36 () {54 vars in 967 bytes} [Tue Aug 9 10:16:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:16:58.115812 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b906fb7a-c8c4-4f08-9fbf-4f8f474ea431 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:16:58.116099 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b906fb7a-c8c4-4f08-9fbf-4f8f474ea431 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:16:58.116368 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b906fb7a-c8c4-4f08-9fbf-4f8f474ea431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:16:58.193742 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-b906fb7a-c8c4-4f08-9fbf-4f8f474ea431 None None] MFA Rules not processed for user `07540b72afd34927855c41db09a7b030`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:16:58.195009 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-b906fb7a-c8c4-4f08-9fbf-4f8f474ea431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:16:58.230891 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:16:58.299027 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 699/1395] 10.222.0.36 () {58 vars in 1064 bytes} [Tue Aug 9 10:16:58 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:16:58.306604 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08a0ce7-f552-4282-bebe-acf2adb856ab None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:16:58.308107 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-c08a0ce7-f552-4282-bebe-acf2adb856ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:16:58.416054 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08a0ce7-f552-4282-bebe-acf2adb856ab None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:16:58.478782 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:16:58.491780 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044455e7-a14e-416a-9b8d-3692e355615a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07540b72afd34927855c41db09a7b030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:16:58.492377 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044455e7-a14e-416a-9b8d-3692e355615a service glance] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:16:58.492650 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044455e7-a14e-416a-9b8d-3692e355615a service glance] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:16:58.492917 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044455e7-a14e-416a-9b8d-3692e355615a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:16:58.494539 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-044455e7-a14e-416a-9b8d-3692e355615a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:16:58.604707 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044455e7-a14e-416a-9b8d-3692e355615a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:16:58.606176 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044455e7-a14e-416a-9b8d-3692e355615a service glance] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:16:58.625618 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 697/1396] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:16:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:16:59.141278 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f367a9-76a7-432c-9891-f06196c1ed0a None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:16:59.141744 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f367a9-76a7-432c-9891-f06196c1ed0a None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:16:59.141879 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f367a9-76a7-432c-9891-f06196c1ed0a None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:16:59.143170 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 700/1397] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:16:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:16:59.148440 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2ac0f-68a1-4099-8dbf-a1545091951d None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:16:59.148844 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2ac0f-68a1-4099-8dbf-a1545091951d None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:16:59.148987 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2ac0f-68a1-4099-8dbf-a1545091951d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:16:59.220999 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-8ba2ac0f-68a1-4099-8dbf-a1545091951d None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:16:59.222279 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-8ba2ac0f-68a1-4099-8dbf-a1545091951d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:16:59.269466 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:16:59.328405 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 698/1398] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:16:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:16:59.367783 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b318263-ef30-4ce7-aaeb-54e24a7d92ed None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:16:59.368074 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b318263-ef30-4ce7-aaeb-54e24a7d92ed None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:16:59.368355 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b318263-ef30-4ce7-aaeb-54e24a7d92ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:16:59.374847 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba2ac0f-68a1-4099-8dbf-a1545091951d None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:16:59.376068 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-8ba2ac0f-68a1-4099-8dbf-a1545091951d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:16:59.436828 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-2b318263-ef30-4ce7-aaeb-54e24a7d92ed None None] MFA Rules not processed for user `cedc4d6c59c44c6d8fb7179070db5e91`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:16:59.438145 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-2b318263-ef30-4ce7-aaeb-54e24a7d92ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:16:59.493226 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba2ac0f-68a1-4099-8dbf-a1545091951d None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:16:59.524069 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 701/1399] 10.222.0.36 () {58 vars in 1009 bytes} [Tue Aug 9 10:16:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:16:59.554776 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:16:59.574484 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091991e3-eddb-4f3d-90e9-8f951130898b None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:16:59.574850 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091991e3-eddb-4f3d-90e9-8f951130898b None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:16:59.576059 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091991e3-eddb-4f3d-90e9-8f951130898b None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:16:59.577611 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 702/1400] 10.222.0.36 () {54 vars in 943 bytes} [Tue Aug 9 10:16:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 10:16:59.583889 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78828aa-e505-4dbf-92a2-a6b6e12bb98c None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:16:59.584174 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78828aa-e505-4dbf-92a2-a6b6e12bb98c None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:16:59.584452 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78828aa-e505-4dbf-92a2-a6b6e12bb98c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:16:59.612967 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282888bc-92ad-4893-a5f4-747e84a2b4ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb863beaaa9f495c8b64655996c061f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:16:59.613508 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282888bc-92ad-4893-a5f4-747e84a2b4ca service nova] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:16:59.613783 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282888bc-92ad-4893-a5f4-747e84a2b4ca service nova] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:16:59.614083 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282888bc-92ad-4893-a5f4-747e84a2b4ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:16:59.615704 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-282888bc-92ad-4893-a5f4-747e84a2b4ca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:16:59.644898 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:16:59.666402 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-e78828aa-e505-4dbf-92a2-a6b6e12bb98c None None] MFA Rules not processed for user `841c5dbaae774944b637c533ebd75b29`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:16:59.667840 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-e78828aa-e505-4dbf-92a2-a6b6e12bb98c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:16:59.715924 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282888bc-92ad-4893-a5f4-747e84a2b4ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:16:59.717513 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282888bc-92ad-4893-a5f4-747e84a2b4ca service nova] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:16:59.736910 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 699/1401] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:16:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 10:16:59.779272 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 703/1402] 10.222.0.36 () {58 vars in 1040 bytes} [Tue Aug 9 10:16:59 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 10:16:59.788825 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282888bc-92ad-4893-a5f4-747e84a2b4ca service nova] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:16:59.790066 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-282888bc-92ad-4893-a5f4-747e84a2b4ca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:16:59.861132 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:16:59.889094 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282888bc-92ad-4893-a5f4-747e84a2b4ca service nova] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:17:00.006578 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb01f135-6326-46d3-bba4-d824ea1c42a1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '841c5dbaae774944b637c533ebd75b29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:17:00.007181 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb01f135-6326-46d3-bba4-d824ea1c42a1 service swift] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:17:00.007452 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb01f135-6326-46d3-bba4-d824ea1c42a1 service swift] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:17:00.007715 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb01f135-6326-46d3-bba4-d824ea1c42a1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:17:00.009329 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-eb01f135-6326-46d3-bba4-d824ea1c42a1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:17:00.093975 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb01f135-6326-46d3-bba4-d824ea1c42a1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:17:00.095554 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb01f135-6326-46d3-bba4-d824ea1c42a1 service swift] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:17:00.103708 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 700/1403] 10.222.0.36 () {60 vars in 1384 bytes} [Tue Aug 9 10:16:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 10:17:01.798247 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a9a13-f77c-48d5-9beb-302c4cf131f8 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:17:01.799143 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a9a13-f77c-48d5-9beb-302c4cf131f8 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:17:01.799416 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a9a13-f77c-48d5-9beb-302c4cf131f8 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:17:01.800823 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 704/1404] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:17:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:17:01.807499 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07017807-ee41-430e-8db1-3f848002ce02 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:17:01.807910 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07017807-ee41-430e-8db1-3f848002ce02 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:17:01.808049 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07017807-ee41-430e-8db1-3f848002ce02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:17:01.827378 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:17:01.923246 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-07017807-ee41-430e-8db1-3f848002ce02 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:17:01.924656 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-07017807-ee41-430e-8db1-3f848002ce02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:17:02.049373 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 701/1405] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:17:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:17:02.099005 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482a9a13-f77c-48d5-9beb-302c4cf131f8 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:17:02.100571 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-482a9a13-f77c-48d5-9beb-302c4cf131f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:17:02.240124 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:17:02.298742 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482a9a13-f77c-48d5-9beb-302c4cf131f8 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:17:02.433936 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008c45ef-0f56-4546-beca-d6fb73058b96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb863beaaa9f495c8b64655996c061f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:17:02.435578 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c45ef-0f56-4546-beca-d6fb73058b96 service nova] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:17:02.436027 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c45ef-0f56-4546-beca-d6fb73058b96 service nova] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:17:02.436306 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c45ef-0f56-4546-beca-d6fb73058b96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:17:02.438037 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-008c45ef-0f56-4546-beca-d6fb73058b96 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:17:02.519429 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:17:02.544445 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008c45ef-0f56-4546-beca-d6fb73058b96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:17:02.546354 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008c45ef-0f56-4546-beca-d6fb73058b96 service nova] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:17:02.565532 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 705/1406] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:17:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:17:04.674328 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4b9ea3-97f5-4948-b7a3-2d4b0fbdcee2 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:17:04.674896 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4b9ea3-97f5-4948-b7a3-2d4b0fbdcee2 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:17:04.674896 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4b9ea3-97f5-4948-b7a3-2d4b0fbdcee2 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:17:04.676209 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 702/1407] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:17:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:17:04.681280 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57051f74-7452-4651-845a-b9cd735b9a06 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:17:04.681710 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57051f74-7452-4651-845a-b9cd735b9a06 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:17:04.681806 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57051f74-7452-4651-845a-b9cd735b9a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:17:04.757786 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-57051f74-7452-4651-845a-b9cd735b9a06 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:17:04.759032 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-57051f74-7452-4651-845a-b9cd735b9a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:17:04.867773 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 706/1408] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:17:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:17:04.912884 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4b9ea3-97f5-4948-b7a3-2d4b0fbdcee2 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:17:04.914644 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-8f4b9ea3-97f5-4948-b7a3-2d4b0fbdcee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:17:05.018101 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:17:05.089677 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4b9ea3-97f5-4948-b7a3-2d4b0fbdcee2 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:17:05.222839 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc3324f-0172-49e8-bb4d-17af46341e03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb863beaaa9f495c8b64655996c061f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:17:05.223365 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3324f-0172-49e8-bb4d-17af46341e03 service nova] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:17:05.223642 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3324f-0172-49e8-bb4d-17af46341e03 service nova] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:17:05.223917 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3324f-0172-49e8-bb4d-17af46341e03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:17:05.225722 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-ffc3324f-0172-49e8-bb4d-17af46341e03 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:17:05.293230 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:17:05.333951 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc3324f-0172-49e8-bb4d-17af46341e03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:17:05.335573 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc3324f-0172-49e8-bb4d-17af46341e03 service nova] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:17:05.355524 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 703/1409] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:17:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:17:14.865732 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=79 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:17:15.353351 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=21 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:17:22.657444 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ecb19b-7f9c-48ea-a277-751158238b7f None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:17:22.658052 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ecb19b-7f9c-48ea-a277-751158238b7f None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:17:22.658052 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ecb19b-7f9c-48ea-a277-751158238b7f None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:17:22.659379 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 707/1410] 10.222.0.36 () {54 vars in 918 bytes} [Tue Aug 9 10:17:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:17:22.664902 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d931d4ac-7b5b-4e24-b557-19f8515ee6b8 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:17:22.665325 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d931d4ac-7b5b-4e24-b557-19f8515ee6b8 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:17:22.665437 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d931d4ac-7b5b-4e24-b557-19f8515ee6b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:17:22.741123 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-d931d4ac-7b5b-4e24-b557-19f8515ee6b8 None None] MFA Rules not processed for user `c4d3b6a332394adf9e1b81ee9c171c48`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:17:22.742377 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-d931d4ac-7b5b-4e24-b557-19f8515ee6b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:17:22.847544 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 704/1411] 10.222.0.36 () {58 vars in 1015 bytes} [Tue Aug 9 10:17:22 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:17:22.863748 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de22a8d-6084-46df-ab05-b7867a332901 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:17:22.864030 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de22a8d-6084-46df-ab05-b7867a332901 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:17:22.864301 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de22a8d-6084-46df-ab05-b7867a332901 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:17:22.865619 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 708/1412] 10.222.0.36 () {54 vars in 918 bytes} [Tue Aug 9 10:17:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:17:22.870112 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd13c3f2-428e-4069-a1fa-636e30fab7d1 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:17:22.870419 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd13c3f2-428e-4069-a1fa-636e30fab7d1 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:17:22.870693 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd13c3f2-428e-4069-a1fa-636e30fab7d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:17:22.944120 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:17:22.947331 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-fd13c3f2-428e-4069-a1fa-636e30fab7d1 None None] MFA Rules not processed for user `eb863beaaa9f495c8b64655996c061f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:17:22.949169 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-fd13c3f2-428e-4069-a1fa-636e30fab7d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:17:23.062676 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 705/1413] 10.222.0.36 () {58 vars in 1015 bytes} [Tue Aug 9 10:17:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:17:25.529563 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac85767-4a3a-4361-80fb-869130b2afa0 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:17:25.530135 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac85767-4a3a-4361-80fb-869130b2afa0 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:17:25.530135 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac85767-4a3a-4361-80fb-869130b2afa0 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:17:25.531406 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 709/1414] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 10:17:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:17:25.536774 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b2207-d0b9-48b5-9299-5ef1ac249f07 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:17:25.537163 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b2207-d0b9-48b5-9299-5ef1ac249f07 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:17:25.537314 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b2207-d0b9-48b5-9299-5ef1ac249f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:17:25.602368 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-628b2207-d0b9-48b5-9299-5ef1ac249f07 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:17:25.603562 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-628b2207-d0b9-48b5-9299-5ef1ac249f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:17:25.658677 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:17:25.700482 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 706/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 10:17:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:17:25.742715 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac85767-4a3a-4361-80fb-869130b2afa0 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:17:25.744231 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-3ac85767-4a3a-4361-80fb-869130b2afa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:17:25.887967 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac85767-4a3a-4361-80fb-869130b2afa0 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:17:25.959317 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:17:25.999540 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720746a4-579f-4571-a95d-affa7112aa5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb863beaaa9f495c8b64655996c061f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:17:26.000132 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720746a4-579f-4571-a95d-affa7112aa5f service nova] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:17:26.000405 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720746a4-579f-4571-a95d-affa7112aa5f service nova] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:17:26.000669 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720746a4-579f-4571-a95d-affa7112aa5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:17:26.002280 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-720746a4-579f-4571-a95d-affa7112aa5f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:17:26.088603 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720746a4-579f-4571-a95d-affa7112aa5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:17:26.090389 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720746a4-579f-4571-a95d-affa7112aa5f service nova] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:17:26.108103 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 710/1416] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:17:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:17:27.013808 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c714bc54-1566-4789-9efa-9065be817c2f None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:17:27.014360 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c714bc54-1566-4789-9efa-9065be817c2f None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:17:27.014360 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c714bc54-1566-4789-9efa-9065be817c2f None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:17:27.015770 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 707/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 10:17:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:17:27.020620 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a998b-fae9-47df-9668-36bd3926754c None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:17:27.021009 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a998b-fae9-47df-9668-36bd3926754c None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:17:27.021175 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a998b-fae9-47df-9668-36bd3926754c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:17:27.096789 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-608a998b-fae9-47df-9668-36bd3926754c None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:17:27.098017 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-608a998b-fae9-47df-9668-36bd3926754c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:17:27.125041 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:17:27.196372 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 711/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 10:17:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 10:17:27.351034 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c714bc54-1566-4789-9efa-9065be817c2f None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:17:27.352540 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-c714bc54-1566-4789-9efa-9065be817c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:17:27.496944 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c714bc54-1566-4789-9efa-9065be817c2f None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:17:27.535735 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:17:27.608466 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0537a9d9-5a19-4424-aa6e-7113fcb5d656 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb863beaaa9f495c8b64655996c061f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:17:27.609065 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537a9d9-5a19-4424-aa6e-7113fcb5d656 service nova] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:17:27.609344 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537a9d9-5a19-4424-aa6e-7113fcb5d656 service nova] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:17:27.609611 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537a9d9-5a19-4424-aa6e-7113fcb5d656 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:17:27.611242 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-0537a9d9-5a19-4424-aa6e-7113fcb5d656 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:17:27.701473 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0537a9d9-5a19-4424-aa6e-7113fcb5d656 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:17:27.703099 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0537a9d9-5a19-4424-aa6e-7113fcb5d656 service nova] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:17:27.721146 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 708/1419] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:17:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:17:28.603882 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b7281-ff55-4cd5-b932-49b5e09ec46b None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:17:28.604460 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b7281-ff55-4cd5-b932-49b5e09ec46b None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:17:28.604460 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b7281-ff55-4cd5-b932-49b5e09ec46b None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:17:28.605796 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 712/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 10:17:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:17:28.611131 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b481b7-5a8d-4ec7-bb66-94104c06f739 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:17:28.611516 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b481b7-5a8d-4ec7-bb66-94104c06f739 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:17:28.611682 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b481b7-5a8d-4ec7-bb66-94104c06f739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:17:28.664932 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:17:28.687197 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-f7b481b7-5a8d-4ec7-bb66-94104c06f739 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:17:28.688403 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-f7b481b7-5a8d-4ec7-bb66-94104c06f739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:17:28.782853 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 709/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 10:17:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:17:28.953437 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394b7281-ff55-4cd5-b932-49b5e09ec46b None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:17:28.958246 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-394b7281-ff55-4cd5-b932-49b5e09ec46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:17:29.104719 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394b7281-ff55-4cd5-b932-49b5e09ec46b None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:17:29.117477 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:17:29.230719 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b95f2d-daa8-4cfb-8c92-c0b86f75a4b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb863beaaa9f495c8b64655996c061f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:17:29.231322 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b95f2d-daa8-4cfb-8c92-c0b86f75a4b8 service nova] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:17:29.231597 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b95f2d-daa8-4cfb-8c92-c0b86f75a4b8 service nova] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:17:29.231866 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b95f2d-daa8-4cfb-8c92-c0b86f75a4b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:17:29.233484 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-f1b95f2d-daa8-4cfb-8c92-c0b86f75a4b8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:17:29.322778 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b95f2d-daa8-4cfb-8c92-c0b86f75a4b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:17:29.324452 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b95f2d-daa8-4cfb-8c92-c0b86f75a4b8 service nova] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:17:29.342856 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 713/1422] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:17:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:17:30.203264 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d68b42c-8023-4a1d-9be9-f25a751b57c2 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:17:30.203947 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d68b42c-8023-4a1d-9be9-f25a751b57c2 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:17:30.203947 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d68b42c-8023-4a1d-9be9-f25a751b57c2 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:17:30.205125 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 710/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 10:17:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:17:30.210055 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea086b-e956-4720-9614-1aa4f8c328c4 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:17:30.210474 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea086b-e956-4720-9614-1aa4f8c328c4 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:17:30.210595 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea086b-e956-4720-9614-1aa4f8c328c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:17:30.231727 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:17:30.288216 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-8dea086b-e956-4720-9614-1aa4f8c328c4 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:17:30.289403 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-8dea086b-e956-4720-9614-1aa4f8c328c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:17:30.383834 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 714/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 10:17:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:17:30.537245 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d68b42c-8023-4a1d-9be9-f25a751b57c2 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:17:30.538722 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-7d68b42c-8023-4a1d-9be9-f25a751b57c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:17:30.647901 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:17:30.683864 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d68b42c-8023-4a1d-9be9-f25a751b57c2 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:17:30.794513 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97eb99d-9333-4c1d-97e7-652f8a050086 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb863beaaa9f495c8b64655996c061f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:17:30.795037 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97eb99d-9333-4c1d-97e7-652f8a050086 service nova] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:17:30.795312 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97eb99d-9333-4c1d-97e7-652f8a050086 service nova] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:17:30.795583 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97eb99d-9333-4c1d-97e7-652f8a050086 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:17:30.797179 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-d97eb99d-9333-4c1d-97e7-652f8a050086 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:17:30.874068 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:17:30.887936 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97eb99d-9333-4c1d-97e7-652f8a050086 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:17:30.889503 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97eb99d-9333-4c1d-97e7-652f8a050086 service nova] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:17:30.907252 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 711/1425] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:17:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:17:31.774104 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410bd30d-fbcd-49ee-99f2-aed8eb66bf5a None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:17:31.774580 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410bd30d-fbcd-49ee-99f2-aed8eb66bf5a None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:17:31.774688 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410bd30d-fbcd-49ee-99f2-aed8eb66bf5a None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:17:31.776039 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 715/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 10:17:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:17:31.781040 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f860a6e9-5fce-47d7-ab18-9f9645e7ef20 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:17:31.781462 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f860a6e9-5fce-47d7-ab18-9f9645e7ef20 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:17:31.781593 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f860a6e9-5fce-47d7-ab18-9f9645e7ef20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:17:31.857441 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-f860a6e9-5fce-47d7-ab18-9f9645e7ef20 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:17:31.858657 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-f860a6e9-5fce-47d7-ab18-9f9645e7ef20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:17:31.953716 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 712/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 10:17:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:17:32.105564 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410bd30d-fbcd-49ee-99f2-aed8eb66bf5a None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:17:32.107145 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-410bd30d-fbcd-49ee-99f2-aed8eb66bf5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:17:32.189302 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:17:32.251100 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410bd30d-fbcd-49ee-99f2-aed8eb66bf5a None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:17:32.360736 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06cb6c0-97d1-41f0-bc30-3eb034b5124d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb863beaaa9f495c8b64655996c061f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:17:32.361247 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06cb6c0-97d1-41f0-bc30-3eb034b5124d service nova] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:17:32.361525 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06cb6c0-97d1-41f0-bc30-3eb034b5124d service nova] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:17:32.361787 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06cb6c0-97d1-41f0-bc30-3eb034b5124d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:17:32.363411 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-c06cb6c0-97d1-41f0-bc30-3eb034b5124d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:17:32.409803 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:17:32.450526 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06cb6c0-97d1-41f0-bc30-3eb034b5124d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:17:32.452113 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06cb6c0-97d1-41f0-bc30-3eb034b5124d service nova] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:17:32.469445 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 716/1428] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:17:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:17:33.271119 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f14068-ed48-446a-8c5d-958c8cef8836 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:17:33.271651 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f14068-ed48-446a-8c5d-958c8cef8836 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:17:33.271651 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f14068-ed48-446a-8c5d-958c8cef8836 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:17:33.272923 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 713/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 10:17:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:17:33.278449 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaebcb5-184e-4a34-bfa3-36e322f71ba2 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:17:33.278897 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaebcb5-184e-4a34-bfa3-36e322f71ba2 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:17:33.278995 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaebcb5-184e-4a34-bfa3-36e322f71ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:17:33.353795 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-adaebcb5-184e-4a34-bfa3-36e322f71ba2 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:17:33.355189 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-adaebcb5-184e-4a34-bfa3-36e322f71ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:17:33.451803 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 717/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 10:17:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:17:33.602947 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f14068-ed48-446a-8c5d-958c8cef8836 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:17:33.604377 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-e4f14068-ed48-446a-8c5d-958c8cef8836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:17:33.654499 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:17:33.751448 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f14068-ed48-446a-8c5d-958c8cef8836 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:17:33.861243 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b933ca-9aa4-4c00-a77f-c5e1a9c7374f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb863beaaa9f495c8b64655996c061f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:17:33.861762 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b933ca-9aa4-4c00-a77f-c5e1a9c7374f service nova] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:17:33.862061 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b933ca-9aa4-4c00-a77f-c5e1a9c7374f service nova] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:17:33.862324 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b933ca-9aa4-4c00-a77f-c5e1a9c7374f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:17:33.863909 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-d7b933ca-9aa4-4c00-a77f-c5e1a9c7374f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:17:33.871153 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:17:33.961583 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b933ca-9aa4-4c00-a77f-c5e1a9c7374f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:17:33.963198 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b933ca-9aa4-4c00-a77f-c5e1a9c7374f service nova] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:17:33.982504 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 714/1431] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:17:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:17:34.786655 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d6265-9f4a-4cea-8511-b767e0c553d6 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:17:34.787192 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d6265-9f4a-4cea-8511-b767e0c553d6 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:17:34.787192 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d6265-9f4a-4cea-8511-b767e0c553d6 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:17:34.788549 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 718/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 10:17:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:17:34.794084 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c09e211-3950-41ab-8644-27511d5c1096 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:17:34.794508 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c09e211-3950-41ab-8644-27511d5c1096 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:17:34.794629 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c09e211-3950-41ab-8644-27511d5c1096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:17:34.869299 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-7c09e211-3950-41ab-8644-27511d5c1096 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:17:34.870653 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-7c09e211-3950-41ab-8644-27511d5c1096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:17:34.937975 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:17:34.968478 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 715/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 10:17:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 10:17:35.119733 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42d6265-9f4a-4cea-8511-b767e0c553d6 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:17:35.121462 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-c42d6265-9f4a-4cea-8511-b767e0c553d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:17:35.139274 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:17:35.282316 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42d6265-9f4a-4cea-8511-b767e0c553d6 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:17:35.368557 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:17:35.396889 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc61105-494c-44ff-a1a4-c854ee7d1768 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb863beaaa9f495c8b64655996c061f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:17:35.397484 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc61105-494c-44ff-a1a4-c854ee7d1768 service nova] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:17:35.397754 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc61105-494c-44ff-a1a4-c854ee7d1768 service nova] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:17:35.398044 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc61105-494c-44ff-a1a4-c854ee7d1768 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:17:35.399631 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-4cc61105-494c-44ff-a1a4-c854ee7d1768 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:17:35.487404 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc61105-494c-44ff-a1a4-c854ee7d1768 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:17:35.488998 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc61105-494c-44ff-a1a4-c854ee7d1768 service nova] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:17:35.506471 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 719/1434] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:17:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:17:36.320118 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e445be6-9c46-44da-ab90-014567a84c9b None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:17:36.320649 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e445be6-9c46-44da-ab90-014567a84c9b None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:17:36.320649 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e445be6-9c46-44da-ab90-014567a84c9b None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:17:36.321949 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 716/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 10:17:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:17:36.327622 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f917ae8-ac82-4d5a-ac78-fd40ea803740 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:17:36.328081 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f917ae8-ac82-4d5a-ac78-fd40ea803740 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:17:36.328185 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f917ae8-ac82-4d5a-ac78-fd40ea803740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:17:36.402663 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-0f917ae8-ac82-4d5a-ac78-fd40ea803740 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:17:36.403866 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-0f917ae8-ac82-4d5a-ac78-fd40ea803740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:17:36.444102 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:17:36.500967 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 720/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 10:17:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:17:36.653503 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e445be6-9c46-44da-ab90-014567a84c9b None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:17:36.655144 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-5e445be6-9c46-44da-ab90-014567a84c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:17:36.801192 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e445be6-9c46-44da-ab90-014567a84c9b None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:17:36.854218 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:17:36.914745 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc60656-d629-4cd1-8ba4-d981115b5b1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb863beaaa9f495c8b64655996c061f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:17:36.915264 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc60656-d629-4cd1-8ba4-d981115b5b1b service nova] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:17:36.915537 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc60656-d629-4cd1-8ba4-d981115b5b1b service nova] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:17:36.915806 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc60656-d629-4cd1-8ba4-d981115b5b1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:17:36.917978 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-edc60656-d629-4cd1-8ba4-d981115b5b1b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:17:37.006855 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc60656-d629-4cd1-8ba4-d981115b5b1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:17:37.008438 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc60656-d629-4cd1-8ba4-d981115b5b1b service nova] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:17:37.026827 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 717/1437] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:17:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:17:37.826033 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c436e74-a879-46b6-90e2-931555c82d4b None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:17:37.826619 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c436e74-a879-46b6-90e2-931555c82d4b None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:17:37.826619 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c436e74-a879-46b6-90e2-931555c82d4b None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:17:37.827927 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 721/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 10:17:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:17:37.832944 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71310994-9875-4c68-8e83-6799b5380fc7 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:17:37.833325 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71310994-9875-4c68-8e83-6799b5380fc7 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:17:37.833492 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71310994-9875-4c68-8e83-6799b5380fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:17:37.908050 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-71310994-9875-4c68-8e83-6799b5380fc7 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:17:37.909233 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-71310994-9875-4c68-8e83-6799b5380fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:17:37.911519 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:17:38.005333 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 718/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 10:17:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:17:38.155992 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c436e74-a879-46b6-90e2-931555c82d4b None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:17:38.157550 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-5c436e74-a879-46b6-90e2-931555c82d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:17:38.304021 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c436e74-a879-46b6-90e2-931555c82d4b None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:17:38.329397 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:17:38.414675 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948148e4-0906-43a0-af73-d209d1c1de88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb863beaaa9f495c8b64655996c061f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:17:38.415193 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948148e4-0906-43a0-af73-d209d1c1de88 service nova] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:17:38.415471 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948148e4-0906-43a0-af73-d209d1c1de88 service nova] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:17:38.415739 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948148e4-0906-43a0-af73-d209d1c1de88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:17:38.417910 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-948148e4-0906-43a0-af73-d209d1c1de88 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:17:38.510707 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948148e4-0906-43a0-af73-d209d1c1de88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:17:38.512361 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948148e4-0906-43a0-af73-d209d1c1de88 service nova] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:17:38.530956 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 722/1440] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:17:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:17:40.419565 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b7b9c-df71-4937-84dd-6017f5550eaa None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:17:40.420134 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b7b9c-df71-4937-84dd-6017f5550eaa None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:17:40.420134 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b7b9c-df71-4937-84dd-6017f5550eaa None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:17:40.421482 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 719/1441] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 10:17:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:17:40.426675 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9243022-67a5-42ba-b83e-813efac0ce92 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:17:40.427114 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9243022-67a5-42ba-b83e-813efac0ce92 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:17:40.427228 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9243022-67a5-42ba-b83e-813efac0ce92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:17:40.468224 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:17:40.493272 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-a9243022-67a5-42ba-b83e-813efac0ce92 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:17:40.494484 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-a9243022-67a5-42ba-b83e-813efac0ce92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:17:40.590734 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 723/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 10:17:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:17:40.629945 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8b7b9c-df71-4937-84dd-6017f5550eaa None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:17:40.631477 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-6a8b7b9c-df71-4937-84dd-6017f5550eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:17:40.734700 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8b7b9c-df71-4937-84dd-6017f5550eaa None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:17:40.767288 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:17:40.807970 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d775623-3155-42e8-b276-4765f95cd3d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:17:40.808563 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d775623-3155-42e8-b276-4765f95cd3d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:17:40.808835 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d775623-3155-42e8-b276-4765f95cd3d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:17:40.809099 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d775623-3155-42e8-b276-4765f95cd3d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:17:40.810709 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-1d775623-3155-42e8-b276-4765f95cd3d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:17:40.919158 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d775623-3155-42e8-b276-4765f95cd3d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:17:40.920565 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d775623-3155-42e8-b276-4765f95cd3d0 service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:17:40.939763 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 720/1443] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:17:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:17:43.154381 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a978fc-2f5e-412e-aa8a-badb4c0f9b63 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:17:43.154934 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a978fc-2f5e-412e-aa8a-badb4c0f9b63 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:17:43.154934 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a978fc-2f5e-412e-aa8a-badb4c0f9b63 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:17:43.156261 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 724/1444] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 10:17:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:17:43.161788 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4414b1af-8839-47ed-a0f4-aa520d2c818b None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:17:43.162245 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4414b1af-8839-47ed-a0f4-aa520d2c818b None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:17:43.162351 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4414b1af-8839-47ed-a0f4-aa520d2c818b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:17:43.227478 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-4414b1af-8839-47ed-a0f4-aa520d2c818b None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:17:43.228594 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-4414b1af-8839-47ed-a0f4-aa520d2c818b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:17:43.241681 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:17:43.328876 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 721/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 10:17:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:17:43.367184 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a978fc-2f5e-412e-aa8a-badb4c0f9b63 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:17:43.368703 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-13a978fc-2f5e-412e-aa8a-badb4c0f9b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:17:43.470121 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a978fc-2f5e-412e-aa8a-badb4c0f9b63 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:17:43.482571 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:17:43.541528 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c22c5bd-974b-4335-acaa-59385926905f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:17:43.542852 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c22c5bd-974b-4335-acaa-59385926905f service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:17:43.543126 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c22c5bd-974b-4335-acaa-59385926905f service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:17:43.543391 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c22c5bd-974b-4335-acaa-59385926905f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:17:43.544981 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-5c22c5bd-974b-4335-acaa-59385926905f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:17:43.652754 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c22c5bd-974b-4335-acaa-59385926905f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:17:43.654264 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c22c5bd-974b-4335-acaa-59385926905f service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:17:43.672724 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 725/1446] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:17:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:17:45.995849 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f0dea6-107f-4ebf-816c-6318e505766d None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:17:45.996377 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f0dea6-107f-4ebf-816c-6318e505766d None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:17:45.996377 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f0dea6-107f-4ebf-816c-6318e505766d None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:17:45.997768 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 722/1447] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 10:17:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:17:46.002885 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1564e1-0d41-4189-a44f-9a744688c321 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:17:46.003331 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1564e1-0d41-4189-a44f-9a744688c321 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:17:46.003434 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1564e1-0d41-4189-a44f-9a744688c321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:17:46.051373 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:17:46.069143 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-4a1564e1-0d41-4189-a44f-9a744688c321 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:17:46.070378 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-4a1564e1-0d41-4189-a44f-9a744688c321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:17:46.164680 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 726/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 10:17:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:17:46.204507 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f0dea6-107f-4ebf-816c-6318e505766d None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:17:46.206111 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-69f0dea6-107f-4ebf-816c-6318e505766d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:17:46.309753 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f0dea6-107f-4ebf-816c-6318e505766d None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:17:46.348836 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:17:46.383444 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f30494-ae49-4412-869d-0f5538aaa2aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:17:46.384044 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f30494-ae49-4412-869d-0f5538aaa2aa service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:17:46.384324 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f30494-ae49-4412-869d-0f5538aaa2aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:17:46.384594 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f30494-ae49-4412-869d-0f5538aaa2aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:17:46.386387 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-45f30494-ae49-4412-869d-0f5538aaa2aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:17:46.493718 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f30494-ae49-4412-869d-0f5538aaa2aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:17:46.495096 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f30494-ae49-4412-869d-0f5538aaa2aa service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:17:46.514487 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 723/1449] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:17:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:17:48.700093 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e2cb3-af76-472e-813b-27a556069eaf None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:17:48.700670 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e2cb3-af76-472e-813b-27a556069eaf None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:17:48.700670 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e2cb3-af76-472e-813b-27a556069eaf None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:17:48.702056 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 727/1450] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 10:17:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:17:48.707410 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8d9e61-4aa4-4426-a31e-ed0fd7c2b902 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:17:48.707844 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8d9e61-4aa4-4426-a31e-ed0fd7c2b902 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:17:48.707951 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8d9e61-4aa4-4426-a31e-ed0fd7c2b902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:17:48.772908 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-ca8d9e61-4aa4-4426-a31e-ed0fd7c2b902 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:17:48.774139 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-ca8d9e61-4aa4-4426-a31e-ed0fd7c2b902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:17:48.796126 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:17:48.871616 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 724/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 10:17:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 10:17:48.910552 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4e2cb3-af76-472e-813b-27a556069eaf None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:17:48.912331 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-9a4e2cb3-af76-472e-813b-27a556069eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:17:49.015695 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4e2cb3-af76-472e-813b-27a556069eaf None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:17:49.035576 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:17:49.090029 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52709888-15db-4e87-82c3-61126ec893d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:17:49.090620 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52709888-15db-4e87-82c3-61126ec893d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:17:49.090893 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52709888-15db-4e87-82c3-61126ec893d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:17:49.091158 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52709888-15db-4e87-82c3-61126ec893d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:17:49.092773 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-52709888-15db-4e87-82c3-61126ec893d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:17:49.201139 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52709888-15db-4e87-82c3-61126ec893d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:17:49.202608 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52709888-15db-4e87-82c3-61126ec893d1 service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:17:49.221111 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 728/1452] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:17:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:17:51.255703 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a331309a-ce94-4686-aa5b-869df4880374 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:17:51.256222 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a331309a-ce94-4686-aa5b-869df4880374 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:17:51.256222 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a331309a-ce94-4686-aa5b-869df4880374 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:17:51.257482 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 725/1453] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 10:17:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:17:51.263794 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10536c0d-973b-43b2-85c9-5a5e5469d8be None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:17:51.264195 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10536c0d-973b-43b2-85c9-5a5e5469d8be None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:17:51.264346 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10536c0d-973b-43b2-85c9-5a5e5469d8be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:17:51.327776 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:17:51.331334 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-10536c0d-973b-43b2-85c9-5a5e5469d8be None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:17:51.333075 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-10536c0d-973b-43b2-85c9-5a5e5469d8be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:17:51.428015 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 729/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 10:17:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:17:51.466609 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a331309a-ce94-4686-aa5b-869df4880374 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:17:51.468159 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-a331309a-ce94-4686-aa5b-869df4880374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:17:51.573320 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a331309a-ce94-4686-aa5b-869df4880374 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:17:51.622110 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:17:51.647384 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a912c6-013e-43f7-986a-ab62a29f127e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:17:51.647986 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a912c6-013e-43f7-986a-ab62a29f127e service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:17:51.648262 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a912c6-013e-43f7-986a-ab62a29f127e service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:17:51.648534 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a912c6-013e-43f7-986a-ab62a29f127e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:17:51.650161 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-56a912c6-013e-43f7-986a-ab62a29f127e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:17:51.758410 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a912c6-013e-43f7-986a-ab62a29f127e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:17:51.759826 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a912c6-013e-43f7-986a-ab62a29f127e service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:17:51.778969 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 726/1455] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:17:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 10:17:53.851794 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9342ba7-cec7-4022-9391-5a463ac0eb48 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:17:53.852384 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9342ba7-cec7-4022-9391-5a463ac0eb48 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:17:53.852384 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9342ba7-cec7-4022-9391-5a463ac0eb48 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:17:53.853756 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 730/1456] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 10:17:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:17:53.859113 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e9f0d8-d110-43a5-902f-958b5b3f6bff None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:17:53.859549 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e9f0d8-d110-43a5-902f-958b5b3f6bff None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:17:53.859647 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e9f0d8-d110-43a5-902f-958b5b3f6bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:17:53.925595 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-b8e9f0d8-d110-43a5-902f-958b5b3f6bff None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:17:53.926832 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-b8e9f0d8-d110-43a5-902f-958b5b3f6bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:17:53.956938 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:17:54.024160 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 727/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 10:17:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:17:54.062950 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9342ba7-cec7-4022-9391-5a463ac0eb48 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:17:54.064489 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-c9342ba7-cec7-4022-9391-5a463ac0eb48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:17:54.167307 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9342ba7-cec7-4022-9391-5a463ac0eb48 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:17:54.194343 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:17:54.239217 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51d7201-3c7e-44fb-929c-078a86043263 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:17:54.239809 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d7201-3c7e-44fb-929c-078a86043263 service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:17:54.240084 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d7201-3c7e-44fb-929c-078a86043263 service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:17:54.240351 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d7201-3c7e-44fb-929c-078a86043263 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:17:54.241965 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-f51d7201-3c7e-44fb-929c-078a86043263 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:17:54.352399 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51d7201-3c7e-44fb-929c-078a86043263 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:17:54.354192 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51d7201-3c7e-44fb-929c-078a86043263 service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:17:54.371758 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 731/1458] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:17:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:17:56.423665 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3fae98-7519-40f0-9c94-67d09827e32e None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:17:56.424203 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3fae98-7519-40f0-9c94-67d09827e32e None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:17:56.424203 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3fae98-7519-40f0-9c94-67d09827e32e None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:17:56.425531 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 728/1459] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 10:17:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:17:56.430646 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ded4d4-d8ce-4033-a9b1-7efd2ed253c0 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:17:56.431052 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ded4d4-d8ce-4033-a9b1-7efd2ed253c0 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:17:56.431199 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ded4d4-d8ce-4033-a9b1-7efd2ed253c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:17:56.498819 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-43ded4d4-d8ce-4033-a9b1-7efd2ed253c0 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:17:56.500006 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-43ded4d4-d8ce-4033-a9b1-7efd2ed253c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:17:56.508000 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:17:56.594362 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 732/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 10:17:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:17:56.632736 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3fae98-7519-40f0-9c94-67d09827e32e None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:17:56.634344 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-fa3fae98-7519-40f0-9c94-67d09827e32e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:17:56.737149 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3fae98-7519-40f0-9c94-67d09827e32e None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:17:56.792377 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:17:56.810508 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38ddc34-43e7-4c85-a29d-ec7186751853 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:17:56.811104 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ddc34-43e7-4c85-a29d-ec7186751853 service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:17:56.811381 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ddc34-43e7-4c85-a29d-ec7186751853 service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:17:56.811654 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ddc34-43e7-4c85-a29d-ec7186751853 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:17:56.813242 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-c38ddc34-43e7-4c85-a29d-ec7186751853 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:17:56.920188 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38ddc34-43e7-4c85-a29d-ec7186751853 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:17:56.921615 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38ddc34-43e7-4c85-a29d-ec7186751853 service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:17:56.940311 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 729/1461] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:17:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:17:58.989572 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c73b48-1f97-4563-8980-d1e99c544f07 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:17:58.990111 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c73b48-1f97-4563-8980-d1e99c544f07 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:17:58.990111 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c73b48-1f97-4563-8980-d1e99c544f07 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:17:58.991519 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 733/1462] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 10:17:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:17:58.997540 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9566f109-5494-4827-8994-672cbc4cb019 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:17:58.997990 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9566f109-5494-4827-8994-672cbc4cb019 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:17:58.998109 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9566f109-5494-4827-8994-672cbc4cb019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:17:59.064699 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-9566f109-5494-4827-8994-672cbc4cb019 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:17:59.065924 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-9566f109-5494-4827-8994-672cbc4cb019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:17:59.103212 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:17:59.162419 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 730/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 10:17:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:17:59.200802 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c73b48-1f97-4563-8980-d1e99c544f07 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:17:59.202377 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-23c73b48-1f97-4563-8980-d1e99c544f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:17:59.310629 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c73b48-1f97-4563-8980-d1e99c544f07 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:17:59.349286 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:17:59.386002 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70d1131-d76d-4ce7-86d9-77f41f5d519d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:17:59.386603 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70d1131-d76d-4ce7-86d9-77f41f5d519d service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:17:59.386882 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70d1131-d76d-4ce7-86d9-77f41f5d519d service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:17:59.387152 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70d1131-d76d-4ce7-86d9-77f41f5d519d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:17:59.388781 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-d70d1131-d76d-4ce7-86d9-77f41f5d519d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:17:59.495330 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70d1131-d76d-4ce7-86d9-77f41f5d519d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:17:59.496680 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70d1131-d76d-4ce7-86d9-77f41f5d519d service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:17:59.514762 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 734/1464] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:17:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:18:01.559174 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbebfa4a-e168-401d-b561-535b808472e1 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:18:01.559783 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbebfa4a-e168-401d-b561-535b808472e1 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:18:01.559783 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbebfa4a-e168-401d-b561-535b808472e1 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:18:01.561077 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 731/1465] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 10:18:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:18:01.566540 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcfb9b0-0d21-423d-9842-3a7405e41ea8 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:18:01.566944 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcfb9b0-0d21-423d-9842-3a7405e41ea8 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:18:01.567098 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcfb9b0-0d21-423d-9842-3a7405e41ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:18:01.632147 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-0bcfb9b0-0d21-423d-9842-3a7405e41ea8 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:18:01.633347 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-0bcfb9b0-0d21-423d-9842-3a7405e41ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:18:01.652109 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:18:01.730921 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 735/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 10:18:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:18:01.768249 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbebfa4a-e168-401d-b561-535b808472e1 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:18:01.769803 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-cbebfa4a-e168-401d-b561-535b808472e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:18:01.873526 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbebfa4a-e168-401d-b561-535b808472e1 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:18:01.939555 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:18:01.946831 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5934e950-1500-4cd9-b340-a08ac6029d6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:18:01.947439 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5934e950-1500-4cd9-b340-a08ac6029d6e service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:18:01.947800 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5934e950-1500-4cd9-b340-a08ac6029d6e service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:18:01.948081 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5934e950-1500-4cd9-b340-a08ac6029d6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:18:01.949685 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-5934e950-1500-4cd9-b340-a08ac6029d6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:18:02.057745 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5934e950-1500-4cd9-b340-a08ac6029d6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:18:02.059216 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5934e950-1500-4cd9-b340-a08ac6029d6e service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:18:02.077474 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 732/1467] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:18:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:18:04.136541 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be3b104-bf76-4856-963b-cc07a3b6d6a6 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:18:04.137111 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be3b104-bf76-4856-963b-cc07a3b6d6a6 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:18:04.137111 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be3b104-bf76-4856-963b-cc07a3b6d6a6 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:18:04.138427 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 736/1468] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 10:18:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:18:04.143522 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a837ece-6590-4010-97f2-e68f0c1a8c93 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:18:04.143972 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a837ece-6590-4010-97f2-e68f0c1a8c93 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:18:04.144067 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a837ece-6590-4010-97f2-e68f0c1a8c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:18:04.209416 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-6a837ece-6590-4010-97f2-e68f0c1a8c93 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:18:04.210557 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-6a837ece-6590-4010-97f2-e68f0c1a8c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:18:04.262510 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:18:04.310907 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 733/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 10:18:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:18:04.347518 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be3b104-bf76-4856-963b-cc07a3b6d6a6 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:18:04.349081 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-0be3b104-bf76-4856-963b-cc07a3b6d6a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:18:04.450529 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be3b104-bf76-4856-963b-cc07a3b6d6a6 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:18:04.497324 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:18:04.523388 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e81303-d78f-43d8-aae4-28889d65cdd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:18:04.523976 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e81303-d78f-43d8-aae4-28889d65cdd2 service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:18:04.524247 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e81303-d78f-43d8-aae4-28889d65cdd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:18:04.524512 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e81303-d78f-43d8-aae4-28889d65cdd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:18:04.526295 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-e3e81303-d78f-43d8-aae4-28889d65cdd2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:18:04.634142 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e81303-d78f-43d8-aae4-28889d65cdd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:18:04.636521 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e81303-d78f-43d8-aae4-28889d65cdd2 service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:18:04.654387 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 737/1470] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:18:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:18:14.309058 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=22 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:18:14.652067 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=66 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:18:24.390799 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfadbd68-2b81-4250-abbe-141704969ad0 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:18:24.391372 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfadbd68-2b81-4250-abbe-141704969ad0 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:18:24.391372 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfadbd68-2b81-4250-abbe-141704969ad0 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:18:24.392737 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 734/1471] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:18:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:18:24.397922 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c68f05-20b6-4243-8f47-ff8912a138cc None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:18:24.398347 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c68f05-20b6-4243-8f47-ff8912a138cc None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:18:24.398473 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c68f05-20b6-4243-8f47-ff8912a138cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:18:24.463773 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-61c68f05-20b6-4243-8f47-ff8912a138cc None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:18:24.464966 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-61c68f05-20b6-4243-8f47-ff8912a138cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:18:24.558967 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 738/1472] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:18:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:18:24.643024 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bca34f-4af6-4af4-a04e-e61d770f615e None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:18:24.643250 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bca34f-4af6-4af4-a04e-e61d770f615e None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:18:24.643521 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bca34f-4af6-4af4-a04e-e61d770f615e None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:18:24.644846 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 735/1473] 10.222.0.36 () {54 vars in 967 bytes} [Tue Aug 9 10:18:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:18:24.650224 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd4ca9-144d-4881-b2a4-fe0a93451ffb None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:18:24.650507 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd4ca9-144d-4881-b2a4-fe0a93451ffb None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:18:24.650776 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd4ca9-144d-4881-b2a4-fe0a93451ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:18:24.727416 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-d9fd4ca9-144d-4881-b2a4-fe0a93451ffb None None] MFA Rules not processed for user `07540b72afd34927855c41db09a7b030`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:18:24.728607 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-d9fd4ca9-144d-4881-b2a4-fe0a93451ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:18:24.749965 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:18:24.805066 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 739/1474] 10.222.0.36 () {58 vars in 1064 bytes} [Tue Aug 9 10:18:24 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:18:24.813083 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bca34f-4af6-4af4-a04e-e61d770f615e None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:18:24.814683 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-31bca34f-4af6-4af4-a04e-e61d770f615e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:18:24.919084 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bca34f-4af6-4af4-a04e-e61d770f615e None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:18:24.991394 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b909907d-efd9-4312-bb99-601c0191e63b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07540b72afd34927855c41db09a7b030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:18:24.991995 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b909907d-efd9-4312-bb99-601c0191e63b service glance] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:18:24.992270 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b909907d-efd9-4312-bb99-601c0191e63b service glance] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:18:24.992543 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b909907d-efd9-4312-bb99-601c0191e63b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:18:24.994750 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-b909907d-efd9-4312-bb99-601c0191e63b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:18:25.048372 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:18:25.103103 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b909907d-efd9-4312-bb99-601c0191e63b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:18:25.104538 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b909907d-efd9-4312-bb99-601c0191e63b service glance] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:18:25.123288 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 736/1475] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:18:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:18:27.215742 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b0c5e2-ae52-4809-990a-230f3e97cd6f None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:18:27.216258 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b0c5e2-ae52-4809-990a-230f3e97cd6f None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:18:27.216258 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b0c5e2-ae52-4809-990a-230f3e97cd6f None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:18:27.217574 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 740/1476] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:18:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:18:27.222680 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f5e5d-1692-4b9d-879e-9533d0256bc6 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:18:27.223084 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f5e5d-1692-4b9d-879e-9533d0256bc6 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:18:27.223228 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f5e5d-1692-4b9d-879e-9533d0256bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:18:27.288832 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-997f5e5d-1692-4b9d-879e-9533d0256bc6 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:18:27.290728 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-997f5e5d-1692-4b9d-879e-9533d0256bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:18:27.386853 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 737/1477] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:18:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:18:27.410465 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b0c5e2-ae52-4809-990a-230f3e97cd6f None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:18:27.411995 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-d2b0c5e2-ae52-4809-990a-230f3e97cd6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:18:27.536427 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b0c5e2-ae52-4809-990a-230f3e97cd6f None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:18:27.583767 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:18:27.627864 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6593df34-1eba-4b75-9483-2fefb50abd59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:18:27.628455 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6593df34-1eba-4b75-9483-2fefb50abd59 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:18:27.628728 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6593df34-1eba-4b75-9483-2fefb50abd59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:18:27.628991 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6593df34-1eba-4b75-9483-2fefb50abd59 admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:18:27.629622 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6593df34-1eba-4b75-9483-2fefb50abd59 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:18:27.631450 dv-cinder-852364-2-smb devstack@keystone.service[80106]: WARNING py.warnings [None req-6593df34-1eba-4b75-9483-2fefb50abd59 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 09 10:18:27.631450 dv-cinder-852364-2-smb devstack@keystone.service[80106]: warnings.warn(msg) Aug 09 10:18:27.631450 dv-cinder-852364-2-smb devstack@keystone.service[80106]: Aug 09 10:18:27.632583 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6593df34-1eba-4b75-9483-2fefb50abd59 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:18:27.651787 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 741/1478] 10.222.0.36 () {56 vars in 1108 bytes} [Tue Aug 9 10:18:27 2022] GET /identity/v3/projects => generated 2553 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:18:29.705652 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd83e5-e760-4a00-b033-082bfa170fd3 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:18:29.706285 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd83e5-e760-4a00-b033-082bfa170fd3 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:18:29.706285 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd83e5-e760-4a00-b033-082bfa170fd3 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:18:29.707599 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 738/1479] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:18:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:18:29.713070 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e507dc-8c63-40a3-8191-eb1fe3d7810f None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:18:29.713495 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e507dc-8c63-40a3-8191-eb1fe3d7810f None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:18:29.713626 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e507dc-8c63-40a3-8191-eb1fe3d7810f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:18:29.779327 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-c9e507dc-8c63-40a3-8191-eb1fe3d7810f None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:18:29.780542 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-c9e507dc-8c63-40a3-8191-eb1fe3d7810f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:18:29.878004 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 742/1480] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:18:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:18:29.922133 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babd83e5-e760-4a00-b033-082bfa170fd3 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:18:29.923687 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-babd83e5-e760-4a00-b033-082bfa170fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:18:29.933555 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:18:30.068448 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babd83e5-e760-4a00-b033-082bfa170fd3 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:18:30.147147 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:18:30.180753 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ee6c45-d6a7-4ad9-8dea-affce33e00c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb863beaaa9f495c8b64655996c061f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:18:30.181348 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ee6c45-d6a7-4ad9-8dea-affce33e00c7 service nova] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:18:30.181622 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ee6c45-d6a7-4ad9-8dea-affce33e00c7 service nova] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:18:30.181913 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ee6c45-d6a7-4ad9-8dea-affce33e00c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:18:30.183492 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-74ee6c45-d6a7-4ad9-8dea-affce33e00c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:18:30.271381 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ee6c45-d6a7-4ad9-8dea-affce33e00c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:18:30.272983 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ee6c45-d6a7-4ad9-8dea-affce33e00c7 service nova] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:18:30.292161 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 739/1481] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:18:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:18:32.498468 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b6eb53-6e08-45be-91e5-cba98f0d7a3f None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:18:32.499072 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b6eb53-6e08-45be-91e5-cba98f0d7a3f None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:18:32.499072 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b6eb53-6e08-45be-91e5-cba98f0d7a3f None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:18:32.500382 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 743/1482] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:18:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:18:32.505486 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1e508-c31c-4133-9335-bc6fc853c4d5 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:18:32.505953 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1e508-c31c-4133-9335-bc6fc853c4d5 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:18:32.506063 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1e508-c31c-4133-9335-bc6fc853c4d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:18:32.571545 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-cda1e508-c31c-4133-9335-bc6fc853c4d5 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:18:32.572835 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-cda1e508-c31c-4133-9335-bc6fc853c4d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:18:32.619528 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:18:32.669839 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 740/1483] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:18:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 10:18:32.705936 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b6eb53-6e08-45be-91e5-cba98f0d7a3f None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:18:32.707499 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-01b6eb53-6e08-45be-91e5-cba98f0d7a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:18:32.731337 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:18:32.810025 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b6eb53-6e08-45be-91e5-cba98f0d7a3f None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:18:32.881051 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc12ef1-ac2d-4854-8461-51bb5dc74976 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:18:32.881639 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc12ef1-ac2d-4854-8461-51bb5dc74976 service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:18:32.881941 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc12ef1-ac2d-4854-8461-51bb5dc74976 service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:18:32.882210 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc12ef1-ac2d-4854-8461-51bb5dc74976 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:18:32.883815 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-ccc12ef1-ac2d-4854-8461-51bb5dc74976 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:18:32.958864 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:18:32.994256 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc12ef1-ac2d-4854-8461-51bb5dc74976 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:18:32.995721 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc12ef1-ac2d-4854-8461-51bb5dc74976 service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:18:33.013165 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 744/1484] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:18:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:18:35.038889 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c33d59-5361-405d-8981-a3d8c0085cd9 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:18:35.039947 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c33d59-5361-405d-8981-a3d8c0085cd9 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:18:35.040154 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c33d59-5361-405d-8981-a3d8c0085cd9 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:18:35.041505 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 741/1485] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:18:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:18:35.046753 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18dad3c-e26f-454e-9bae-110cb0cac501 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:18:35.047140 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18dad3c-e26f-454e-9bae-110cb0cac501 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:18:35.047301 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18dad3c-e26f-454e-9bae-110cb0cac501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:18:35.111380 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-c18dad3c-e26f-454e-9bae-110cb0cac501 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:18:35.112561 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-c18dad3c-e26f-454e-9bae-110cb0cac501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:18:35.206626 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 745/1486] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:18:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:18:35.245549 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c33d59-5361-405d-8981-a3d8c0085cd9 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:18:35.247177 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-33c33d59-5361-405d-8981-a3d8c0085cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:18:35.353075 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c33d59-5361-405d-8981-a3d8c0085cd9 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:18:35.425291 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:18:35.427171 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94001c2e-d22e-455d-9501-08395f6c279a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:18:35.427982 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94001c2e-d22e-455d-9501-08395f6c279a service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:18:35.428399 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94001c2e-d22e-455d-9501-08395f6c279a service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:18:35.428877 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94001c2e-d22e-455d-9501-08395f6c279a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:18:35.430600 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-94001c2e-d22e-455d-9501-08395f6c279a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:18:35.539880 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94001c2e-d22e-455d-9501-08395f6c279a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:18:35.541330 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94001c2e-d22e-455d-9501-08395f6c279a service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:18:35.560235 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 742/1487] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:18:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:18:37.696651 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f51aaa2-3bdf-4b81-a2c6-af8630249f81 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:18:37.697231 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f51aaa2-3bdf-4b81-a2c6-af8630249f81 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:18:37.697231 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f51aaa2-3bdf-4b81-a2c6-af8630249f81 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:18:37.698631 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 746/1488] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:18:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:18:37.703748 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f186e667-43d9-48c9-97ac-ae386ac3d8b1 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:18:37.704180 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f186e667-43d9-48c9-97ac-ae386ac3d8b1 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:18:37.704303 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f186e667-43d9-48c9-97ac-ae386ac3d8b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:18:37.774296 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-f186e667-43d9-48c9-97ac-ae386ac3d8b1 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:18:37.775522 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-f186e667-43d9-48c9-97ac-ae386ac3d8b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:18:37.828037 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:18:37.872280 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 743/1489] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:18:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:18:37.912565 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f51aaa2-3bdf-4b81-a2c6-af8630249f81 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:18:37.914187 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-6f51aaa2-3bdf-4b81-a2c6-af8630249f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:18:37.950816 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:18:38.019793 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f51aaa2-3bdf-4b81-a2c6-af8630249f81 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:18:38.091111 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ede65c-2c4c-4fb2-876c-c18683981908 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:18:38.091711 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ede65c-2c4c-4fb2-876c-c18683981908 service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:18:38.091988 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ede65c-2c4c-4fb2-876c-c18683981908 service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:18:38.092254 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ede65c-2c4c-4fb2-876c-c18683981908 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:18:38.093873 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-d1ede65c-2c4c-4fb2-876c-c18683981908 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:18:38.178259 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:18:38.207163 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ede65c-2c4c-4fb2-876c-c18683981908 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:18:38.208541 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ede65c-2c4c-4fb2-876c-c18683981908 service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:18:38.226589 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 747/1490] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:18:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:18:40.418993 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a922c9-3260-4cdb-b0b1-5da66dc70760 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:18:40.419552 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a922c9-3260-4cdb-b0b1-5da66dc70760 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:18:40.419552 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a922c9-3260-4cdb-b0b1-5da66dc70760 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:18:40.420866 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 744/1491] 10.222.0.36 () {54 vars in 927 bytes} [Tue Aug 9 10:18:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:18:40.425931 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65333295-56a0-484f-a875-617ae0d6ba3a None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:18:40.426342 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65333295-56a0-484f-a875-617ae0d6ba3a None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:18:40.426483 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65333295-56a0-484f-a875-617ae0d6ba3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:18:40.491069 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-65333295-56a0-484f-a875-617ae0d6ba3a None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:18:40.492298 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-65333295-56a0-484f-a875-617ae0d6ba3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:18:40.592229 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 748/1492] 10.222.0.36 () {58 vars in 1024 bytes} [Tue Aug 9 10:18:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:18:40.631342 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a922c9-3260-4cdb-b0b1-5da66dc70760 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:18:40.632883 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-b1a922c9-3260-4cdb-b0b1-5da66dc70760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:18:40.738936 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a922c9-3260-4cdb-b0b1-5da66dc70760 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:18:40.810682 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc56f1d-e4f2-4f19-ada9-11ae919854e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:18:40.811281 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc56f1d-e4f2-4f19-ada9-11ae919854e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:18:40.811557 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc56f1d-e4f2-4f19-ada9-11ae919854e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:18:40.811826 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc56f1d-e4f2-4f19-ada9-11ae919854e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:18:40.813411 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-8fc56f1d-e4f2-4f19-ada9-11ae919854e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:18:40.822745 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:18:40.920939 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc56f1d-e4f2-4f19-ada9-11ae919854e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:18:40.922411 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc56f1d-e4f2-4f19-ada9-11ae919854e6 service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:18:40.940645 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 745/1493] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:18:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:18:50.590437 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=82 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:18:50.938207 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=50 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:19:51.216691 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4186da-9160-4463-a3e8-2a9fff1f50ba None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:19:51.217256 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4186da-9160-4463-a3e8-2a9fff1f50ba None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:19:51.217256 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4186da-9160-4463-a3e8-2a9fff1f50ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:19:51.292598 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-6c4186da-9160-4463-a3e8-2a9fff1f50ba None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:19:51.293787 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-6c4186da-9160-4463-a3e8-2a9fff1f50ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:19:51.510475 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 749/1494] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:19:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:19:51.518500 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bffcce-5f8e-42fe-8145-e8224551f4c7 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:19:51.519033 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bffcce-5f8e-42fe-8145-e8224551f4c7 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:19:51.519033 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bffcce-5f8e-42fe-8145-e8224551f4c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:19:51.593742 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-46bffcce-5f8e-42fe-8145-e8224551f4c7 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:19:51.594949 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-46bffcce-5f8e-42fe-8145-e8224551f4c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:19:51.690291 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 746/1495] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:19:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:19:51.694959 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4186da-9160-4463-a3e8-2a9fff1f50ba None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:19:51.696202 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-6c4186da-9160-4463-a3e8-2a9fff1f50ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:19:51.707453 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4186da-9160-4463-a3e8-2a9fff1f50ba None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:19:51.767802 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:19:51.801685 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeb01c1-a67c-47da-adb7-3b309edd39c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:19:51.802298 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeb01c1-a67c-47da-adb7-3b309edd39c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:19:51.802568 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeb01c1-a67c-47da-adb7-3b309edd39c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:19:51.802832 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeb01c1-a67c-47da-adb7-3b309edd39c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:19:51.803461 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeb01c1-a67c-47da-adb7-3b309edd39c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:19:51.803757 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeb01c1-a67c-47da-adb7-3b309edd39c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:19:51.804761 dv-cinder-852364-2-smb devstack@keystone.service[80106]: WARNING py.warnings [None req-7aeb01c1-a67c-47da-adb7-3b309edd39c9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 10:19:51.804761 dv-cinder-852364-2-smb devstack@keystone.service[80106]: warnings.warn(msg) Aug 09 10:19:51.804761 dv-cinder-852364-2-smb devstack@keystone.service[80106]: Aug 09 10:19:51.805639 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeb01c1-a67c-47da-adb7-3b309edd39c9 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:19:51.816388 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 750/1496] 10.222.0.36 () {58 vars in 1153 bytes} [Tue Aug 9 10:19:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:19:51.824987 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bffcce-5f8e-42fe-8145-e8224551f4c7 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:19:51.834533 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bffcce-5f8e-42fe-8145-e8224551f4c7 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:19:51.896149 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:19:51.931370 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47a0f7c-6d3e-4f92-9543-87475371ec2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:19:51.931970 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a0f7c-6d3e-4f92-9543-87475371ec2d admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:19:51.932247 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a0f7c-6d3e-4f92-9543-87475371ec2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:19:51.932518 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a0f7c-6d3e-4f92-9543-87475371ec2d admin admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:19:51.933134 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47a0f7c-6d3e-4f92-9543-87475371ec2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:19:51.934875 dv-cinder-852364-2-smb devstack@keystone.service[80105]: WARNING py.warnings [None req-e47a0f7c-6d3e-4f92-9543-87475371ec2d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 09 10:19:51.934875 dv-cinder-852364-2-smb devstack@keystone.service[80105]: warnings.warn(msg) Aug 09 10:19:51.934875 dv-cinder-852364-2-smb devstack@keystone.service[80105]: Aug 09 10:19:51.936068 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47a0f7c-6d3e-4f92-9543-87475371ec2d admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:19:51.992865 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 747/1497] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:19:51 2022] POST /identity/v3/projects => generated 377 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:19:51.997074 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeb01c1-a67c-47da-adb7-3b309edd39c9 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:19:51.998665 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-7aeb01c1-a67c-47da-adb7-3b309edd39c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:19:52.031230 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeb01c1-a67c-47da-adb7-3b309edd39c9 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:19:52.124270 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5f67f3-01f4-4175-ba64-ffc9868849f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:19:52.124863 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f67f3-01f4-4175-ba64-ffc9868849f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:19:52.125139 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f67f3-01f4-4175-ba64-ffc9868849f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:19:52.125401 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5f67f3-01f4-4175-ba64-ffc9868849f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:19:52.126045 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5f67f3-01f4-4175-ba64-ffc9868849f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:19:52.127054 dv-cinder-852364-2-smb devstack@keystone.service[80106]: WARNING py.warnings [None req-1c5f67f3-01f4-4175-ba64-ffc9868849f3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 09 10:19:52.127054 dv-cinder-852364-2-smb devstack@keystone.service[80106]: warnings.warn(msg) Aug 09 10:19:52.127054 dv-cinder-852364-2-smb devstack@keystone.service[80106]: Aug 09 10:19:52.128244 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5f67f3-01f4-4175-ba64-ffc9868849f3 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:19:52.171636 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 751/1498] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:19:51 2022] POST /identity/v3/users => generated 289 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:19:52.175746 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47a0f7c-6d3e-4f92-9543-87475371ec2d admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:19:52.178409 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-e47a0f7c-6d3e-4f92-9543-87475371ec2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:19:52.243188 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47a0f7c-6d3e-4f92-9543-87475371ec2d admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:19:52.326986 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:19:52.338231 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ab7a8c-bfc9-4e21-98da-0c1f6c4ce9a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:19:52.338836 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab7a8c-bfc9-4e21-98da-0c1f6c4ce9a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:19:52.339112 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab7a8c-bfc9-4e21-98da-0c1f6c4ce9a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:19:52.339378 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab7a8c-bfc9-4e21-98da-0c1f6c4ce9a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:19:52.340007 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ab7a8c-bfc9-4e21-98da-0c1f6c4ce9a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:19:52.341004 dv-cinder-852364-2-smb devstack@keystone.service[80105]: WARNING py.warnings [None req-77ab7a8c-bfc9-4e21-98da-0c1f6c4ce9a3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 10:19:52.341004 dv-cinder-852364-2-smb devstack@keystone.service[80105]: warnings.warn(msg) Aug 09 10:19:52.341004 dv-cinder-852364-2-smb devstack@keystone.service[80105]: Aug 09 10:19:52.341901 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ab7a8c-bfc9-4e21-98da-0c1f6c4ce9a3 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:19:52.354864 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 748/1499] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:19:52 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:19:52.359091 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5f67f3-01f4-4175-ba64-ffc9868849f3 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:19:52.360653 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-1c5f67f3-01f4-4175-ba64-ffc9868849f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:19:52.372664 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5f67f3-01f4-4175-ba64-ffc9868849f3 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:19:52.398251 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:19:52.466923 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9888c9f9-ac1d-4c0c-91fe-083fda130998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:19:52.467520 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9888c9f9-ac1d-4c0c-91fe-083fda130998 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:19:52.467792 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9888c9f9-ac1d-4c0c-91fe-083fda130998 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:19:52.468059 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9888c9f9-ac1d-4c0c-91fe-083fda130998 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:19:52.468688 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9888c9f9-ac1d-4c0c-91fe-083fda130998 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:19:52.469688 dv-cinder-852364-2-smb devstack@keystone.service[80106]: WARNING py.warnings [None req-9888c9f9-ac1d-4c0c-91fe-083fda130998 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 10:19:52.469688 dv-cinder-852364-2-smb devstack@keystone.service[80106]: warnings.warn(msg) Aug 09 10:19:52.469688 dv-cinder-852364-2-smb devstack@keystone.service[80106]: Aug 09 10:19:52.470589 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9888c9f9-ac1d-4c0c-91fe-083fda130998 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:19:52.483326 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 752/1500] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:19:52 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:19:52.487438 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ab7a8c-bfc9-4e21-98da-0c1f6c4ce9a3 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:19:52.488970 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-77ab7a8c-bfc9-4e21-98da-0c1f6c4ce9a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:19:52.521755 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ab7a8c-bfc9-4e21-98da-0c1f6c4ce9a3 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:19:52.618763 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ee7aa0-d0e7-4787-98b7-178dd078af73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:19:52.619338 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ee7aa0-d0e7-4787-98b7-178dd078af73 admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:19:52.619626 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ee7aa0-d0e7-4787-98b7-178dd078af73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:19:52.619900 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ee7aa0-d0e7-4787-98b7-178dd078af73 admin admin] PATH_INFO: `/v3/projects/6536645cf9514a968a953f4a07b0efbc/users/1be5770d0aa54a01bd76435061fbd3a9/roles/a9895331e9694fa8b2b50908bb057bcb` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:19:52.642817 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ee7aa0-d0e7-4787-98b7-178dd078af73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6536645cf9514a968a953f4a07b0efbc, user_id=1be5770d0aa54a01bd76435061fbd3a9, role_id=a9895331e9694fa8b2b50908bb057bcb)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:19:52.643836 dv-cinder-852364-2-smb devstack@keystone.service[80105]: WARNING py.warnings [None req-d9ee7aa0-d0e7-4787-98b7-178dd078af73 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 09 10:19:52.643836 dv-cinder-852364-2-smb devstack@keystone.service[80105]: warnings.warn(msg) Aug 09 10:19:52.643836 dv-cinder-852364-2-smb devstack@keystone.service[80105]: Aug 09 10:19:52.646285 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ee7aa0-d0e7-4787-98b7-178dd078af73 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:19:52.670660 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 749/1501] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:19:52 2022] PUT /identity/v3/projects/6536645cf9514a968a953f4a07b0efbc/users/1be5770d0aa54a01bd76435061fbd3a9/roles/a9895331e9694fa8b2b50908bb057bcb => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:19:52.682834 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea048ec-8966-421b-b88a-5fa8e562a93e None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:19:52.683117 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea048ec-8966-421b-b88a-5fa8e562a93e None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:19:52.683419 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea048ec-8966-421b-b88a-5fa8e562a93e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:19:52.739510 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-4ea048ec-8966-421b-b88a-5fa8e562a93e None None] MFA Rules not processed for user `1be5770d0aa54a01bd76435061fbd3a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:19:52.740691 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-4ea048ec-8966-421b-b88a-5fa8e562a93e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:19:52.816793 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 753/1502] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:19:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:19:52.830426 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe0bf8f-eecc-41ca-9bcc-8f5eeb017910 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:19:52.830710 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe0bf8f-eecc-41ca-9bcc-8f5eeb017910 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:19:52.830983 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe0bf8f-eecc-41ca-9bcc-8f5eeb017910 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:19:52.832326 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 750/1503] 10.222.0.36 () {54 vars in 964 bytes} [Tue Aug 9 10:19:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:19:52.837770 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530977c6-0a6a-4c1b-8719-1933685bdc65 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:19:52.838082 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530977c6-0a6a-4c1b-8719-1933685bdc65 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:19:52.838351 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530977c6-0a6a-4c1b-8719-1933685bdc65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:19:52.869011 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:19:52.916566 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-530977c6-0a6a-4c1b-8719-1933685bdc65 None None] MFA Rules not processed for user `1f6c687a38524de0bf23d87ae91d3b0f`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:19:52.917764 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-530977c6-0a6a-4c1b-8719-1933685bdc65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:19:52.992527 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 754/1504] 10.222.0.36 () {58 vars in 1061 bytes} [Tue Aug 9 10:19:52 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:19:53.000527 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe0bf8f-eecc-41ca-9bcc-8f5eeb017910 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:19:53.002066 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-bfe0bf8f-eecc-41ca-9bcc-8f5eeb017910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:19:53.052186 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:19:53.106484 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe0bf8f-eecc-41ca-9bcc-8f5eeb017910 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:19:53.183059 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f57b33-ef76-4192-94b3-99ac5d9f70d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6c687a38524de0bf23d87ae91d3b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:19:53.183664 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f57b33-ef76-4192-94b3-99ac5d9f70d1 service cinder] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:19:53.183937 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f57b33-ef76-4192-94b3-99ac5d9f70d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:19:53.184200 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f57b33-ef76-4192-94b3-99ac5d9f70d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:19:53.185870 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-68f57b33-ef76-4192-94b3-99ac5d9f70d1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:19:53.283903 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f57b33-ef76-4192-94b3-99ac5d9f70d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:19:53.285590 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f57b33-ef76-4192-94b3-99ac5d9f70d1 service cinder] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:19:53.289072 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:19:53.304766 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 751/1505] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:19:52 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 10:19:53.349342 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc072aca-351b-4511-8b85-0fe0723be684 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:19:53.349631 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc072aca-351b-4511-8b85-0fe0723be684 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:19:53.349943 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc072aca-351b-4511-8b85-0fe0723be684 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:19:53.351236 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 755/1506] 10.222.0.36 () {52 vars in 830 bytes} [Tue Aug 9 10:19:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:19:53.354815 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f57b33-ef76-4192-94b3-99ac5d9f70d1 service cinder] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:19:53.356012 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-68f57b33-ef76-4192-94b3-99ac5d9f70d1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:19:53.452312 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f57b33-ef76-4192-94b3-99ac5d9f70d1 service cinder] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:19:53.543524 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517f2fdd-610e-4063-ace5-63b644aea4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:19:53.544163 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f2fdd-610e-4063-ace5-63b644aea4be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:19:53.544391 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f2fdd-610e-4063-ace5-63b644aea4be admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:19:53.544658 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f2fdd-610e-4063-ace5-63b644aea4be admin admin] PATH_INFO: `/v3/users/1be5770d0aa54a01bd76435061fbd3a9` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:19:53.556522 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517f2fdd-610e-4063-ace5-63b644aea4be admin admin] RBAC: Authorizing `identity:delete_user(user_id=1be5770d0aa54a01bd76435061fbd3a9)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:19:53.557528 dv-cinder-852364-2-smb devstack@keystone.service[80105]: WARNING py.warnings [None req-517f2fdd-610e-4063-ace5-63b644aea4be admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 09 10:19:53.557528 dv-cinder-852364-2-smb devstack@keystone.service[80105]: warnings.warn(msg) Aug 09 10:19:53.557528 dv-cinder-852364-2-smb devstack@keystone.service[80105]: Aug 09 10:19:53.558763 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517f2fdd-610e-4063-ace5-63b644aea4be admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:19:53.568935 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:19:53.623981 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-517f2fdd-610e-4063-ace5-63b644aea4be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1be5770d0aa54a01bd76435061fbd3a9'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:19:53.648315 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-517f2fdd-610e-4063-ace5-63b644aea4be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1be5770d0aa54a01bd76435061fbd3a9'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:19:53.662157 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-517f2fdd-610e-4063-ace5-63b644aea4be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1be5770d0aa54a01bd76435061fbd3a9'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:19:53.662724 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-517f2fdd-610e-4063-ace5-63b644aea4be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1be5770d0aa54a01bd76435061fbd3a9'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:19:53.671833 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-517f2fdd-610e-4063-ace5-63b644aea4be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1be5770d0aa54a01bd76435061fbd3a9'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:19:53.677647 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 752/1507] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:19:53 2022] DELETE /identity/v3/users/1be5770d0aa54a01bd76435061fbd3a9 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:19:53.681985 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a2437f-fdf2-4c58-9fbf-24ecccffa5f6 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:19:53.682456 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a2437f-fdf2-4c58-9fbf-24ecccffa5f6 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:19:53.682560 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a2437f-fdf2-4c58-9fbf-24ecccffa5f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:19:53.737708 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-a5a2437f-fdf2-4c58-9fbf-24ecccffa5f6 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:19:53.738857 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-a5a2437f-fdf2-4c58-9fbf-24ecccffa5f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:19:53.812166 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:19:53.824826 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 756/1508] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:19:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:19:53.835815 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517f2fdd-610e-4063-ace5-63b644aea4be admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:19:53.837067 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-517f2fdd-610e-4063-ace5-63b644aea4be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:19:53.937975 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517f2fdd-610e-4063-ace5-63b644aea4be admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:19:53.993006 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:19:54.013632 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ad3f9c-8442-470b-93c8-49430da6189e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:19:54.014287 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad3f9c-8442-470b-93c8-49430da6189e service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:19:54.014583 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad3f9c-8442-470b-93c8-49430da6189e service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:19:54.014832 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad3f9c-8442-470b-93c8-49430da6189e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:19:54.016413 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-69ad3f9c-8442-470b-93c8-49430da6189e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:19:54.121099 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ad3f9c-8442-470b-93c8-49430da6189e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:19:54.122544 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ad3f9c-8442-470b-93c8-49430da6189e service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:19:54.140978 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 753/1509] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:19:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:19:54.482757 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a2437f-fdf2-4c58-9fbf-24ecccffa5f6 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:19:54.484099 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-a5a2437f-fdf2-4c58-9fbf-24ecccffa5f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:19:54.495954 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a2437f-fdf2-4c58-9fbf-24ecccffa5f6 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:19:54.606850 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef8dc2c-5a22-4ba5-b916-6d35edc622d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:19:54.607476 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef8dc2c-5a22-4ba5-b916-6d35edc622d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:19:54.607749 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef8dc2c-5a22-4ba5-b916-6d35edc622d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:19:54.608015 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef8dc2c-5a22-4ba5-b916-6d35edc622d7 admin admin] PATH_INFO: `/v3/projects/6536645cf9514a968a953f4a07b0efbc` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:19:54.617801 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef8dc2c-5a22-4ba5-b916-6d35edc622d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6536645cf9514a968a953f4a07b0efbc)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:19:54.618855 dv-cinder-852364-2-smb devstack@keystone.service[80106]: WARNING py.warnings [None req-5ef8dc2c-5a22-4ba5-b916-6d35edc622d7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 09 10:19:54.618855 dv-cinder-852364-2-smb devstack@keystone.service[80106]: warnings.warn(msg) Aug 09 10:19:54.618855 dv-cinder-852364-2-smb devstack@keystone.service[80106]: Aug 09 10:19:54.620042 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef8dc2c-5a22-4ba5-b916-6d35edc622d7 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:19:54.678184 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-5ef8dc2c-5a22-4ba5-b916-6d35edc622d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6536645cf9514a968a953f4a07b0efbc', 'request_id': 'req-5ef8dc2c-5a22-4ba5-b916-6d35edc622d7'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:19:54.683985 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-5ef8dc2c-5a22-4ba5-b916-6d35edc622d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6536645cf9514a968a953f4a07b0efbc', 'request_id': 'req-5ef8dc2c-5a22-4ba5-b916-6d35edc622d7'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:19:54.697482 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-5ef8dc2c-5a22-4ba5-b916-6d35edc622d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6536645cf9514a968a953f4a07b0efbc', 'request_id': 'req-5ef8dc2c-5a22-4ba5-b916-6d35edc622d7'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:19:54.723549 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-5ef8dc2c-5a22-4ba5-b916-6d35edc622d7 admin admin] The token cache is being invalidate because project 6536645cf9514a968a953f4a07b0efbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:19:54.723836 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-5ef8dc2c-5a22-4ba5-b916-6d35edc622d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:19:54.724264 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-5ef8dc2c-5a22-4ba5-b916-6d35edc622d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:19:54.725641 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 757/1510] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:19:54 2022] DELETE /identity/v3/projects/6536645cf9514a968a953f4a07b0efbc => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:20:04.138750 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=62 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:20:04.721473 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:21:28.620236 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ccba53-5435-4598-acbd-f2e23ad070e0 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:21:28.620835 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ccba53-5435-4598-acbd-f2e23ad070e0 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:21:28.620835 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ccba53-5435-4598-acbd-f2e23ad070e0 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:21:28.622171 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 754/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 10:21:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:21:28.626890 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ddbc4b-2795-4091-927f-dc541f5c9ca0 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:21:28.627327 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ddbc4b-2795-4091-927f-dc541f5c9ca0 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:21:28.627435 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ddbc4b-2795-4091-927f-dc541f5c9ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:21:28.709413 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-a2ddbc4b-2795-4091-927f-dc541f5c9ca0 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:21:28.710657 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-a2ddbc4b-2795-4091-927f-dc541f5c9ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:21:28.812746 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 758/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 10:21:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:21:28.972294 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ccba53-5435-4598-acbd-f2e23ad070e0 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:21:28.975444 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-07ccba53-5435-4598-acbd-f2e23ad070e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:21:29.099135 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ccba53-5435-4598-acbd-f2e23ad070e0 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:21:29.104592 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1063c7a-d078-4330-bf6c-43cbfb176f4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb863beaaa9f495c8b64655996c061f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:21:29.105229 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1063c7a-d078-4330-bf6c-43cbfb176f4a service nova] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:21:29.105514 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1063c7a-d078-4330-bf6c-43cbfb176f4a service nova] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:21:29.105785 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1063c7a-d078-4330-bf6c-43cbfb176f4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:21:29.114180 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1063c7a-d078-4330-bf6c-43cbfb176f4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:21:29.115756 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1063c7a-d078-4330-bf6c-43cbfb176f4a service nova] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:21:29.124953 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 755/1513] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:21:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:21:29.956250 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87489d1-1898-49d8-a3db-e49aeead0216 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:21:29.956729 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87489d1-1898-49d8-a3db-e49aeead0216 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:21:29.957685 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87489d1-1898-49d8-a3db-e49aeead0216 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:21:29.958764 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 759/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 10:21:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:21:29.963850 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4415b91-2b52-4118-8c46-cb2d56efcc26 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:21:29.964297 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4415b91-2b52-4118-8c46-cb2d56efcc26 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:21:29.964404 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4415b91-2b52-4118-8c46-cb2d56efcc26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:21:29.984414 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-c4415b91-2b52-4118-8c46-cb2d56efcc26 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:21:29.985620 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-c4415b91-2b52-4118-8c46-cb2d56efcc26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:21:29.993692 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 756/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 10:21:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:21:30.144926 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87489d1-1898-49d8-a3db-e49aeead0216 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:21:30.159391 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87489d1-1898-49d8-a3db-e49aeead0216 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:21:30.165311 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efb7020-72a7-4ed9-96c0-752fe5a2e8fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb863beaaa9f495c8b64655996c061f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:21:30.165931 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb7020-72a7-4ed9-96c0-752fe5a2e8fa service nova] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:21:30.166216 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb7020-72a7-4ed9-96c0-752fe5a2e8fa service nova] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:21:30.166492 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb7020-72a7-4ed9-96c0-752fe5a2e8fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:21:30.174706 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efb7020-72a7-4ed9-96c0-752fe5a2e8fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:21:30.176367 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efb7020-72a7-4ed9-96c0-752fe5a2e8fa service nova] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:21:30.185687 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 760/1516] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:21:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:21:30.680397 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51808715-f61d-4ad0-a933-7af0e3ccd0ba None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:21:30.680681 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51808715-f61d-4ad0-a933-7af0e3ccd0ba None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:21:30.680959 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51808715-f61d-4ad0-a933-7af0e3ccd0ba None None] PATH_INFO: `/v3` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:21:30.682279 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 757/1517] 10.222.0.30 () {54 vars in 925 bytes} [Tue Aug 9 10:21:30 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:21:30.688583 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a304a9e3-8756-4e63-8cd8-4770b81f2d59 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:21:30.688868 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a304a9e3-8756-4e63-8cd8-4770b81f2d59 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:21:30.689139 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a304a9e3-8756-4e63-8cd8-4770b81f2d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:21:30.747554 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-a304a9e3-8756-4e63-8cd8-4770b81f2d59 None None] MFA Rules not processed for user `c4d3b6a332394adf9e1b81ee9c171c48`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:21:30.748740 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-a304a9e3-8756-4e63-8cd8-4770b81f2d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:21:30.765336 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:21:30.821188 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 761/1518] 10.222.0.30 () {58 vars in 1015 bytes} [Tue Aug 9 10:21:30 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:21:34.625952 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cf3216-24c5-4b7b-9c1d-7d366e16ef08 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:21:34.626503 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cf3216-24c5-4b7b-9c1d-7d366e16ef08 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:21:34.626503 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cf3216-24c5-4b7b-9c1d-7d366e16ef08 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:21:34.627833 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 758/1519] 10.222.0.36 () {54 vars in 961 bytes} [Tue Aug 9 10:21:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:21:34.634030 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89e4f6b-0919-439b-96e1-26dfd0b89161 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:21:34.634423 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89e4f6b-0919-439b-96e1-26dfd0b89161 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:21:34.634595 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89e4f6b-0919-439b-96e1-26dfd0b89161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:21:34.653725 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-c89e4f6b-0919-439b-96e1-26dfd0b89161 None None] MFA Rules not processed for user `c4d3b6a332394adf9e1b81ee9c171c48`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:21:34.654925 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-c89e4f6b-0919-439b-96e1-26dfd0b89161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:21:34.663697 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 762/1520] 10.222.0.36 () {58 vars in 1058 bytes} [Tue Aug 9 10:21:34 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:21:34.670911 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cf3216-24c5-4b7b-9c1d-7d366e16ef08 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:21:34.684651 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cf3216-24c5-4b7b-9c1d-7d366e16ef08 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:21:34.689567 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7296edbe-c20d-4a9d-95b7-7a7ee0ea3266 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4d3b6a332394adf9e1b81ee9c171c48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:21:34.690259 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7296edbe-c20d-4a9d-95b7-7a7ee0ea3266 service placement] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:21:34.690543 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7296edbe-c20d-4a9d-95b7-7a7ee0ea3266 service placement] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:21:34.690816 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7296edbe-c20d-4a9d-95b7-7a7ee0ea3266 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:21:34.699577 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7296edbe-c20d-4a9d-95b7-7a7ee0ea3266 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:21:34.701144 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7296edbe-c20d-4a9d-95b7-7a7ee0ea3266 service placement] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:21:34.710949 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 759/1521] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:21:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 10:21:41.442561 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec0b45-3749-4fbe-bfc9-4fd3b55e0e62 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:21:41.443178 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec0b45-3749-4fbe-bfc9-4fd3b55e0e62 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:21:41.443178 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec0b45-3749-4fbe-bfc9-4fd3b55e0e62 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:21:41.444476 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 763/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 10:21:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:21:41.449116 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dffca71-98fb-49ba-97e5-7efa1cfda4f8 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:21:41.449523 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dffca71-98fb-49ba-97e5-7efa1cfda4f8 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:21:41.449663 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dffca71-98fb-49ba-97e5-7efa1cfda4f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:21:41.469631 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-7dffca71-98fb-49ba-97e5-7efa1cfda4f8 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:21:41.470887 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-7dffca71-98fb-49ba-97e5-7efa1cfda4f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:21:41.479101 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 760/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 10:21:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:21:41.635843 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bec0b45-3749-4fbe-bfc9-4fd3b55e0e62 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:21:41.651507 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bec0b45-3749-4fbe-bfc9-4fd3b55e0e62 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:21:41.657042 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79528f3e-0993-4ec0-b370-5340fff13c16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb863beaaa9f495c8b64655996c061f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:21:41.657929 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79528f3e-0993-4ec0-b370-5340fff13c16 service nova] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:21:41.658214 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79528f3e-0993-4ec0-b370-5340fff13c16 service nova] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:21:41.658485 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79528f3e-0993-4ec0-b370-5340fff13c16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:21:41.666628 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79528f3e-0993-4ec0-b370-5340fff13c16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:21:41.668214 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79528f3e-0993-4ec0-b370-5340fff13c16 service nova] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:21:41.677472 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 764/1524] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:21:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 10:21:42.493565 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98945e7-cefd-45e7-9228-4e90a0389c28 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:21:42.494187 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98945e7-cefd-45e7-9228-4e90a0389c28 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:21:42.494187 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98945e7-cefd-45e7-9228-4e90a0389c28 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:21:42.495476 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 761/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 9 10:21:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:21:42.500281 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c87626-dd48-4de5-932e-a6bbb2f2f741 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:21:42.500725 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c87626-dd48-4de5-932e-a6bbb2f2f741 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:21:42.500823 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c87626-dd48-4de5-932e-a6bbb2f2f741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:21:42.520765 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-b2c87626-dd48-4de5-932e-a6bbb2f2f741 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:21:42.521985 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-b2c87626-dd48-4de5-932e-a6bbb2f2f741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:21:42.529692 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 765/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 9 10:21:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:21:42.680887 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98945e7-cefd-45e7-9228-4e90a0389c28 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:21:42.696347 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98945e7-cefd-45e7-9228-4e90a0389c28 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:21:42.701632 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f469a603-8316-49f5-8e9a-83a1d547a808 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb863beaaa9f495c8b64655996c061f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:21:42.702252 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f469a603-8316-49f5-8e9a-83a1d547a808 service nova] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:21:42.702531 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f469a603-8316-49f5-8e9a-83a1d547a808 service nova] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:21:42.702800 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f469a603-8316-49f5-8e9a-83a1d547a808 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:21:42.710693 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f469a603-8316-49f5-8e9a-83a1d547a808 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:21:42.712278 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f469a603-8316-49f5-8e9a-83a1d547a808 service nova] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:21:42.721465 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 762/1527] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:21:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:21:46.542418 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc24846-4c65-4335-8ed8-c9895fe68d83 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:21:46.542966 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc24846-4c65-4335-8ed8-c9895fe68d83 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:21:46.542966 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc24846-4c65-4335-8ed8-c9895fe68d83 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:21:46.544350 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 766/1528] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 10:21:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:21:46.549504 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd29fe-66a8-4070-a2cf-0094ca636b1f None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:21:46.550592 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd29fe-66a8-4070-a2cf-0094ca636b1f None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:21:46.550592 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd29fe-66a8-4070-a2cf-0094ca636b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:21:46.570825 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-52bd29fe-66a8-4070-a2cf-0094ca636b1f None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:21:46.572004 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-52bd29fe-66a8-4070-a2cf-0094ca636b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:21:46.579616 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 763/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 10:21:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:21:46.652308 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc24846-4c65-4335-8ed8-c9895fe68d83 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:21:46.654020 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-3fc24846-4c65-4335-8ed8-c9895fe68d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:21:46.731260 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc24846-4c65-4335-8ed8-c9895fe68d83 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:21:46.734804 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df1a083-6692-403c-af94-8fb0203ee91c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:21:46.735393 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df1a083-6692-403c-af94-8fb0203ee91c service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:21:46.735668 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df1a083-6692-403c-af94-8fb0203ee91c service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:21:46.735939 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df1a083-6692-403c-af94-8fb0203ee91c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:21:46.745157 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df1a083-6692-403c-af94-8fb0203ee91c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:21:46.746603 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df1a083-6692-403c-af94-8fb0203ee91c service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:21:46.756687 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 767/1530] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:21:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:21:48.755372 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e955a-04a9-4ac6-8dc5-5b696cbf9029 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:21:48.755920 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e955a-04a9-4ac6-8dc5-5b696cbf9029 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:21:48.755920 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e955a-04a9-4ac6-8dc5-5b696cbf9029 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:21:48.757260 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 764/1531] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 10:21:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:21:48.762394 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd0480b-3f44-4eee-b103-3d5f5435022c None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:21:48.762804 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd0480b-3f44-4eee-b103-3d5f5435022c None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:21:48.762941 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd0480b-3f44-4eee-b103-3d5f5435022c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:21:48.782164 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-9bd0480b-3f44-4eee-b103-3d5f5435022c None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:21:48.783593 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-9bd0480b-3f44-4eee-b103-3d5f5435022c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:21:48.791899 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 768/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 10:21:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:21:48.826235 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296e955a-04a9-4ac6-8dc5-5b696cbf9029 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:21:48.837397 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296e955a-04a9-4ac6-8dc5-5b696cbf9029 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:21:48.840858 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa5bafe-afd1-4201-b4f4-cfc754350cde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:21:48.841449 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5bafe-afd1-4201-b4f4-cfc754350cde service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:21:48.841725 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5bafe-afd1-4201-b4f4-cfc754350cde service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:21:48.842031 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5bafe-afd1-4201-b4f4-cfc754350cde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:21:48.851302 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa5bafe-afd1-4201-b4f4-cfc754350cde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:21:48.852704 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa5bafe-afd1-4201-b4f4-cfc754350cde service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:21:48.862079 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 765/1533] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:21:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:21:52.292157 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d75f4-855a-4eb4-baaf-5fe66ac882a2 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:21:52.292692 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d75f4-855a-4eb4-baaf-5fe66ac882a2 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:21:52.292692 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d75f4-855a-4eb4-baaf-5fe66ac882a2 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:21:52.293987 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 769/1534] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 10:21:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:21:52.299173 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f96c1-dde2-4f7d-97bf-0a86fb183ebf None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:21:52.300300 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f96c1-dde2-4f7d-97bf-0a86fb183ebf None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:21:52.300300 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f96c1-dde2-4f7d-97bf-0a86fb183ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:21:52.319579 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-4c3f96c1-dde2-4f7d-97bf-0a86fb183ebf None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:21:52.320748 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-4c3f96c1-dde2-4f7d-97bf-0a86fb183ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:21:52.328353 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 766/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 10:21:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:21:52.630626 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3d75f4-855a-4eb4-baaf-5fe66ac882a2 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:21:52.632290 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-aa3d75f4-855a-4eb4-baaf-5fe66ac882a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:21:52.698285 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:21:52.713010 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3d75f4-855a-4eb4-baaf-5fe66ac882a2 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:21:52.716603 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8858515b-9c8b-4a68-beeb-33705623f0de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6c687a38524de0bf23d87ae91d3b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:21:52.717198 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8858515b-9c8b-4a68-beeb-33705623f0de service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:21:52.717475 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8858515b-9c8b-4a68-beeb-33705623f0de service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:21:52.717744 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8858515b-9c8b-4a68-beeb-33705623f0de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:21:52.726933 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8858515b-9c8b-4a68-beeb-33705623f0de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:21:52.728361 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8858515b-9c8b-4a68-beeb-33705623f0de service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:21:52.738105 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 770/1536] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:21:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:21:54.752972 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdf6118-e6a7-4609-8f65-c5a79f7219c3 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:21:54.753579 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdf6118-e6a7-4609-8f65-c5a79f7219c3 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:21:54.753579 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdf6118-e6a7-4609-8f65-c5a79f7219c3 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:21:54.755168 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 767/1537] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 9 10:21:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:21:54.760238 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c3a51-1e46-4828-bb14-ebd8f5df6d17 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:21:54.760635 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c3a51-1e46-4828-bb14-ebd8f5df6d17 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:21:54.760786 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c3a51-1e46-4828-bb14-ebd8f5df6d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:21:54.780316 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-ba4c3a51-1e46-4828-bb14-ebd8f5df6d17 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:21:54.781487 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-ba4c3a51-1e46-4828-bb14-ebd8f5df6d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:21:54.790162 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 771/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 9 10:21:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:21:55.091285 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdf6118-e6a7-4609-8f65-c5a79f7219c3 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:21:55.092982 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-3cdf6118-e6a7-4609-8f65-c5a79f7219c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:21:55.101070 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=84 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:21:55.107522 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdf6118-e6a7-4609-8f65-c5a79f7219c3 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:21:55.110977 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319a5855-766a-417d-ae58-6d558690b0ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6c687a38524de0bf23d87ae91d3b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:21:55.111560 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a5855-766a-417d-ae58-6d558690b0ac service cinder] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:21:55.112527 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a5855-766a-417d-ae58-6d558690b0ac service cinder] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:21:55.112739 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a5855-766a-417d-ae58-6d558690b0ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:21:55.121389 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319a5855-766a-417d-ae58-6d558690b0ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:21:55.122813 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319a5855-766a-417d-ae58-6d558690b0ac service cinder] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:21:55.131973 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 768/1539] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:21:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:22:04.775680 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=11 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:22:05.127829 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=5 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:23:19.882698 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408d0f6d-7dcd-4b26-8df8-99e132c7f6ec None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:19.891931 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408d0f6d-7dcd-4b26-8df8-99e132c7f6ec None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:19.891931 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408d0f6d-7dcd-4b26-8df8-99e132c7f6ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:19.910521 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-408d0f6d-7dcd-4b26-8df8-99e132c7f6ec None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:23:19.911732 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-408d0f6d-7dcd-4b26-8df8-99e132c7f6ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:19.923447 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 772/1540] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:23:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:23:19.932893 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd8ab2-4a9e-4221-84c1-38b8fe665243 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:19.933604 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd8ab2-4a9e-4221-84c1-38b8fe665243 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:19.933604 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd8ab2-4a9e-4221-84c1-38b8fe665243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:19.963508 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-0edd8ab2-4a9e-4221-84c1-38b8fe665243 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:23:19.964724 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-0edd8ab2-4a9e-4221-84c1-38b8fe665243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:19.980803 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 769/1541] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:23:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 10:23:19.985786 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408d0f6d-7dcd-4b26-8df8-99e132c7f6ec None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:20.002594 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408d0f6d-7dcd-4b26-8df8-99e132c7f6ec None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:20.009467 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8652b6ab-d13a-49e1-9811-1d8c5a74b5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:20.010124 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8652b6ab-d13a-49e1-9811-1d8c5a74b5e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:20.010400 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8652b6ab-d13a-49e1-9811-1d8c5a74b5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:20.010664 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8652b6ab-d13a-49e1-9811-1d8c5a74b5e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:20.011319 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8652b6ab-d13a-49e1-9811-1d8c5a74b5e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:23:20.011617 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8652b6ab-d13a-49e1-9811-1d8c5a74b5e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:20.013324 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8652b6ab-d13a-49e1-9811-1d8c5a74b5e2 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:20.037819 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 773/1542] 10.222.0.36 () {58 vars in 1153 bytes} [Tue Aug 9 10:23:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:23:20.046979 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edd8ab2-4a9e-4221-84c1-38b8fe665243 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:20.057143 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edd8ab2-4a9e-4221-84c1-38b8fe665243 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:20.066824 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaaa683-9bca-4ea0-bb44-5278fd61ee5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:20.067460 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaaa683-9bca-4ea0-bb44-5278fd61ee5e admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:20.067740 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaaa683-9bca-4ea0-bb44-5278fd61ee5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:20.068166 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaaa683-9bca-4ea0-bb44-5278fd61ee5e admin admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:20.068820 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaaa683-9bca-4ea0-bb44-5278fd61ee5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:20.073234 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaaa683-9bca-4ea0-bb44-5278fd61ee5e admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:20.126640 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 770/1543] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:23:20 2022] POST /identity/v3/projects => generated 385 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:23:20.131019 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8652b6ab-d13a-49e1-9811-1d8c5a74b5e2 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:20.151043 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8652b6ab-d13a-49e1-9811-1d8c5a74b5e2 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:20.203608 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4165fc-3d90-4c35-bf45-cdd07354e00c None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:20.203950 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4165fc-3d90-4c35-bf45-cdd07354e00c None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:20.204163 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4165fc-3d90-4c35-bf45-cdd07354e00c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:20.229552 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-7b4165fc-3d90-4c35-bf45-cdd07354e00c None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:23:20.230801 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-7b4165fc-3d90-4c35-bf45-cdd07354e00c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:20.261733 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4e8816-2937-405c-8758-9a11b9ba45d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:20.262547 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e8816-2937-405c-8758-9a11b9ba45d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:20.262826 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e8816-2937-405c-8758-9a11b9ba45d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:20.263219 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e8816-2937-405c-8758-9a11b9ba45d3 admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:20.263899 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4e8816-2937-405c-8758-9a11b9ba45d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:20.266802 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4e8816-2937-405c-8758-9a11b9ba45d3 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:20.305783 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 774/1544] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:23:20 2022] POST /identity/v3/users => generated 293 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:23:20.307103 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e0ee6f-1d7b-47d4-93a5-96abb27a4f88 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:20.307390 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e0ee6f-1d7b-47d4-93a5-96abb27a4f88 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:20.307662 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e0ee6f-1d7b-47d4-93a5-96abb27a4f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:20.346838 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-02e0ee6f-1d7b-47d4-93a5-96abb27a4f88 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:23:20.348273 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-02e0ee6f-1d7b-47d4-93a5-96abb27a4f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:20.351550 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 771/1545] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:23:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 10:23:20.352416 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4165fc-3d90-4c35-bf45-cdd07354e00c None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:20.364320 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 775/1546] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:23:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:23:20.365476 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d5af8d-9dfc-4fac-b608-cb3db4035ee2 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:20.365759 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d5af8d-9dfc-4fac-b608-cb3db4035ee2 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:20.366050 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d5af8d-9dfc-4fac-b608-cb3db4035ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:20.374523 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4165fc-3d90-4c35-bf45-cdd07354e00c None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:20.386548 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3aed38-2bc1-47aa-909a-4a166db63d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:20.387530 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3aed38-2bc1-47aa-909a-4a166db63d4e admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:20.387806 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3aed38-2bc1-47aa-909a-4a166db63d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:20.388069 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3aed38-2bc1-47aa-909a-4a166db63d4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:20.388711 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3aed38-2bc1-47aa-909a-4a166db63d4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:20.393693 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3aed38-2bc1-47aa-909a-4a166db63d4e admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:20.406853 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-42d5af8d-9dfc-4fac-b608-cb3db4035ee2 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:23:20.407978 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-42d5af8d-9dfc-4fac-b608-cb3db4035ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:20.420947 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 772/1547] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:23:20 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:23:20.424107 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beef128-de00-43a4-aec7-4aab053f2f30 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:20.424645 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beef128-de00-43a4-aec7-4aab053f2f30 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:20.425140 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beef128-de00-43a4-aec7-4aab053f2f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:20.434067 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 776/1548] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:23:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:23:20.435571 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b9d75-4691-4d68-960e-97593f962519 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:20.437005 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b9d75-4691-4d68-960e-97593f962519 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:20.437666 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b9d75-4691-4d68-960e-97593f962519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:20.454212 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-8beef128-de00-43a4-aec7-4aab053f2f30 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:23:20.455397 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-8beef128-de00-43a4-aec7-4aab053f2f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:20.458575 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-358b9d75-4691-4d68-960e-97593f962519 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:23:20.459900 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-358b9d75-4691-4d68-960e-97593f962519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:20.464960 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 773/1549] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:23:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:23:20.467120 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6146849-6705-49fc-9c16-ac9705b76bdb None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:20.467120 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6146849-6705-49fc-9c16-ac9705b76bdb None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:20.467120 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6146849-6705-49fc-9c16-ac9705b76bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:20.469274 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 777/1550] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:23:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:23:20.469864 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e311abed-6df8-4ec4-88dc-076d4c2c2836 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:20.470816 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e311abed-6df8-4ec4-88dc-076d4c2c2836 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:20.471085 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e311abed-6df8-4ec4-88dc-076d4c2c2836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:20.494355 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-e311abed-6df8-4ec4-88dc-076d4c2c2836 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:23:20.495540 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-e311abed-6df8-4ec4-88dc-076d4c2c2836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:20.496266 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-d6146849-6705-49fc-9c16-ac9705b76bdb None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:23:20.497564 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-d6146849-6705-49fc-9c16-ac9705b76bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:20.505937 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 774/1551] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:23:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:23:20.510016 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 778/1552] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:23:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:23:20.510266 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6146849-6705-49fc-9c16-ac9705b76bdb None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:20.512115 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a329577d-c603-48dc-9600-aa2e60258155 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:20.512400 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a329577d-c603-48dc-9600-aa2e60258155 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:20.512699 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a329577d-c603-48dc-9600-aa2e60258155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:20.523881 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6146849-6705-49fc-9c16-ac9705b76bdb None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:20.528634 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c115e098-ed36-4c40-b15e-f566a4b08317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:20.529238 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c115e098-ed36-4c40-b15e-f566a4b08317 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:20.529518 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c115e098-ed36-4c40-b15e-f566a4b08317 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:20.530491 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c115e098-ed36-4c40-b15e-f566a4b08317 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:20.531511 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c115e098-ed36-4c40-b15e-f566a4b08317 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:20.533139 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c115e098-ed36-4c40-b15e-f566a4b08317 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:20.534293 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-a329577d-c603-48dc-9600-aa2e60258155 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:23:20.535471 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-a329577d-c603-48dc-9600-aa2e60258155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:20.543082 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 779/1553] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:23:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:23:20.547757 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 775/1554] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:23:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:23:20.547916 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81acd630-f89c-446a-b175-529e7e37447b None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:20.547916 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81acd630-f89c-446a-b175-529e7e37447b None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:20.548083 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c115e098-ed36-4c40-b15e-f566a4b08317 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:20.548169 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81acd630-f89c-446a-b175-529e7e37447b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:20.557754 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c115e098-ed36-4c40-b15e-f566a4b08317 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:20.562728 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945078e9-0aa6-4314-85bf-5c1209696ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:20.563317 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945078e9-0aa6-4314-85bf-5c1209696ba8 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:20.563597 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945078e9-0aa6-4314-85bf-5c1209696ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:20.563868 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945078e9-0aa6-4314-85bf-5c1209696ba8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:20.564504 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945078e9-0aa6-4314-85bf-5c1209696ba8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:23:20.564812 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945078e9-0aa6-4314-85bf-5c1209696ba8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:20.565814 dv-cinder-852364-2-smb devstack@keystone.service[80105]: WARNING py.warnings [None req-945078e9-0aa6-4314-85bf-5c1209696ba8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 10:23:20.565814 dv-cinder-852364-2-smb devstack@keystone.service[80105]: warnings.warn(msg) Aug 09 10:23:20.565814 dv-cinder-852364-2-smb devstack@keystone.service[80105]: Aug 09 10:23:20.566107 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-81acd630-f89c-446a-b175-529e7e37447b None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:23:20.566721 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945078e9-0aa6-4314-85bf-5c1209696ba8 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:20.567435 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-81acd630-f89c-446a-b175-529e7e37447b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:20.576974 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 780/1555] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:23:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:23:20.578182 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c06c551-df31-412a-b556-b910ce89eb67 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:20.578535 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c06c551-df31-412a-b556-b910ce89eb67 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:20.578810 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c06c551-df31-412a-b556-b910ce89eb67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:20.579176 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 776/1556] 10.222.0.36 () {58 vars in 1153 bytes} [Tue Aug 9 10:23:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:23:20.579981 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945078e9-0aa6-4314-85bf-5c1209696ba8 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:20.592061 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945078e9-0aa6-4314-85bf-5c1209696ba8 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:20.597687 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f89e107-fc3c-4e5a-a22e-3721ec027f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:20.598436 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f89e107-fc3c-4e5a-a22e-3721ec027f11 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:20.598715 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f89e107-fc3c-4e5a-a22e-3721ec027f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:20.598980 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f89e107-fc3c-4e5a-a22e-3721ec027f11 admin admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:20.599613 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f89e107-fc3c-4e5a-a22e-3721ec027f11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:23:20.599911 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f89e107-fc3c-4e5a-a22e-3721ec027f11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:20.600388 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-9c06c551-df31-412a-b556-b910ce89eb67 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:23:20.601482 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f89e107-fc3c-4e5a-a22e-3721ec027f11 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:20.601598 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-9c06c551-df31-412a-b556-b910ce89eb67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:20.609959 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 781/1557] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:23:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:23:20.620503 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 777/1558] 10.222.0.36 () {58 vars in 1153 bytes} [Tue Aug 9 10:23:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:23:20.620503 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5d9bc-3fa1-4b34-b635-cdc6930fa28e None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:20.620790 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c009588b-87ce-43e4-abfb-7a346eb77cbf None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:20.620888 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5d9bc-3fa1-4b34-b635-cdc6930fa28e None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:20.620985 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c009588b-87ce-43e4-abfb-7a346eb77cbf None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:20.621099 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5d9bc-3fa1-4b34-b635-cdc6930fa28e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:20.621201 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c009588b-87ce-43e4-abfb-7a346eb77cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:20.640368 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-c009588b-87ce-43e4-abfb-7a346eb77cbf None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:23:20.641328 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-81c5d9bc-3fa1-4b34-b635-cdc6930fa28e None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:23:20.641810 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-c009588b-87ce-43e4-abfb-7a346eb77cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:20.642502 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-81c5d9bc-3fa1-4b34-b635-cdc6930fa28e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:20.650779 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 782/1559] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:23:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:23:20.651354 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c009588b-87ce-43e4-abfb-7a346eb77cbf None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:20.651942 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 778/1560] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:23:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:23:20.653305 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaabdba-7e1a-4f7b-ac57-0150d39563f8 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:20.653594 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaabdba-7e1a-4f7b-ac57-0150d39563f8 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:20.654016 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaabdba-7e1a-4f7b-ac57-0150d39563f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:20.667135 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c009588b-87ce-43e4-abfb-7a346eb77cbf None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:20.673759 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5fde21-0c32-4958-9d71-2d4b231379a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:20.674599 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5fde21-0c32-4958-9d71-2d4b231379a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:20.674940 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5fde21-0c32-4958-9d71-2d4b231379a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:20.675162 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5fde21-0c32-4958-9d71-2d4b231379a8 admin admin] PATH_INFO: `/v3/projects/4de32e41dd4845fbba0547e9c53a4cf2/users/3d39820fab6041b9b655c54ce74e7e4d/roles/a9895331e9694fa8b2b50908bb057bcb` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:20.677649 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-1eaabdba-7e1a-4f7b-ac57-0150d39563f8 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:23:20.680346 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-1eaabdba-7e1a-4f7b-ac57-0150d39563f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:20.689758 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 779/1561] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:23:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:23:20.690759 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaabdba-7e1a-4f7b-ac57-0150d39563f8 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:20.698908 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5fde21-0c32-4958-9d71-2d4b231379a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4de32e41dd4845fbba0547e9c53a4cf2, user_id=3d39820fab6041b9b655c54ce74e7e4d, role_id=a9895331e9694fa8b2b50908bb057bcb)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:20.699948 dv-cinder-852364-2-smb devstack@keystone.service[80106]: WARNING py.warnings [None req-da5fde21-0c32-4958-9d71-2d4b231379a8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 09 10:23:20.699948 dv-cinder-852364-2-smb devstack@keystone.service[80106]: warnings.warn(msg) Aug 09 10:23:20.699948 dv-cinder-852364-2-smb devstack@keystone.service[80106]: Aug 09 10:23:20.700464 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaabdba-7e1a-4f7b-ac57-0150d39563f8 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:20.702459 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5fde21-0c32-4958-9d71-2d4b231379a8 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:20.706027 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf936a6-6ea1-43a5-b8af-82f421e5450a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:20.706762 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf936a6-6ea1-43a5-b8af-82f421e5450a admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:20.707021 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf936a6-6ea1-43a5-b8af-82f421e5450a admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:20.707239 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf936a6-6ea1-43a5-b8af-82f421e5450a admin admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:20.707911 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf936a6-6ea1-43a5-b8af-82f421e5450a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:23:20.708237 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf936a6-6ea1-43a5-b8af-82f421e5450a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:20.709825 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf936a6-6ea1-43a5-b8af-82f421e5450a admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:20.715691 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 783/1562] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:23:20 2022] PUT /identity/v3/projects/4de32e41dd4845fbba0547e9c53a4cf2/users/3d39820fab6041b9b655c54ce74e7e4d/roles/a9895331e9694fa8b2b50908bb057bcb => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:23:20.716463 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5fde21-0c32-4958-9d71-2d4b231379a8 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:20.724681 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 780/1563] 10.222.0.36 () {58 vars in 1153 bytes} [Tue Aug 9 10:23:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:23:20.725487 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf936a6-6ea1-43a5-b8af-82f421e5450a admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:20.735079 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf936a6-6ea1-43a5-b8af-82f421e5450a admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:20.768721 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:23:20.768934 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:23:20.780813 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5fde21-0c32-4958-9d71-2d4b231379a8 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:20.786206 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98605630-5ace-4a20-8518-7182fa9ff7ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:20.786808 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98605630-5ace-4a20-8518-7182fa9ff7ef admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:20.787093 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98605630-5ace-4a20-8518-7182fa9ff7ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:20.787365 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98605630-5ace-4a20-8518-7182fa9ff7ef admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:20.788009 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98605630-5ace-4a20-8518-7182fa9ff7ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:20.789128 dv-cinder-852364-2-smb devstack@keystone.service[80106]: WARNING py.warnings [None req-98605630-5ace-4a20-8518-7182fa9ff7ef admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 09 10:23:20.789128 dv-cinder-852364-2-smb devstack@keystone.service[80106]: warnings.warn(msg) Aug 09 10:23:20.789128 dv-cinder-852364-2-smb devstack@keystone.service[80106]: Aug 09 10:23:20.790354 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98605630-5ace-4a20-8518-7182fa9ff7ef admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:20.796828 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd335f1-8e92-46c1-852a-b40127f6c7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:20.797425 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd335f1-8e92-46c1-852a-b40127f6c7c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:20.797701 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd335f1-8e92-46c1-852a-b40127f6c7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:20.798006 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd335f1-8e92-46c1-852a-b40127f6c7c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:20.798642 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd335f1-8e92-46c1-852a-b40127f6c7c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:23:20.798938 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd335f1-8e92-46c1-852a-b40127f6c7c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:20.800503 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd335f1-8e92-46c1-852a-b40127f6c7c9 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:20.813505 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 781/1564] 10.222.0.36 () {58 vars in 1153 bytes} [Tue Aug 9 10:23:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:23:20.814341 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd335f1-8e92-46c1-852a-b40127f6c7c9 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:20.821907 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 784/1565] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:23:20 2022] POST /identity/v3/projects => generated 375 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:23:20.821907 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98605630-5ace-4a20-8518-7182fa9ff7ef admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:20.830649 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd335f1-8e92-46c1-852a-b40127f6c7c9 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:20.882886 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98605630-5ace-4a20-8518-7182fa9ff7ef admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:20.886418 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baece190-84df-44ef-b74d-8487836fee79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:20.887056 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baece190-84df-44ef-b74d-8487836fee79 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:20.887381 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baece190-84df-44ef-b74d-8487836fee79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:20.887596 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656c0135-b456-4c70-b971-ef55818c25cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:20.887731 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baece190-84df-44ef-b74d-8487836fee79 admin admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:20.888198 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c0135-b456-4c70-b971-ef55818c25cb admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:20.888294 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baece190-84df-44ef-b74d-8487836fee79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:20.888478 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c0135-b456-4c70-b971-ef55818c25cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:20.888751 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c0135-b456-4c70-b971-ef55818c25cb admin admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:20.889626 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656c0135-b456-4c70-b971-ef55818c25cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:23:20.889960 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656c0135-b456-4c70-b971-ef55818c25cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:20.890172 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baece190-84df-44ef-b74d-8487836fee79 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:20.891573 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656c0135-b456-4c70-b971-ef55818c25cb admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:20.903013 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 785/1566] 10.222.0.36 () {58 vars in 1153 bytes} [Tue Aug 9 10:23:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:23:20.904270 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cde4b7-8cfc-46fb-96a1-a48d9985eb64 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:20.904557 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cde4b7-8cfc-46fb-96a1-a48d9985eb64 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:20.904864 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cde4b7-8cfc-46fb-96a1-a48d9985eb64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:20.927121 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 782/1567] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:23:20 2022] POST /identity/v3/projects => generated 371 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:23:20.927121 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baece190-84df-44ef-b74d-8487836fee79 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:20.927414 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-f7cde4b7-8cfc-46fb-96a1-a48d9985eb64 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:23:20.927414 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-f7cde4b7-8cfc-46fb-96a1-a48d9985eb64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:20.997475 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 786/1568] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:23:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:23:20.999715 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2074ca9-c532-4941-b1b5-c74ba0bc69a4 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:21.000004 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2074ca9-c532-4941-b1b5-c74ba0bc69a4 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:21.000280 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2074ca9-c532-4941-b1b5-c74ba0bc69a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:21.004742 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baece190-84df-44ef-b74d-8487836fee79 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:21.009580 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f861bb7-f572-4fca-be32-136e5cdedba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:21.010222 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f861bb7-f572-4fca-be32-136e5cdedba5 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:21.010501 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f861bb7-f572-4fca-be32-136e5cdedba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:21.010771 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f861bb7-f572-4fca-be32-136e5cdedba5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:21.011417 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f861bb7-f572-4fca-be32-136e5cdedba5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:23:21.011716 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f861bb7-f572-4fca-be32-136e5cdedba5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:21.013363 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f861bb7-f572-4fca-be32-136e5cdedba5 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:21.018846 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-e2074ca9-c532-4941-b1b5-c74ba0bc69a4 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:23:21.020086 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-e2074ca9-c532-4941-b1b5-c74ba0bc69a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:21.025136 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 783/1569] 10.222.0.36 () {58 vars in 1153 bytes} [Tue Aug 9 10:23:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:23:21.026060 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f861bb7-f572-4fca-be32-136e5cdedba5 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:21.035146 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 787/1570] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:23:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:23:21.035757 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f861bb7-f572-4fca-be32-136e5cdedba5 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:21.035946 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2074ca9-c532-4941-b1b5-c74ba0bc69a4 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:21.042523 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0632f40-f430-4cb3-9ca4-0a015f03bf0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:21.043168 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0632f40-f430-4cb3-9ca4-0a015f03bf0c admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:21.043391 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0632f40-f430-4cb3-9ca4-0a015f03bf0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:21.043663 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0632f40-f430-4cb3-9ca4-0a015f03bf0c admin admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:21.044279 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0632f40-f430-4cb3-9ca4-0a015f03bf0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:21.045125 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2074ca9-c532-4941-b1b5-c74ba0bc69a4 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:21.046901 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0632f40-f430-4cb3-9ca4-0a015f03bf0c admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:21.050347 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f7318f-28f7-4158-8b60-e59ed7c8695a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:21.050932 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f7318f-28f7-4158-8b60-e59ed7c8695a admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:21.051210 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f7318f-28f7-4158-8b60-e59ed7c8695a admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:21.051522 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f7318f-28f7-4158-8b60-e59ed7c8695a admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:21.052130 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f7318f-28f7-4158-8b60-e59ed7c8695a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:21.054120 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f7318f-28f7-4158-8b60-e59ed7c8695a admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:21.075673 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 784/1571] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:23:21 2022] POST /identity/v3/projects => generated 393 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:23:21.076493 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0632f40-f430-4cb3-9ca4-0a015f03bf0c admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:21.083072 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 788/1572] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:23:21 2022] POST /identity/v3/projects => generated 387 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:23:21.083777 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f7318f-28f7-4158-8b60-e59ed7c8695a admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:21.108616 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:23:21.132148 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:23:21.147924 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0632f40-f430-4cb3-9ca4-0a015f03bf0c admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:21.150545 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f7318f-28f7-4158-8b60-e59ed7c8695a admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:21.152715 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0448a51-b9fd-4886-a0bb-f12864d825a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:21.153373 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0448a51-b9fd-4886-a0bb-f12864d825a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:21.153656 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0448a51-b9fd-4886-a0bb-f12864d825a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:21.154022 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0448a51-b9fd-4886-a0bb-f12864d825a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:21.155261 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0448a51-b9fd-4886-a0bb-f12864d825a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:21.156251 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb52bfb-ca50-45da-bff9-e0d0431086cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:21.156866 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb52bfb-ca50-45da-bff9-e0d0431086cc admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:21.157061 dv-cinder-852364-2-smb devstack@keystone.service[80105]: WARNING py.warnings [None req-b0448a51-b9fd-4886-a0bb-f12864d825a0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 09 10:23:21.157061 dv-cinder-852364-2-smb devstack@keystone.service[80105]: warnings.warn(msg) Aug 09 10:23:21.157061 dv-cinder-852364-2-smb devstack@keystone.service[80105]: Aug 09 10:23:21.157337 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb52bfb-ca50-45da-bff9-e0d0431086cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:21.157434 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb52bfb-ca50-45da-bff9-e0d0431086cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:21.158024 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb52bfb-ca50-45da-bff9-e0d0431086cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:21.158299 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0448a51-b9fd-4886-a0bb-f12864d825a0 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:21.160005 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb52bfb-ca50-45da-bff9-e0d0431086cc admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:21.181009 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 785/1573] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:23:21 2022] POST /identity/v3/users => generated 288 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:23:21.181808 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0448a51-b9fd-4886-a0bb-f12864d825a0 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:21.192824 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 789/1574] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:23:21 2022] POST /identity/v3/projects => generated 375 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:23:21.192986 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0448a51-b9fd-4886-a0bb-f12864d825a0 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:21.194015 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb52bfb-ca50-45da-bff9-e0d0431086cc admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:21.254040 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb1069-e041-476e-b6c8-d21ee8372af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:21.254655 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb1069-e041-476e-b6c8-d21ee8372af2 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:21.254937 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb1069-e041-476e-b6c8-d21ee8372af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:21.255211 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb1069-e041-476e-b6c8-d21ee8372af2 admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:21.255836 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeb1069-e041-476e-b6c8-d21ee8372af2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:21.257554 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb52bfb-ca50-45da-bff9-e0d0431086cc admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:21.257753 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeb1069-e041-476e-b6c8-d21ee8372af2 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:21.262242 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612368c8-cc21-44f4-97bb-b3a050e5ef4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:21.262847 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612368c8-cc21-44f4-97bb-b3a050e5ef4c admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:21.263120 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612368c8-cc21-44f4-97bb-b3a050e5ef4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:21.263392 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612368c8-cc21-44f4-97bb-b3a050e5ef4c admin admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:21.264357 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612368c8-cc21-44f4-97bb-b3a050e5ef4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:23:21.264668 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612368c8-cc21-44f4-97bb-b3a050e5ef4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:21.266284 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612368c8-cc21-44f4-97bb-b3a050e5ef4c admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:21.282445 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 790/1575] 10.222.0.36 () {58 vars in 1153 bytes} [Tue Aug 9 10:23:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:23:21.283223 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612368c8-cc21-44f4-97bb-b3a050e5ef4c admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:21.287006 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 786/1576] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:23:21 2022] POST /identity/v3/users => generated 286 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:23:21.287006 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb1069-e041-476e-b6c8-d21ee8372af2 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:21.296799 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612368c8-cc21-44f4-97bb-b3a050e5ef4c admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:21.301445 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e47726f-0923-455d-8cbb-4f2e562403b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:21.302186 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e47726f-0923-455d-8cbb-4f2e562403b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:21.302465 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e47726f-0923-455d-8cbb-4f2e562403b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:21.302734 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e47726f-0923-455d-8cbb-4f2e562403b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:21.303345 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e47726f-0923-455d-8cbb-4f2e562403b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:21.305233 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e47726f-0923-455d-8cbb-4f2e562403b3 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:21.333177 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 791/1577] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:23:21 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:23:21.334366 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e47726f-0923-455d-8cbb-4f2e562403b3 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:21.347746 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb1069-e041-476e-b6c8-d21ee8372af2 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:21.396933 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f36041d-4950-4688-a7a8-ce65a18493ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:21.397543 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f36041d-4950-4688-a7a8-ce65a18493ee service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:21.397822 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f36041d-4950-4688-a7a8-ce65a18493ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:21.398124 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f36041d-4950-4688-a7a8-ce65a18493ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:21.399079 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e47726f-0923-455d-8cbb-4f2e562403b3 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:21.403710 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751a2e90-c261-4393-a4d4-2966176c9bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:21.404308 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a2e90-c261-4393-a4d4-2966176c9bd4 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:21.405101 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a2e90-c261-4393-a4d4-2966176c9bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:21.405675 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a2e90-c261-4393-a4d4-2966176c9bd4 admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:21.406257 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751a2e90-c261-4393-a4d4-2966176c9bd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:21.408181 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751a2e90-c261-4393-a4d4-2966176c9bd4 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:21.408481 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f36041d-4950-4688-a7a8-ce65a18493ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:21.409953 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f36041d-4950-4688-a7a8-ce65a18493ee service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:21.419393 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 787/1578] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:23:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:23:21.420220 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f36041d-4950-4688-a7a8-ce65a18493ee service neutron] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:21.427721 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:23:21.431364 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 792/1579] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:23:21 2022] POST /identity/v3/users => generated 297 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:23:21.432181 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751a2e90-c261-4393-a4d4-2966176c9bd4 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:21.435327 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f36041d-4950-4688-a7a8-ce65a18493ee service neutron] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:21.441577 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf65d3d-55ae-4119-8b36-6c4da56ce877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:21.442348 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf65d3d-55ae-4119-8b36-6c4da56ce877 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:21.442691 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf65d3d-55ae-4119-8b36-6c4da56ce877 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:21.442965 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751a2e90-c261-4393-a4d4-2966176c9bd4 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:21.443302 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf65d3d-55ae-4119-8b36-6c4da56ce877 admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:21.444417 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf65d3d-55ae-4119-8b36-6c4da56ce877 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:21.447019 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf65d3d-55ae-4119-8b36-6c4da56ce877 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:21.448544 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1529805a-5d91-4e48-ba48-76b69475f26a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:21.449172 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1529805a-5d91-4e48-ba48-76b69475f26a admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:21.449544 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1529805a-5d91-4e48-ba48-76b69475f26a admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:21.449739 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1529805a-5d91-4e48-ba48-76b69475f26a admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:21.450429 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1529805a-5d91-4e48-ba48-76b69475f26a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:21.452207 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1529805a-5d91-4e48-ba48-76b69475f26a admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:21.463408 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 793/1580] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:23:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:23:21.464170 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1529805a-5d91-4e48-ba48-76b69475f26a admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:21.476625 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 788/1581] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:23:21 2022] POST /identity/v3/users => generated 294 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:23:21.476625 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf65d3d-55ae-4119-8b36-6c4da56ce877 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:21.476927 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1529805a-5d91-4e48-ba48-76b69475f26a admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:21.481606 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0216245e-4d62-4382-be6b-8f98bed4aa68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:21.482255 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0216245e-4d62-4382-be6b-8f98bed4aa68 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:21.482535 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0216245e-4d62-4382-be6b-8f98bed4aa68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:21.482874 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0216245e-4d62-4382-be6b-8f98bed4aa68 admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:21.483999 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0216245e-4d62-4382-be6b-8f98bed4aa68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:21.485994 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0216245e-4d62-4382-be6b-8f98bed4aa68 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:21.487043 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf65d3d-55ae-4119-8b36-6c4da56ce877 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:21.492804 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45003a3-2dbe-470d-bf09-b226e04b55f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:21.493582 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45003a3-2dbe-470d-bf09-b226e04b55f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:21.494055 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45003a3-2dbe-470d-bf09-b226e04b55f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:21.494332 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45003a3-2dbe-470d-bf09-b226e04b55f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:21.495208 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45003a3-2dbe-470d-bf09-b226e04b55f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:21.496638 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45003a3-2dbe-470d-bf09-b226e04b55f2 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:21.507582 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 789/1582] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:23:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:23:21.508742 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45003a3-2dbe-470d-bf09-b226e04b55f2 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:21.511352 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 794/1583] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:23:21 2022] POST /identity/v3/users => generated 288 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:23:21.512123 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0216245e-4d62-4382-be6b-8f98bed4aa68 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:21.518023 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:23:21.519700 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45003a3-2dbe-470d-bf09-b226e04b55f2 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:21.524113 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0216245e-4d62-4382-be6b-8f98bed4aa68 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:21.524570 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9dcd49-b34d-448f-bb14-1a41d88f6f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:21.525323 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9dcd49-b34d-448f-bb14-1a41d88f6f3b admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:21.525682 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9dcd49-b34d-448f-bb14-1a41d88f6f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:21.525918 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9dcd49-b34d-448f-bb14-1a41d88f6f3b admin admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:21.526635 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9dcd49-b34d-448f-bb14-1a41d88f6f3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:21.528940 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9dcd49-b34d-448f-bb14-1a41d88f6f3b admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:21.532487 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf931a56-594c-4962-adc3-ea7d56205e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:21.534978 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf931a56-594c-4962-adc3-ea7d56205e90 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:21.535823 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf931a56-594c-4962-adc3-ea7d56205e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:21.536523 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf931a56-594c-4962-adc3-ea7d56205e90 admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:21.537622 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf931a56-594c-4962-adc3-ea7d56205e90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:21.540223 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf931a56-594c-4962-adc3-ea7d56205e90 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:21.564364 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 790/1584] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:23:21 2022] POST /identity/v3/projects => generated 377 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:23:21.565425 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9dcd49-b34d-448f-bb14-1a41d88f6f3b admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:21.572749 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 795/1585] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:23:21 2022] POST /identity/v3/users => generated 287 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:23:21.574117 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf931a56-594c-4962-adc3-ea7d56205e90 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:21.587271 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf931a56-594c-4962-adc3-ea7d56205e90 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:21.645141 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9dcd49-b34d-448f-bb14-1a41d88f6f3b admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:21.650954 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc885c9-cab0-4a9f-8bfe-180c62b94e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:21.651561 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc885c9-cab0-4a9f-8bfe-180c62b94e31 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:21.651841 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc885c9-cab0-4a9f-8bfe-180c62b94e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:21.652116 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc885c9-cab0-4a9f-8bfe-180c62b94e31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:21.652768 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc885c9-cab0-4a9f-8bfe-180c62b94e31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:21.654422 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc885c9-cab0-4a9f-8bfe-180c62b94e31 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:21.668779 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 791/1586] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:23:21 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:23:21.668779 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc885c9-cab0-4a9f-8bfe-180c62b94e31 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:21.676141 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d536ed-8ae8-4d97-a59a-32e83ff891eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:21.677305 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d536ed-8ae8-4d97-a59a-32e83ff891eb admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:21.677762 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d536ed-8ae8-4d97-a59a-32e83ff891eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:21.678064 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d536ed-8ae8-4d97-a59a-32e83ff891eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:21.678759 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d536ed-8ae8-4d97-a59a-32e83ff891eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:21.678980 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc885c9-cab0-4a9f-8bfe-180c62b94e31 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:21.680797 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d536ed-8ae8-4d97-a59a-32e83ff891eb admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:21.683813 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4c442d-0ecd-4661-a94a-9835ba6a3001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:21.684419 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4c442d-0ecd-4661-a94a-9835ba6a3001 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:21.684704 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4c442d-0ecd-4661-a94a-9835ba6a3001 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:21.684976 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4c442d-0ecd-4661-a94a-9835ba6a3001 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:21.685610 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4c442d-0ecd-4661-a94a-9835ba6a3001 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:21.687484 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4c442d-0ecd-4661-a94a-9835ba6a3001 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:21.691869 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 796/1587] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:23:21 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:23:21.692710 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d536ed-8ae8-4d97-a59a-32e83ff891eb admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:21.700353 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 792/1588] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:23:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:23:21.702756 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4c442d-0ecd-4661-a94a-9835ba6a3001 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:21.705793 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d536ed-8ae8-4d97-a59a-32e83ff891eb admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:21.711672 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba40803b-3474-46cd-8fec-f471d8b79913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:21.712304 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba40803b-3474-46cd-8fec-f471d8b79913 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:21.712599 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba40803b-3474-46cd-8fec-f471d8b79913 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:21.712867 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba40803b-3474-46cd-8fec-f471d8b79913 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:21.713524 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba40803b-3474-46cd-8fec-f471d8b79913 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:21.715206 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba40803b-3474-46cd-8fec-f471d8b79913 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:21.718123 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4c442d-0ecd-4661-a94a-9835ba6a3001 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:21.723398 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b49156a-0fa5-4241-99a6-0dbac1b1ffb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:21.724001 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b49156a-0fa5-4241-99a6-0dbac1b1ffb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:21.724276 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b49156a-0fa5-4241-99a6-0dbac1b1ffb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:21.724671 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b49156a-0fa5-4241-99a6-0dbac1b1ffb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:21.725332 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b49156a-0fa5-4241-99a6-0dbac1b1ffb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:21.726473 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 797/1589] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:23:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:23:21.727399 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba40803b-3474-46cd-8fec-f471d8b79913 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:21.730746 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b49156a-0fa5-4241-99a6-0dbac1b1ffb8 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:21.738575 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba40803b-3474-46cd-8fec-f471d8b79913 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:21.743401 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b18310-b7c2-40dd-af7e-4dcc8ff30b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:21.743571 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 793/1590] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:23:21 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:23:21.743812 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b18310-b7c2-40dd-af7e-4dcc8ff30b32 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:21.744085 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b18310-b7c2-40dd-af7e-4dcc8ff30b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:21.744353 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b18310-b7c2-40dd-af7e-4dcc8ff30b32 admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:21.744964 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b18310-b7c2-40dd-af7e-4dcc8ff30b32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:21.746935 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b18310-b7c2-40dd-af7e-4dcc8ff30b32 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:21.747084 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b49156a-0fa5-4241-99a6-0dbac1b1ffb8 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:21.757690 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b49156a-0fa5-4241-99a6-0dbac1b1ffb8 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:21.764021 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14464be0-597a-43dd-8553-0488cef38401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:21.764841 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14464be0-597a-43dd-8553-0488cef38401 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:21.765126 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14464be0-597a-43dd-8553-0488cef38401 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:21.765403 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14464be0-597a-43dd-8553-0488cef38401 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:21.766056 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14464be0-597a-43dd-8553-0488cef38401 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:21.767637 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14464be0-597a-43dd-8553-0488cef38401 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:21.773486 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 798/1591] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:23:21 2022] POST /identity/v3/users => generated 289 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:23:21.773486 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b18310-b7c2-40dd-af7e-4dcc8ff30b32 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:21.779602 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 794/1592] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:23:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:23:21.780732 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14464be0-597a-43dd-8553-0488cef38401 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:21.787074 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b18310-b7c2-40dd-af7e-4dcc8ff30b32 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:21.791772 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14464be0-597a-43dd-8553-0488cef38401 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:21.793793 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3baedc-a9ce-4564-bd65-47fb6eaea1c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:21.794605 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3baedc-a9ce-4564-bd65-47fb6eaea1c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:21.795028 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3baedc-a9ce-4564-bd65-47fb6eaea1c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:21.796198 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3baedc-a9ce-4564-bd65-47fb6eaea1c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:21.797291 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3baedc-a9ce-4564-bd65-47fb6eaea1c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:21.798959 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3baedc-a9ce-4564-bd65-47fb6eaea1c8 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:21.800468 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5863f4-9ef7-465c-9b83-261fc65121d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:21.801830 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5863f4-9ef7-465c-9b83-261fc65121d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:21.802311 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5863f4-9ef7-465c-9b83-261fc65121d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:21.802738 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5863f4-9ef7-465c-9b83-261fc65121d0 admin admin] PATH_INFO: `/v3/projects/1bc4315b4ad74fd4923c9ada35d658e9/users/cabb49e9859c482ab1ee55c04f121ab3/roles/a9895331e9694fa8b2b50908bb057bcb` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:21.811976 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 799/1593] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:23:21 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:23:21.816379 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3baedc-a9ce-4564-bd65-47fb6eaea1c8 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:21.822457 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5863f4-9ef7-465c-9b83-261fc65121d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bc4315b4ad74fd4923c9ada35d658e9, user_id=cabb49e9859c482ab1ee55c04f121ab3, role_id=a9895331e9694fa8b2b50908bb057bcb)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:21.825892 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5863f4-9ef7-465c-9b83-261fc65121d0 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:21.830201 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3baedc-a9ce-4564-bd65-47fb6eaea1c8 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:21.837998 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f04871-f9a2-4fc7-9c76-0ce9874235ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:21.839102 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f04871-f9a2-4fc7-9c76-0ce9874235ff admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:21.839540 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f04871-f9a2-4fc7-9c76-0ce9874235ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:21.839956 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f04871-f9a2-4fc7-9c76-0ce9874235ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:21.840847 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f04871-f9a2-4fc7-9c76-0ce9874235ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:21.843229 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 795/1594] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:23:21 2022] PUT /identity/v3/projects/1bc4315b4ad74fd4923c9ada35d658e9/users/cabb49e9859c482ab1ee55c04f121ab3/roles/a9895331e9694fa8b2b50908bb057bcb => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:23:21.844152 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5863f4-9ef7-465c-9b83-261fc65121d0 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:21.855353 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f04871-f9a2-4fc7-9c76-0ce9874235ff admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:21.869475 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 800/1595] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:23:21 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:23:21.874517 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f04871-f9a2-4fc7-9c76-0ce9874235ff admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:21.886952 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f04871-f9a2-4fc7-9c76-0ce9874235ff admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:21.908055 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:23:21.922852 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5863f4-9ef7-465c-9b83-261fc65121d0 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:21.929738 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda8ee17-47a2-4d7e-8800-1df4e7fb8ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:21.930461 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda8ee17-47a2-4d7e-8800-1df4e7fb8ba2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:21.930741 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda8ee17-47a2-4d7e-8800-1df4e7fb8ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:21.931036 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda8ee17-47a2-4d7e-8800-1df4e7fb8ba2 admin admin] PATH_INFO: `/v3/projects/411579565c794b9b8dce1f8727103738/users/601a3160d88f4100b1552f547e372307/roles/a9895331e9694fa8b2b50908bb057bcb` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:21.949373 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda8ee17-47a2-4d7e-8800-1df4e7fb8ba2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=411579565c794b9b8dce1f8727103738, user_id=601a3160d88f4100b1552f547e372307, role_id=a9895331e9694fa8b2b50908bb057bcb)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:21.952751 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda8ee17-47a2-4d7e-8800-1df4e7fb8ba2 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:21.965770 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475e0cf4-1a79-41b3-817d-0348890e0fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:21.966687 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e0cf4-1a79-41b3-817d-0348890e0fa5 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:21.967012 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e0cf4-1a79-41b3-817d-0348890e0fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:21.968382 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e0cf4-1a79-41b3-817d-0348890e0fa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:21.969427 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475e0cf4-1a79-41b3-817d-0348890e0fa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:21.969894 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 796/1596] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:23:21 2022] PUT /identity/v3/projects/411579565c794b9b8dce1f8727103738/users/601a3160d88f4100b1552f547e372307/roles/a9895331e9694fa8b2b50908bb057bcb => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:23:21.970891 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475e0cf4-1a79-41b3-817d-0348890e0fa5 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:21.974788 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda8ee17-47a2-4d7e-8800-1df4e7fb8ba2 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:21.983110 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 801/1597] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:23:21 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:23:21.984008 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475e0cf4-1a79-41b3-817d-0348890e0fa5 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:21.994106 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475e0cf4-1a79-41b3-817d-0348890e0fa5 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:22.022624 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:23:22.047968 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda8ee17-47a2-4d7e-8800-1df4e7fb8ba2 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:22.054987 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cff027-fec7-468f-87c0-fd09990c5885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:22.055698 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cff027-fec7-468f-87c0-fd09990c5885 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:22.056168 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cff027-fec7-468f-87c0-fd09990c5885 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:22.056529 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cff027-fec7-468f-87c0-fd09990c5885 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:22.057422 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cff027-fec7-468f-87c0-fd09990c5885 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:22.059353 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cff027-fec7-468f-87c0-fd09990c5885 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:22.063263 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21a19d6-6401-413d-9967-75481d2d0c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:22.064051 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a19d6-6401-413d-9967-75481d2d0c7f admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:22.064638 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a19d6-6401-413d-9967-75481d2d0c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:22.064638 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a19d6-6401-413d-9967-75481d2d0c7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:22.065436 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21a19d6-6401-413d-9967-75481d2d0c7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:22.067236 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21a19d6-6401-413d-9967-75481d2d0c7f admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:22.074935 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 797/1598] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:23:21 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:23:22.074935 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cff027-fec7-468f-87c0-fd09990c5885 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:22.084000 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 802/1599] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:23:21 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:23:22.084000 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd3faf9-932c-4c4f-9fdc-240163da491d None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:22.084000 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd3faf9-932c-4c4f-9fdc-240163da491d None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:22.084000 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd3faf9-932c-4c4f-9fdc-240163da491d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:22.088417 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cff027-fec7-468f-87c0-fd09990c5885 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:22.093828 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34598088-2a7d-473e-ae26-f5a2afadf74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:22.094633 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34598088-2a7d-473e-ae26-f5a2afadf74a admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:22.094982 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34598088-2a7d-473e-ae26-f5a2afadf74a admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:22.095327 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34598088-2a7d-473e-ae26-f5a2afadf74a admin admin] PATH_INFO: `/v3/projects/0888330230c849fb847e74299fd09dbe/users/83f35273053c4f728a6137a42c63a066/roles/a9895331e9694fa8b2b50908bb057bcb` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:22.117708 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-2fd3faf9-932c-4c4f-9fdc-240163da491d None None] MFA Rules not processed for user `cabb49e9859c482ab1ee55c04f121ab3`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:23:22.119060 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-2fd3faf9-932c-4c4f-9fdc-240163da491d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:22.119496 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34598088-2a7d-473e-ae26-f5a2afadf74a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0888330230c849fb847e74299fd09dbe, user_id=83f35273053c4f728a6137a42c63a066, role_id=a9895331e9694fa8b2b50908bb057bcb)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:22.123033 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34598088-2a7d-473e-ae26-f5a2afadf74a admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:22.139843 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 798/1600] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:23:22 2022] PUT /identity/v3/projects/0888330230c849fb847e74299fd09dbe/users/83f35273053c4f728a6137a42c63a066/roles/a9895331e9694fa8b2b50908bb057bcb => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:23:22.140422 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34598088-2a7d-473e-ae26-f5a2afadf74a admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:22.205184 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 803/1601] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:23:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:23:22.206783 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b9809-b0a6-41dc-8a43-692204a62d65 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:22.207062 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b9809-b0a6-41dc-8a43-692204a62d65 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:22.207335 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b9809-b0a6-41dc-8a43-692204a62d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:22.242039 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34598088-2a7d-473e-ae26-f5a2afadf74a admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:22.253061 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01ea29e-115d-4a62-b0cd-2f69220b4f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:22.253337 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-fd5b9809-b0a6-41dc-8a43-692204a62d65 None None] MFA Rules not processed for user `601a3160d88f4100b1552f547e372307`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:23:22.254943 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-fd5b9809-b0a6-41dc-8a43-692204a62d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:22.257604 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ea29e-115d-4a62-b0cd-2f69220b4f53 admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:22.258167 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ea29e-115d-4a62-b0cd-2f69220b4f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:22.259940 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ea29e-115d-4a62-b0cd-2f69220b4f53 admin admin] PATH_INFO: `/v3/projects/c3c303dd98424308a19f65b08ee35c91/users/74925532a3b64d21b4e861ec70bc4345/roles/a9895331e9694fa8b2b50908bb057bcb` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:22.292121 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01ea29e-115d-4a62-b0cd-2f69220b4f53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3c303dd98424308a19f65b08ee35c91, user_id=74925532a3b64d21b4e861ec70bc4345, role_id=a9895331e9694fa8b2b50908bb057bcb)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:22.294933 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01ea29e-115d-4a62-b0cd-2f69220b4f53 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:22.311697 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 799/1602] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:23:22 2022] PUT /identity/v3/projects/c3c303dd98424308a19f65b08ee35c91/users/74925532a3b64d21b4e861ec70bc4345/roles/a9895331e9694fa8b2b50908bb057bcb => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:23:22.312699 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01ea29e-115d-4a62-b0cd-2f69220b4f53 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:22.342702 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 804/1603] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:23:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:23:22.343745 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5b9809-b0a6-41dc-8a43-692204a62d65 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:22.364875 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:23:22.379459 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5b9809-b0a6-41dc-8a43-692204a62d65 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:22.407037 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01ea29e-115d-4a62-b0cd-2f69220b4f53 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:22.415241 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2a75e5-f0c0-4eac-8c49-d4f958e47e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:22.415949 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a75e5-f0c0-4eac-8c49-d4f958e47e4a admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:22.416229 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a75e5-f0c0-4eac-8c49-d4f958e47e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:22.416500 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a75e5-f0c0-4eac-8c49-d4f958e47e4a admin admin] PATH_INFO: `/v3/projects/20b19bd1345f4d169902c867aca01f47/users/efd69dedc75842f495bde0c20799a340/roles/a9895331e9694fa8b2b50908bb057bcb` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:22.437579 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2a75e5-f0c0-4eac-8c49-d4f958e47e4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=20b19bd1345f4d169902c867aca01f47, user_id=efd69dedc75842f495bde0c20799a340, role_id=a9895331e9694fa8b2b50908bb057bcb)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:22.441882 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2a75e5-f0c0-4eac-8c49-d4f958e47e4a admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:22.446554 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:23:22.464853 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 800/1604] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:23:22 2022] PUT /identity/v3/projects/20b19bd1345f4d169902c867aca01f47/users/efd69dedc75842f495bde0c20799a340/roles/a9895331e9694fa8b2b50908bb057bcb => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:23:22.464853 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2a75e5-f0c0-4eac-8c49-d4f958e47e4a admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:22.474022 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a834b43-2c18-48ae-a504-c1c372a01fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:22.474831 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a834b43-2c18-48ae-a504-c1c372a01fe9 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:22.475249 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a834b43-2c18-48ae-a504-c1c372a01fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:22.475620 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a834b43-2c18-48ae-a504-c1c372a01fe9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:22.476420 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a834b43-2c18-48ae-a504-c1c372a01fe9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:22.478350 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a834b43-2c18-48ae-a504-c1c372a01fe9 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:22.492147 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 805/1605] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:23:22 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:23:22.494299 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb1ddfb-937a-4655-bb9b-e23d1953a8c8 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:22.494994 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb1ddfb-937a-4655-bb9b-e23d1953a8c8 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:22.495624 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb1ddfb-937a-4655-bb9b-e23d1953a8c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:22.523376 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-bbb1ddfb-937a-4655-bb9b-e23d1953a8c8 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:23:22.525299 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-bbb1ddfb-937a-4655-bb9b-e23d1953a8c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:22.543504 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2a75e5-f0c0-4eac-8c49-d4f958e47e4a admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:22.548755 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbab32e-8f16-439d-9396-c3a114a07577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:22.549418 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbab32e-8f16-439d-9396-c3a114a07577 admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:22.549719 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbab32e-8f16-439d-9396-c3a114a07577 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:22.550397 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbab32e-8f16-439d-9396-c3a114a07577 admin admin] PATH_INFO: `/v3/projects/d07286da652c4a2d824e194d1726d635/users/b9ebcd69ca0944c68a7d8774160991b9/roles/a9895331e9694fa8b2b50908bb057bcb` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:22.569223 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbab32e-8f16-439d-9396-c3a114a07577 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d07286da652c4a2d824e194d1726d635, user_id=b9ebcd69ca0944c68a7d8774160991b9, role_id=a9895331e9694fa8b2b50908bb057bcb)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:22.573096 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbab32e-8f16-439d-9396-c3a114a07577 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:22.593973 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 801/1606] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:23:22 2022] PUT /identity/v3/projects/d07286da652c4a2d824e194d1726d635/users/b9ebcd69ca0944c68a7d8774160991b9/roles/a9895331e9694fa8b2b50908bb057bcb => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:23:22.595289 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe9203c-ad72-44ac-b0e0-09f57197f753 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:22.595563 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe9203c-ad72-44ac-b0e0-09f57197f753 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:22.595836 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe9203c-ad72-44ac-b0e0-09f57197f753 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:22.603498 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 802/1607] 10.222.0.36 () {54 vars in 962 bytes} [Tue Aug 9 10:23:22 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:23:22.604775 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1908c269-f71e-46f3-bb85-d11b68d676b3 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:22.605058 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1908c269-f71e-46f3-bb85-d11b68d676b3 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:22.605334 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1908c269-f71e-46f3-bb85-d11b68d676b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:22.622568 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 806/1608] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:23:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:23:22.625562 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade1a951-6bea-4eb7-a232-9422605df7f7 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:22.626371 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade1a951-6bea-4eb7-a232-9422605df7f7 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:22.626840 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade1a951-6bea-4eb7-a232-9422605df7f7 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:22.626953 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-1908c269-f71e-46f3-bb85-d11b68d676b3 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:23:22.628209 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-1908c269-f71e-46f3-bb85-d11b68d676b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:22.634414 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 807/1609] 10.222.0.36 () {54 vars in 962 bytes} [Tue Aug 9 10:23:22 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:23:22.636510 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd2ed62-332e-4f24-bce3-1ca40654cd49 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:22.637026 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd2ed62-332e-4f24-bce3-1ca40654cd49 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:22.637780 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd2ed62-332e-4f24-bce3-1ca40654cd49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:22.662361 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-6fd2ed62-332e-4f24-bce3-1ca40654cd49 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:23:22.664329 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-6fd2ed62-332e-4f24-bce3-1ca40654cd49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:22.705726 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 803/1610] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:23:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:23:22.711295 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1908c269-f71e-46f3-bb85-d11b68d676b3 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:22.723110 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1908c269-f71e-46f3-bb85-d11b68d676b3 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:22.729344 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92240a33-a63c-4615-8d15-4bc5da2ee47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:22.730313 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92240a33-a63c-4615-8d15-4bc5da2ee47c admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:22.731272 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92240a33-a63c-4615-8d15-4bc5da2ee47c admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:22.731622 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92240a33-a63c-4615-8d15-4bc5da2ee47c admin admin] PATH_INFO: `/v3/projects/a9a8731d3b324b3c9d054a82652a2f3b/users/e475e2e663794a3c83cfc9e82947a70f/roles/a9895331e9694fa8b2b50908bb057bcb` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:22.753195 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92240a33-a63c-4615-8d15-4bc5da2ee47c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9a8731d3b324b3c9d054a82652a2f3b, user_id=e475e2e663794a3c83cfc9e82947a70f, role_id=a9895331e9694fa8b2b50908bb057bcb)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:22.757338 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92240a33-a63c-4615-8d15-4bc5da2ee47c admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:22.777258 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 808/1611] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:23:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:23:22.778859 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ef13a-1b5e-47fa-973e-b5218260fbad None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:22.779206 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ef13a-1b5e-47fa-973e-b5218260fbad None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:22.779666 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ef13a-1b5e-47fa-973e-b5218260fbad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:22.785422 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 804/1612] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:23:22 2022] PUT /identity/v3/projects/a9a8731d3b324b3c9d054a82652a2f3b/users/e475e2e663794a3c83cfc9e82947a70f/roles/a9895331e9694fa8b2b50908bb057bcb => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:23:22.785422 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb7fd2d-1916-4267-8800-35bbafd40234 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:22.785422 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb7fd2d-1916-4267-8800-35bbafd40234 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:22.785422 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb7fd2d-1916-4267-8800-35bbafd40234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:22.834185 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:23:22.838480 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-5fb7fd2d-1916-4267-8800-35bbafd40234 None None] MFA Rules not processed for user `b9ebcd69ca0944c68a7d8774160991b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:23:22.842409 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-5fb7fd2d-1916-4267-8800-35bbafd40234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:22.857128 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-f67ef13a-1b5e-47fa-973e-b5218260fbad None None] MFA Rules not processed for user `eb863beaaa9f495c8b64655996c061f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:23:22.859158 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-f67ef13a-1b5e-47fa-973e-b5218260fbad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:22.928388 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 805/1613] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:23:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:23:22.929387 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb7fd2d-1916-4267-8800-35bbafd40234 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:22.931322 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-5fb7fd2d-1916-4267-8800-35bbafd40234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:22.937684 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:23:22.955576 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 809/1614] 10.222.0.36 () {58 vars in 1059 bytes} [Tue Aug 9 10:23:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:23:22.957014 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b7f91f-550b-49c0-92f8-3838564f2347 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:22.957302 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b7f91f-550b-49c0-92f8-3838564f2347 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:22.957580 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b7f91f-550b-49c0-92f8-3838564f2347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:22.987927 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-b6b7f91f-550b-49c0-92f8-3838564f2347 None None] MFA Rules not processed for user `eb863beaaa9f495c8b64655996c061f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:23:22.989219 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-b6b7f91f-550b-49c0-92f8-3838564f2347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:23.011528 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 810/1615] 10.222.0.36 () {58 vars in 1059 bytes} [Tue Aug 9 10:23:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:23:23.019833 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b7f91f-550b-49c0-92f8-3838564f2347 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:23.023460 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-b6b7f91f-550b-49c0-92f8-3838564f2347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:23.036740 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb7fd2d-1916-4267-8800-35bbafd40234 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:23.041181 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819d0e86-cf6b-4071-a78b-e751902b11e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:23.042120 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819d0e86-cf6b-4071-a78b-e751902b11e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:23.042567 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819d0e86-cf6b-4071-a78b-e751902b11e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:23.042772 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819d0e86-cf6b-4071-a78b-e751902b11e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:23.089779 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b7f91f-550b-49c0-92f8-3838564f2347 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:23.100332 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbc2c63-5b41-4d11-b4f4-5dfdea60c9cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:23.100332 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc2c63-5b41-4d11-b4f4-5dfdea60c9cd service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:23.100332 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc2c63-5b41-4d11-b4f4-5dfdea60c9cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:23.100332 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc2c63-5b41-4d11-b4f4-5dfdea60c9cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:23.127812 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819d0e86-cf6b-4071-a78b-e751902b11e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:23.130160 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819d0e86-cf6b-4071-a78b-e751902b11e9 service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:23.145612 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 806/1616] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:23:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:23:23.147448 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b303f7f-25d6-4669-afe8-4f45d454e0d0 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:23.147740 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b303f7f-25d6-4669-afe8-4f45d454e0d0 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:23.148058 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b303f7f-25d6-4669-afe8-4f45d454e0d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:23.199802 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-9b303f7f-25d6-4669-afe8-4f45d454e0d0 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:23:23.201029 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-9b303f7f-25d6-4669-afe8-4f45d454e0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:23.206849 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbc2c63-5b41-4d11-b4f4-5dfdea60c9cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:23.208673 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbc2c63-5b41-4d11-b4f4-5dfdea60c9cd service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:23.212918 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 807/1617] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:23:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:23:23.213926 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b303f7f-25d6-4669-afe8-4f45d454e0d0 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:23.225638 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b303f7f-25d6-4669-afe8-4f45d454e0d0 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:23.225894 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 811/1618] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:23:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:23:23.227493 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbc2c63-5b41-4d11-b4f4-5dfdea60c9cd service neutron] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:23.231170 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaca793-b80c-4714-bae8-c46a35f8eb34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:23.231948 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaca793-b80c-4714-bae8-c46a35f8eb34 service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:23.232319 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaca793-b80c-4714-bae8-c46a35f8eb34 service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:23.232765 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaca793-b80c-4714-bae8-c46a35f8eb34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:23.245762 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaca793-b80c-4714-bae8-c46a35f8eb34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:23.248504 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaca793-b80c-4714-bae8-c46a35f8eb34 service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:23.348066 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 808/1619] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:23:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:23:23.348066 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaca793-b80c-4714-bae8-c46a35f8eb34 service neutron] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:23.351366 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbc2c63-5b41-4d11-b4f4-5dfdea60c9cd service neutron] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:23.351366 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfefaf6b-af95-42e5-888c-4004b4206a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:23.351366 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfefaf6b-af95-42e5-888c-4004b4206a01 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:23.351366 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfefaf6b-af95-42e5-888c-4004b4206a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:23.353326 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfefaf6b-af95-42e5-888c-4004b4206a01 admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:23.353326 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfefaf6b-af95-42e5-888c-4004b4206a01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:23.353326 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfefaf6b-af95-42e5-888c-4004b4206a01 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:23.354958 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaca793-b80c-4714-bae8-c46a35f8eb34 service neutron] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:23.354958 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517df157-7c7b-4c48-89b3-739d86e55981 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb863beaaa9f495c8b64655996c061f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:23.354958 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517df157-7c7b-4c48-89b3-739d86e55981 service nova] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:23.354958 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517df157-7c7b-4c48-89b3-739d86e55981 service nova] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:23.355910 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517df157-7c7b-4c48-89b3-739d86e55981 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:23.383240 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 812/1620] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:23:23 2022] POST /identity/v3/projects => generated 371 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:23:23.387126 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfefaf6b-af95-42e5-888c-4004b4206a01 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:23.432466 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:23:23.476803 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517df157-7c7b-4c48-89b3-739d86e55981 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:23.479052 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517df157-7c7b-4c48-89b3-739d86e55981 service nova] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:23.485394 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfefaf6b-af95-42e5-888c-4004b4206a01 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:23.505636 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c883dc1d-44ae-4459-a9d8-29f4ec1857e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb863beaaa9f495c8b64655996c061f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:23.506417 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c883dc1d-44ae-4459-a9d8-29f4ec1857e3 service nova] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:23.506701 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c883dc1d-44ae-4459-a9d8-29f4ec1857e3 service nova] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:23.506962 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c883dc1d-44ae-4459-a9d8-29f4ec1857e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:23.522130 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 809/1621] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:23:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:23:23.524471 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:23:23.526778 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517df157-7c7b-4c48-89b3-739d86e55981 service nova] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:23.554564 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517df157-7c7b-4c48-89b3-739d86e55981 service nova] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:23.607309 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c883dc1d-44ae-4459-a9d8-29f4ec1857e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:23.611772 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c883dc1d-44ae-4459-a9d8-29f4ec1857e3 service nova] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:23.625721 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 813/1622] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:23:23 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:23:23.627482 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c883dc1d-44ae-4459-a9d8-29f4ec1857e3 service nova] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:23.688447 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702d4bbf-d63b-4dbe-8eba-1bdc42f7efeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:23.689151 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702d4bbf-d63b-4dbe-8eba-1bdc42f7efeb service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:23.693707 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702d4bbf-d63b-4dbe-8eba-1bdc42f7efeb service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:23.694239 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702d4bbf-d63b-4dbe-8eba-1bdc42f7efeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:23.715032 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c883dc1d-44ae-4459-a9d8-29f4ec1857e3 service nova] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:23.720729 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba650298-45af-4dd3-8e3f-5fef73d3d03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:23.722794 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba650298-45af-4dd3-8e3f-5fef73d3d03a admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:23.723455 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba650298-45af-4dd3-8e3f-5fef73d3d03a admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:23.723905 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba650298-45af-4dd3-8e3f-5fef73d3d03a admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:23.725138 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba650298-45af-4dd3-8e3f-5fef73d3d03a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:23.728218 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba650298-45af-4dd3-8e3f-5fef73d3d03a admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:23.762378 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 814/1623] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:23:23 2022] POST /identity/v3/users => generated 292 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:23:23.763815 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba650298-45af-4dd3-8e3f-5fef73d3d03a admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:23.786883 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba650298-45af-4dd3-8e3f-5fef73d3d03a admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:23.798477 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e89543-2dcc-4e6b-8caa-1918bfab774b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:23.799188 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e89543-2dcc-4e6b-8caa-1918bfab774b admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:23.800056 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e89543-2dcc-4e6b-8caa-1918bfab774b admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:23.802072 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e89543-2dcc-4e6b-8caa-1918bfab774b admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:23.802842 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e89543-2dcc-4e6b-8caa-1918bfab774b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:23.807848 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e89543-2dcc-4e6b-8caa-1918bfab774b admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:23.831997 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 815/1624] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:23:23 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:23:23.836100 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e89543-2dcc-4e6b-8caa-1918bfab774b admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:23.851007 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702d4bbf-d63b-4dbe-8eba-1bdc42f7efeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:23.852744 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702d4bbf-d63b-4dbe-8eba-1bdc42f7efeb service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:23.859987 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e89543-2dcc-4e6b-8caa-1918bfab774b admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:23.872630 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6032c93c-1ada-4a65-9006-7c9717cdd559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:23.873583 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6032c93c-1ada-4a65-9006-7c9717cdd559 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:23.873891 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6032c93c-1ada-4a65-9006-7c9717cdd559 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:23.874200 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6032c93c-1ada-4a65-9006-7c9717cdd559 admin admin] PATH_INFO: `/v3/projects/7e896272c4e24f0587acfe86b253a443/users/7ab85c06ce674552900be7d00d32077a/roles/89ca30cbbb634be8a96e9921aa56626b` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:23.876617 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 810/1625] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:23:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:23:23.906499 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6032c93c-1ada-4a65-9006-7c9717cdd559 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e896272c4e24f0587acfe86b253a443, user_id=7ab85c06ce674552900be7d00d32077a, role_id=89ca30cbbb634be8a96e9921aa56626b)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:23.914391 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6032c93c-1ada-4a65-9006-7c9717cdd559 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:23.944873 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 816/1626] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:23:23 2022] PUT /identity/v3/projects/7e896272c4e24f0587acfe86b253a443/users/7ab85c06ce674552900be7d00d32077a/roles/89ca30cbbb634be8a96e9921aa56626b => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 10:23:23.946760 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702d4bbf-d63b-4dbe-8eba-1bdc42f7efeb service neutron] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:23.960857 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702d4bbf-d63b-4dbe-8eba-1bdc42f7efeb service neutron] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:24.053704 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af85c622-1494-444c-b0db-e853fa69f7c4 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:24.054691 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af85c622-1494-444c-b0db-e853fa69f7c4 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:24.055258 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af85c622-1494-444c-b0db-e853fa69f7c4 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:24.057275 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 817/1627] 10.222.0.36 () {54 vars in 912 bytes} [Tue Aug 9 10:23:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 10:23:24.065379 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddd4615-512a-45cc-835c-e4047ff13caf None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:24.073067 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddd4615-512a-45cc-835c-e4047ff13caf None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:24.073436 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddd4615-512a-45cc-835c-e4047ff13caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:24.104819 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-6ddd4615-512a-45cc-835c-e4047ff13caf None None] MFA Rules not processed for user `eb863beaaa9f495c8b64655996c061f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:23:24.106154 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-6ddd4615-512a-45cc-835c-e4047ff13caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:24.146214 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de574ed-0e06-4f64-a458-fde1b4de2d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:24.147557 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de574ed-0e06-4f64-a458-fde1b4de2d83 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:24.148004 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de574ed-0e06-4f64-a458-fde1b4de2d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:24.148433 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de574ed-0e06-4f64-a458-fde1b4de2d83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:24.150175 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de574ed-0e06-4f64-a458-fde1b4de2d83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:24.152057 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de574ed-0e06-4f64-a458-fde1b4de2d83 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:24.185575 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 811/1628] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:23:23 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:23:24.190541 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de574ed-0e06-4f64-a458-fde1b4de2d83 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:24.205508 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de574ed-0e06-4f64-a458-fde1b4de2d83 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:24.219153 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3219cf96-9f18-4236-bf1d-71e53de310f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:24.220792 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3219cf96-9f18-4236-bf1d-71e53de310f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:24.221721 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3219cf96-9f18-4236-bf1d-71e53de310f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:24.222201 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3219cf96-9f18-4236-bf1d-71e53de310f9 admin admin] PATH_INFO: `/v3/projects/7e896272c4e24f0587acfe86b253a443/users/7ab85c06ce674552900be7d00d32077a/roles/89ca30cbbb634be8a96e9921aa56626b` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:24.228122 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3219cf96-9f18-4236-bf1d-71e53de310f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e896272c4e24f0587acfe86b253a443, user_id=7ab85c06ce674552900be7d00d32077a, role_id=89ca30cbbb634be8a96e9921aa56626b)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:24.228925 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 818/1629] 10.222.0.36 () {58 vars in 1009 bytes} [Tue Aug 9 10:23:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:23:24.230291 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb96c53-57b1-4cfb-a291-8f99a17482bb None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:24.234093 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb96c53-57b1-4cfb-a291-8f99a17482bb None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:24.235171 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb96c53-57b1-4cfb-a291-8f99a17482bb None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:24.239157 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3219cf96-9f18-4236-bf1d-71e53de310f9 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:24.240045 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 819/1630] 10.222.0.36 () {54 vars in 912 bytes} [Tue Aug 9 10:23:24 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:23:24.247335 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f02f17-a3aa-47fb-8dba-9414e84036f5 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:24.247620 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f02f17-a3aa-47fb-8dba-9414e84036f5 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:24.247955 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f02f17-a3aa-47fb-8dba-9414e84036f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:24.268664 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:23:24.291808 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 812/1631] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:23:24 2022] PUT /identity/v3/projects/7e896272c4e24f0587acfe86b253a443/users/7ab85c06ce674552900be7d00d32077a/roles/89ca30cbbb634be8a96e9921aa56626b => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 10:23:24.293007 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3219cf96-9f18-4236-bf1d-71e53de310f9 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:24.320277 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:23:24.334008 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-53f02f17-a3aa-47fb-8dba-9414e84036f5 None None] MFA Rules not processed for user `eb863beaaa9f495c8b64655996c061f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:23:24.335228 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-53f02f17-a3aa-47fb-8dba-9414e84036f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:24.473502 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3219cf96-9f18-4236-bf1d-71e53de310f9 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:24.477648 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 820/1632] 10.222.0.36 () {58 vars in 1009 bytes} [Tue Aug 9 10:23:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:23:24.479025 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1023fc-43b7-4b9d-b6df-bdc8265ccc88 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:24.479399 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1023fc-43b7-4b9d-b6df-bdc8265ccc88 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:24.479675 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1023fc-43b7-4b9d-b6df-bdc8265ccc88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:24.486717 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9581fcee-a9f9-467e-9e25-908a25cba445 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6c687a38524de0bf23d87ae91d3b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:24.496575 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9581fcee-a9f9-467e-9e25-908a25cba445 service cinder] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:24.497133 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9581fcee-a9f9-467e-9e25-908a25cba445 service cinder] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:24.498727 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9581fcee-a9f9-467e-9e25-908a25cba445 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:24.523396 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-cf1023fc-43b7-4b9d-b6df-bdc8265ccc88 None None] MFA Rules not processed for user `7ab85c06ce674552900be7d00d32077a`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:23:24.525444 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-cf1023fc-43b7-4b9d-b6df-bdc8265ccc88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:24.537220 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9581fcee-a9f9-467e-9e25-908a25cba445 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:24.542854 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9581fcee-a9f9-467e-9e25-908a25cba445 service cinder] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:24.574787 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 813/1633] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:23:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:23:24.575813 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9581fcee-a9f9-467e-9e25-908a25cba445 service cinder] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:24.588317 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9581fcee-a9f9-467e-9e25-908a25cba445 service cinder] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:24.594298 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546d9623-0af0-4068-a12e-6bdc9bff1ebc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6c687a38524de0bf23d87ae91d3b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:24.597604 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d9623-0af0-4068-a12e-6bdc9bff1ebc service cinder] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:24.599109 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d9623-0af0-4068-a12e-6bdc9bff1ebc service cinder] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:24.599591 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d9623-0af0-4068-a12e-6bdc9bff1ebc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:24.632036 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546d9623-0af0-4068-a12e-6bdc9bff1ebc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:24.637138 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546d9623-0af0-4068-a12e-6bdc9bff1ebc service cinder] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:24.668917 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 814/1634] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:23:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:23:24.678272 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 821/1635] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:23:24 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:23:24.743934 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546d9623-0af0-4068-a12e-6bdc9bff1ebc service cinder] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:24.752638 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546d9623-0af0-4068-a12e-6bdc9bff1ebc service cinder] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:24.762731 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4801c87e-0ec1-4ae3-9579-aabbf00790c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6c687a38524de0bf23d87ae91d3b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:24.763434 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4801c87e-0ec1-4ae3-9579-aabbf00790c4 service cinder] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:24.764104 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4801c87e-0ec1-4ae3-9579-aabbf00790c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:24.764407 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4801c87e-0ec1-4ae3-9579-aabbf00790c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:24.794417 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4801c87e-0ec1-4ae3-9579-aabbf00790c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:24.800487 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4801c87e-0ec1-4ae3-9579-aabbf00790c4 service cinder] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:24.837548 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 815/1636] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:23:24 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:23:25.109889 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1023fc-43b7-4b9d-b6df-bdc8265ccc88 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:25.311806 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1023fc-43b7-4b9d-b6df-bdc8265ccc88 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:25.324978 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad73fc8-5c1f-42b8-9662-0da1dd95f998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:25.325514 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad73fc8-5c1f-42b8-9662-0da1dd95f998 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:25.325815 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad73fc8-5c1f-42b8-9662-0da1dd95f998 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:25.326127 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad73fc8-5c1f-42b8-9662-0da1dd95f998 admin admin] PATH_INFO: `/v3/users/cabb49e9859c482ab1ee55c04f121ab3` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:25.328013 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad73fc8-5c1f-42b8-9662-0da1dd95f998 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cabb49e9859c482ab1ee55c04f121ab3)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:25.329067 dv-cinder-852364-2-smb devstack@keystone.service[80106]: WARNING py.warnings [None req-fad73fc8-5c1f-42b8-9662-0da1dd95f998 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 09 10:23:25.329067 dv-cinder-852364-2-smb devstack@keystone.service[80106]: warnings.warn(msg) Aug 09 10:23:25.329067 dv-cinder-852364-2-smb devstack@keystone.service[80106]: Aug 09 10:23:25.330319 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad73fc8-5c1f-42b8-9662-0da1dd95f998 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:25.376857 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:23:25.468290 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-fad73fc8-5c1f-42b8-9662-0da1dd95f998 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cabb49e9859c482ab1ee55c04f121ab3'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:23:25.525377 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-fad73fc8-5c1f-42b8-9662-0da1dd95f998 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cabb49e9859c482ab1ee55c04f121ab3'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:23:25.547347 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-fad73fc8-5c1f-42b8-9662-0da1dd95f998 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cabb49e9859c482ab1ee55c04f121ab3'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:23:25.548561 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-fad73fc8-5c1f-42b8-9662-0da1dd95f998 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cabb49e9859c482ab1ee55c04f121ab3'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:23:25.564799 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-fad73fc8-5c1f-42b8-9662-0da1dd95f998 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cabb49e9859c482ab1ee55c04f121ab3'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:23:25.582380 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 822/1637] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:23:25 2022] DELETE /identity/v3/users/cabb49e9859c482ab1ee55c04f121ab3 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 10:23:25.583203 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2ec575-0e2f-4a65-a393-bb82e32e0e83 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:25.583713 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2ec575-0e2f-4a65-a393-bb82e32e0e83 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:25.583827 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2ec575-0e2f-4a65-a393-bb82e32e0e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:25.624845 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-0b2ec575-0e2f-4a65-a393-bb82e32e0e83 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:23:25.625145 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-0b2ec575-0e2f-4a65-a393-bb82e32e0e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:25.747791 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 816/1638] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:23:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 10:23:25.786692 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad73fc8-5c1f-42b8-9662-0da1dd95f998 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:25.789731 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-fad73fc8-5c1f-42b8-9662-0da1dd95f998 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:25.825198 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2ec575-0e2f-4a65-a393-bb82e32e0e83 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:25.827907 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-0b2ec575-0e2f-4a65-a393-bb82e32e0e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:25.832414 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad73fc8-5c1f-42b8-9662-0da1dd95f998 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:25.844940 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5776d8d0-9ba6-404e-9253-167c3a93175a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:25.847212 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5776d8d0-9ba6-404e-9253-167c3a93175a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:25.847621 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5776d8d0-9ba6-404e-9253-167c3a93175a admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:25.849773 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5776d8d0-9ba6-404e-9253-167c3a93175a admin admin] PATH_INFO: `/v3/users/b9ebcd69ca0944c68a7d8774160991b9` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:25.852628 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5776d8d0-9ba6-404e-9253-167c3a93175a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9ebcd69ca0944c68a7d8774160991b9)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:25.855770 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5776d8d0-9ba6-404e-9253-167c3a93175a admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:26.018659 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-5776d8d0-9ba6-404e-9253-167c3a93175a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9ebcd69ca0944c68a7d8774160991b9'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:23:26.042881 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2ec575-0e2f-4a65-a393-bb82e32e0e83 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:26.061123 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44501cd7-8867-4f06-bea8-16b4554b7fde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:26.061944 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44501cd7-8867-4f06-bea8-16b4554b7fde service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:26.062238 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44501cd7-8867-4f06-bea8-16b4554b7fde service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:26.062521 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44501cd7-8867-4f06-bea8-16b4554b7fde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:26.086553 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-5776d8d0-9ba6-404e-9253-167c3a93175a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9ebcd69ca0944c68a7d8774160991b9'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:23:26.086967 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44501cd7-8867-4f06-bea8-16b4554b7fde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:26.088344 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44501cd7-8867-4f06-bea8-16b4554b7fde service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:26.109927 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-5776d8d0-9ba6-404e-9253-167c3a93175a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9ebcd69ca0944c68a7d8774160991b9'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:23:26.110946 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-5776d8d0-9ba6-404e-9253-167c3a93175a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9ebcd69ca0944c68a7d8774160991b9'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:23:26.117235 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 817/1639] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:23:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:23:26.124978 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-5776d8d0-9ba6-404e-9253-167c3a93175a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9ebcd69ca0944c68a7d8774160991b9'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:23:26.136300 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 823/1640] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:23:25 2022] DELETE /identity/v3/users/b9ebcd69ca0944c68a7d8774160991b9 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:23:26.141466 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172fdabf-5856-4786-aa78-b4fe4bd6921a None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:26.141929 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172fdabf-5856-4786-aa78-b4fe4bd6921a None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:26.143023 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172fdabf-5856-4786-aa78-b4fe4bd6921a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:26.210756 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-172fdabf-5856-4786-aa78-b4fe4bd6921a None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:23:26.213059 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-172fdabf-5856-4786-aa78-b4fe4bd6921a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:26.256316 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:23:26.335494 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 818/1641] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:23:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:23:26.527933 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5776d8d0-9ba6-404e-9253-167c3a93175a admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:26.530199 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-5776d8d0-9ba6-404e-9253-167c3a93175a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:26.660195 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5776d8d0-9ba6-404e-9253-167c3a93175a admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:26.674108 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46869467-8196-411a-8150-05173196059a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:26.674831 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46869467-8196-411a-8150-05173196059a service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:26.675117 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46869467-8196-411a-8150-05173196059a service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:26.675386 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46869467-8196-411a-8150-05173196059a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:26.702754 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46869467-8196-411a-8150-05173196059a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:26.705512 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46869467-8196-411a-8150-05173196059a service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:26.731984 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 824/1642] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:23:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:23:27.558612 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172fdabf-5856-4786-aa78-b4fe4bd6921a None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:27.561721 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-172fdabf-5856-4786-aa78-b4fe4bd6921a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:27.584715 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172fdabf-5856-4786-aa78-b4fe4bd6921a None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:27.594365 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d4952c-8bf2-4581-972e-d0b84a64200b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:27.595207 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d4952c-8bf2-4581-972e-d0b84a64200b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:27.595931 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d4952c-8bf2-4581-972e-d0b84a64200b admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:27.596100 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d4952c-8bf2-4581-972e-d0b84a64200b admin admin] PATH_INFO: `/v3/projects/1bc4315b4ad74fd4923c9ada35d658e9` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:27.598254 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d4952c-8bf2-4581-972e-d0b84a64200b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bc4315b4ad74fd4923c9ada35d658e9)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:27.599874 dv-cinder-852364-2-smb devstack@keystone.service[80105]: WARNING py.warnings [None req-d1d4952c-8bf2-4581-972e-d0b84a64200b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 09 10:23:27.599874 dv-cinder-852364-2-smb devstack@keystone.service[80105]: warnings.warn(msg) Aug 09 10:23:27.599874 dv-cinder-852364-2-smb devstack@keystone.service[80105]: Aug 09 10:23:27.602038 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d4952c-8bf2-4581-972e-d0b84a64200b admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:27.731014 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-d1d4952c-8bf2-4581-972e-d0b84a64200b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bc4315b4ad74fd4923c9ada35d658e9', 'request_id': 'req-d1d4952c-8bf2-4581-972e-d0b84a64200b'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:23:27.755765 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-d1d4952c-8bf2-4581-972e-d0b84a64200b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bc4315b4ad74fd4923c9ada35d658e9', 'request_id': 'req-d1d4952c-8bf2-4581-972e-d0b84a64200b'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:23:27.819030 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-d1d4952c-8bf2-4581-972e-d0b84a64200b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bc4315b4ad74fd4923c9ada35d658e9', 'request_id': 'req-d1d4952c-8bf2-4581-972e-d0b84a64200b'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:23:27.856989 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-d1d4952c-8bf2-4581-972e-d0b84a64200b admin admin] The token cache is being invalidate because project 1bc4315b4ad74fd4923c9ada35d658e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80105) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:23:27.857305 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-d1d4952c-8bf2-4581-972e-d0b84a64200b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:23:27.862415 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-d1d4952c-8bf2-4581-972e-d0b84a64200b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:23:27.865376 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 819/1643] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:23:27 2022] DELETE /identity/v3/projects/1bc4315b4ad74fd4923c9ada35d658e9 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:23:27.871016 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d6a8bc-29d0-492e-a28f-6ed6cf7a8dbb None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:27.872163 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d6a8bc-29d0-492e-a28f-6ed6cf7a8dbb None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:27.872657 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d6a8bc-29d0-492e-a28f-6ed6cf7a8dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:27.920230 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-72d6a8bc-29d0-492e-a28f-6ed6cf7a8dbb None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:23:27.926175 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-72d6a8bc-29d0-492e-a28f-6ed6cf7a8dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:27.948446 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:23:28.155999 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 825/1644] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:23:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:23:28.163956 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3dfb0-aef8-4625-aae6-5f80371bf39f None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:28.164243 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3dfb0-aef8-4625-aae6-5f80371bf39f None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:28.164523 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3dfb0-aef8-4625-aae6-5f80371bf39f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:28.198928 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-bba3dfb0-aef8-4625-aae6-5f80371bf39f None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:23:28.200122 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-bba3dfb0-aef8-4625-aae6-5f80371bf39f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:28.223220 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 820/1645] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:23:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:23:28.224039 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d6a8bc-29d0-492e-a28f-6ed6cf7a8dbb None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:28.238683 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d6a8bc-29d0-492e-a28f-6ed6cf7a8dbb None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:28.297000 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694e08f8-43e0-49d9-ba87-3609a124e88d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:28.297645 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694e08f8-43e0-49d9-ba87-3609a124e88d admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:28.297946 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694e08f8-43e0-49d9-ba87-3609a124e88d admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:28.298591 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694e08f8-43e0-49d9-ba87-3609a124e88d admin admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:28.298865 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694e08f8-43e0-49d9-ba87-3609a124e88d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:23:28.299169 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694e08f8-43e0-49d9-ba87-3609a124e88d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:28.310172 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694e08f8-43e0-49d9-ba87-3609a124e88d admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:28.352320 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 826/1646] 10.222.0.36 () {58 vars in 1153 bytes} [Tue Aug 9 10:23:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:23:28.354172 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba3dfb0-aef8-4625-aae6-5f80371bf39f None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:28.388114 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba3dfb0-aef8-4625-aae6-5f80371bf39f None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:28.403066 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9faf170-fae0-4e38-8dc3-0da0b2cb1849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:28.404034 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9faf170-fae0-4e38-8dc3-0da0b2cb1849 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:28.404223 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9faf170-fae0-4e38-8dc3-0da0b2cb1849 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:28.406019 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9faf170-fae0-4e38-8dc3-0da0b2cb1849 admin admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:28.409316 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9faf170-fae0-4e38-8dc3-0da0b2cb1849 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:28.416840 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9faf170-fae0-4e38-8dc3-0da0b2cb1849 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:28.504948 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 821/1647] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:23:28 2022] POST /identity/v3/projects => generated 365 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:23:28.508986 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694e08f8-43e0-49d9-ba87-3609a124e88d admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:28.525574 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694e08f8-43e0-49d9-ba87-3609a124e88d admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:28.697077 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d14cc69-5784-4ab5-b4c4-63bf30305102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:28.698077 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d14cc69-5784-4ab5-b4c4-63bf30305102 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:28.699249 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d14cc69-5784-4ab5-b4c4-63bf30305102 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:28.699684 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d14cc69-5784-4ab5-b4c4-63bf30305102 admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:28.700511 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d14cc69-5784-4ab5-b4c4-63bf30305102 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:28.703381 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d14cc69-5784-4ab5-b4c4-63bf30305102 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:28.757533 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 827/1648] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:23:28 2022] POST /identity/v3/users => generated 283 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:23:28.758775 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9faf170-fae0-4e38-8dc3-0da0b2cb1849 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:28.777926 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9faf170-fae0-4e38-8dc3-0da0b2cb1849 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:28.793181 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff13ec75-4419-48a3-8bae-d49c048edf2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:28.798311 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff13ec75-4419-48a3-8bae-d49c048edf2d admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:28.798676 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff13ec75-4419-48a3-8bae-d49c048edf2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:28.799030 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff13ec75-4419-48a3-8bae-d49c048edf2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:28.799957 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff13ec75-4419-48a3-8bae-d49c048edf2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:28.802884 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff13ec75-4419-48a3-8bae-d49c048edf2d admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:28.828927 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 822/1649] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:23:28 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:23:28.830200 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d14cc69-5784-4ab5-b4c4-63bf30305102 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:28.845578 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d14cc69-5784-4ab5-b4c4-63bf30305102 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:28.866303 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce562f9-dc9a-464f-b121-193629610d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:28.866973 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce562f9-dc9a-464f-b121-193629610d82 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:28.867290 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce562f9-dc9a-464f-b121-193629610d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:28.867658 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce562f9-dc9a-464f-b121-193629610d82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:28.868325 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce562f9-dc9a-464f-b121-193629610d82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:28.870186 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce562f9-dc9a-464f-b121-193629610d82 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:28.898397 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 828/1650] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:23:28 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:23:28.900024 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff13ec75-4419-48a3-8bae-d49c048edf2d admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:28.924823 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff13ec75-4419-48a3-8bae-d49c048edf2d admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:28.935365 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b866d728-19ed-4522-bf62-e163e516ca51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:28.937386 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b866d728-19ed-4522-bf62-e163e516ca51 admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:28.937819 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b866d728-19ed-4522-bf62-e163e516ca51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:28.938319 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b866d728-19ed-4522-bf62-e163e516ca51 admin admin] PATH_INFO: `/v3/projects/76d1ed073e5143abaaa1ab76994f1ac9/users/4d8c04e47f7042bebb5564434b6c4389/roles/a9895331e9694fa8b2b50908bb057bcb` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:28.969656 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce562f9-dc9a-464f-b121-193629610d82 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:28.971409 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-bce562f9-dc9a-464f-b121-193629610d82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:28.979928 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b866d728-19ed-4522-bf62-e163e516ca51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76d1ed073e5143abaaa1ab76994f1ac9, user_id=4d8c04e47f7042bebb5564434b6c4389, role_id=a9895331e9694fa8b2b50908bb057bcb)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:28.988417 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b866d728-19ed-4522-bf62-e163e516ca51 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:28.992108 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce562f9-dc9a-464f-b121-193629610d82 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:28.999755 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2bf24a-6b7e-4a2f-b100-9ebb1c2588cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:29.001283 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2bf24a-6b7e-4a2f-b100-9ebb1c2588cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:29.001819 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2bf24a-6b7e-4a2f-b100-9ebb1c2588cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:29.002638 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2bf24a-6b7e-4a2f-b100-9ebb1c2588cd admin admin] PATH_INFO: `/v3/users/601a3160d88f4100b1552f547e372307` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:29.004647 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2bf24a-6b7e-4a2f-b100-9ebb1c2588cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=601a3160d88f4100b1552f547e372307)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:29.009562 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2bf24a-6b7e-4a2f-b100-9ebb1c2588cd admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:29.023204 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 823/1651] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:23:28 2022] PUT /identity/v3/projects/76d1ed073e5143abaaa1ab76994f1ac9/users/4d8c04e47f7042bebb5564434b6c4389/roles/a9895331e9694fa8b2b50908bb057bcb => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:23:29.034555 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c63513-ee2f-449b-bdfb-818d67e6647e None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:29.034860 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c63513-ee2f-449b-bdfb-818d67e6647e None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:29.035107 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c63513-ee2f-449b-bdfb-818d67e6647e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:29.089388 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-f5c63513-ee2f-449b-bdfb-818d67e6647e None None] MFA Rules not processed for user `4d8c04e47f7042bebb5564434b6c4389`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:23:29.092863 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-f5c63513-ee2f-449b-bdfb-818d67e6647e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:29.119126 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-ae2bf24a-6b7e-4a2f-b100-9ebb1c2588cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '601a3160d88f4100b1552f547e372307'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:23:29.154398 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-ae2bf24a-6b7e-4a2f-b100-9ebb1c2588cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '601a3160d88f4100b1552f547e372307'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:23:29.178005 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-ae2bf24a-6b7e-4a2f-b100-9ebb1c2588cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '601a3160d88f4100b1552f547e372307'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:23:29.178805 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-ae2bf24a-6b7e-4a2f-b100-9ebb1c2588cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '601a3160d88f4100b1552f547e372307'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:23:29.181360 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:23:29.195594 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:23:29.197615 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-ae2bf24a-6b7e-4a2f-b100-9ebb1c2588cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '601a3160d88f4100b1552f547e372307'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:23:29.219293 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 829/1652] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:23:28 2022] DELETE /identity/v3/users/601a3160d88f4100b1552f547e372307 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 10:23:29.220877 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a18b439-644b-4448-8480-7ec76cb28ae6 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:29.221365 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a18b439-644b-4448-8480-7ec76cb28ae6 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:29.221747 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a18b439-644b-4448-8480-7ec76cb28ae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:29.273262 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-8a18b439-644b-4448-8480-7ec76cb28ae6 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:23:29.275084 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-8a18b439-644b-4448-8480-7ec76cb28ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:29.331467 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 824/1653] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:23:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:23:29.332643 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c63513-ee2f-449b-bdfb-818d67e6647e None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:29.335195 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-f5c63513-ee2f-449b-bdfb-818d67e6647e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:29.436029 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 830/1654] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:23:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:23:29.462986 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c63513-ee2f-449b-bdfb-818d67e6647e None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:29.469328 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdaf288-273f-4b63-a7cf-7720c82de5e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:29.470204 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdaf288-273f-4b63-a7cf-7720c82de5e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:29.470660 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdaf288-273f-4b63-a7cf-7720c82de5e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:29.471038 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdaf288-273f-4b63-a7cf-7720c82de5e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:29.471785 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdaf288-273f-4b63-a7cf-7720c82de5e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:29.473836 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdaf288-273f-4b63-a7cf-7720c82de5e7 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:29.525466 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 825/1655] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:23:29 2022] POST /identity/v3/projects => generated 363 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:23:29.526909 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a18b439-644b-4448-8480-7ec76cb28ae6 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:29.546474 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a18b439-644b-4448-8480-7ec76cb28ae6 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:29.668707 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09378895-2b7c-421c-b548-274cf0df173d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:29.669603 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09378895-2b7c-421c-b548-274cf0df173d admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:29.670217 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09378895-2b7c-421c-b548-274cf0df173d admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:29.670687 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09378895-2b7c-421c-b548-274cf0df173d admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:29.671576 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09378895-2b7c-421c-b548-274cf0df173d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:29.685329 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdaf288-273f-4b63-a7cf-7720c82de5e7 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:29.688592 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-ebdaf288-273f-4b63-a7cf-7720c82de5e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:29.723164 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09378895-2b7c-421c-b548-274cf0df173d admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:29.770622 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 831/1656] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:23:29 2022] POST /identity/v3/users => generated 288 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:23:29.774433 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09378895-2b7c-421c-b548-274cf0df173d admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:29.801393 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09378895-2b7c-421c-b548-274cf0df173d admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:29.813281 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ba07ba-96b6-44d0-8e6e-7ef7c594a1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:29.814294 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba07ba-96b6-44d0-8e6e-7ef7c594a1b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:29.814731 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba07ba-96b6-44d0-8e6e-7ef7c594a1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:29.815110 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba07ba-96b6-44d0-8e6e-7ef7c594a1b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:29.815921 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ba07ba-96b6-44d0-8e6e-7ef7c594a1b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:29.818509 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ba07ba-96b6-44d0-8e6e-7ef7c594a1b3 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:29.830986 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdaf288-273f-4b63-a7cf-7720c82de5e7 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:29.834697 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 832/1657] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:23:29 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:23:29.838559 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5383d9-9dc5-49a2-ab71-76198fe71c5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:29.839203 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5383d9-9dc5-49a2-ab71-76198fe71c5d service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:29.839487 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5383d9-9dc5-49a2-ab71-76198fe71c5d service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:29.839762 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5383d9-9dc5-49a2-ab71-76198fe71c5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:29.840127 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ba07ba-96b6-44d0-8e6e-7ef7c594a1b3 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:29.853007 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5383d9-9dc5-49a2-ab71-76198fe71c5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:29.855107 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5383d9-9dc5-49a2-ab71-76198fe71c5d service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:29.864156 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ba07ba-96b6-44d0-8e6e-7ef7c594a1b3 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:29.867730 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 826/1658] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:23:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:23:29.870493 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46bff2d-b9e8-46d7-88c1-9fb6118b1e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:29.871392 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46bff2d-b9e8-46d7-88c1-9fb6118b1e20 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:29.871709 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46bff2d-b9e8-46d7-88c1-9fb6118b1e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:29.871983 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46bff2d-b9e8-46d7-88c1-9fb6118b1e20 admin admin] PATH_INFO: `/v3/projects/00262a9e53e24ae8913b0c740faae6c9/users/886a0b2bebd447da80875fe374df61a3/roles/89ca30cbbb634be8a96e9921aa56626b` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:29.900448 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46bff2d-b9e8-46d7-88c1-9fb6118b1e20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00262a9e53e24ae8913b0c740faae6c9, user_id=886a0b2bebd447da80875fe374df61a3, role_id=89ca30cbbb634be8a96e9921aa56626b)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:29.903462 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46bff2d-b9e8-46d7-88c1-9fb6118b1e20 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:29.926694 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 833/1659] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:23:29 2022] PUT /identity/v3/projects/00262a9e53e24ae8913b0c740faae6c9/users/886a0b2bebd447da80875fe374df61a3/roles/89ca30cbbb634be8a96e9921aa56626b => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:23:29.930430 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5383d9-9dc5-49a2-ab71-76198fe71c5d service neutron] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:29.948145 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5383d9-9dc5-49a2-ab71-76198fe71c5d service neutron] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:30.060150 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351cf244-91b4-4b44-b5ce-4476365aaa28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:30.061250 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351cf244-91b4-4b44-b5ce-4476365aaa28 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:30.061543 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351cf244-91b4-4b44-b5ce-4476365aaa28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:30.061823 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351cf244-91b4-4b44-b5ce-4476365aaa28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:30.062758 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351cf244-91b4-4b44-b5ce-4476365aaa28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:30.064625 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351cf244-91b4-4b44-b5ce-4476365aaa28 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:30.067373 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:23:30.084466 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 827/1660] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:23:29 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:23:30.084622 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46bff2d-b9e8-46d7-88c1-9fb6118b1e20 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:30.105975 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46bff2d-b9e8-46d7-88c1-9fb6118b1e20 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:30.112034 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265b85f0-2b36-45cc-b920-5bb9014313ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:30.112718 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b85f0-2b36-45cc-b920-5bb9014313ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:30.112998 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b85f0-2b36-45cc-b920-5bb9014313ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:30.113274 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b85f0-2b36-45cc-b920-5bb9014313ea admin admin] PATH_INFO: `/v3/projects/00262a9e53e24ae8913b0c740faae6c9/users/886a0b2bebd447da80875fe374df61a3/roles/89ca30cbbb634be8a96e9921aa56626b` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:30.123608 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265b85f0-2b36-45cc-b920-5bb9014313ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=00262a9e53e24ae8913b0c740faae6c9, user_id=886a0b2bebd447da80875fe374df61a3, role_id=89ca30cbbb634be8a96e9921aa56626b)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:30.127390 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265b85f0-2b36-45cc-b920-5bb9014313ea admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:30.134524 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351cf244-91b4-4b44-b5ce-4476365aaa28 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:30.137887 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-351cf244-91b4-4b44-b5ce-4476365aaa28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:30.151583 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 834/1661] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:23:30 2022] PUT /identity/v3/projects/00262a9e53e24ae8913b0c740faae6c9/users/886a0b2bebd447da80875fe374df61a3/roles/89ca30cbbb634be8a96e9921aa56626b => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:23:30.168199 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b58bd3d-da34-4bf8-8a8f-bd6dcfaf5586 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:30.168819 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b58bd3d-da34-4bf8-8a8f-bd6dcfaf5586 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:30.169287 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b58bd3d-da34-4bf8-8a8f-bd6dcfaf5586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:30.179536 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351cf244-91b4-4b44-b5ce-4476365aaa28 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:30.261032 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-4b58bd3d-da34-4bf8-8a8f-bd6dcfaf5586 None None] MFA Rules not processed for user `886a0b2bebd447da80875fe374df61a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:23:30.265144 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-4b58bd3d-da34-4bf8-8a8f-bd6dcfaf5586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:30.305377 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610c8ce3-52ee-47fa-ae98-522ed325c9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:30.309029 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610c8ce3-52ee-47fa-ae98-522ed325c9d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:30.309351 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610c8ce3-52ee-47fa-ae98-522ed325c9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:30.309634 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610c8ce3-52ee-47fa-ae98-522ed325c9d5 admin admin] PATH_INFO: `/v3/projects/d07286da652c4a2d824e194d1726d635` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:30.312501 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610c8ce3-52ee-47fa-ae98-522ed325c9d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d07286da652c4a2d824e194d1726d635)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:30.315954 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610c8ce3-52ee-47fa-ae98-522ed325c9d5 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:30.318583 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:INSERT=6,keystone:DELETE=1,keystone:SELECT=93 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:23:30.399357 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-610c8ce3-52ee-47fa-ae98-522ed325c9d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd07286da652c4a2d824e194d1726d635', 'request_id': 'req-610c8ce3-52ee-47fa-ae98-522ed325c9d5'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:23:30.420304 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-610c8ce3-52ee-47fa-ae98-522ed325c9d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd07286da652c4a2d824e194d1726d635', 'request_id': 'req-610c8ce3-52ee-47fa-ae98-522ed325c9d5'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:23:30.427325 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 835/1662] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:23:30 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 10:23:30.444130 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b58bd3d-da34-4bf8-8a8f-bd6dcfaf5586 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:30.445879 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-4b58bd3d-da34-4bf8-8a8f-bd6dcfaf5586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:30.447951 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-610c8ce3-52ee-47fa-ae98-522ed325c9d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd07286da652c4a2d824e194d1726d635', 'request_id': 'req-610c8ce3-52ee-47fa-ae98-522ed325c9d5'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:23:30.484765 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-610c8ce3-52ee-47fa-ae98-522ed325c9d5 admin admin] The token cache is being invalidate because project d07286da652c4a2d824e194d1726d635 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80105) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:23:30.485291 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-610c8ce3-52ee-47fa-ae98-522ed325c9d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:23:30.487138 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-610c8ce3-52ee-47fa-ae98-522ed325c9d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:23:30.490544 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 828/1663] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:23:30 2022] DELETE /identity/v3/projects/d07286da652c4a2d824e194d1726d635 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:23:30.498005 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610c8ce3-52ee-47fa-ae98-522ed325c9d5 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:30.503014 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-610c8ce3-52ee-47fa-ae98-522ed325c9d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:30.605602 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b58bd3d-da34-4bf8-8a8f-bd6dcfaf5586 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:30.666082 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610c8ce3-52ee-47fa-ae98-522ed325c9d5 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:30.682471 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b47b7e9-9442-4fe3-abbd-5ce334705da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:30.683310 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b47b7e9-9442-4fe3-abbd-5ce334705da4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:30.683702 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b47b7e9-9442-4fe3-abbd-5ce334705da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:30.684077 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b47b7e9-9442-4fe3-abbd-5ce334705da4 admin admin] PATH_INFO: `/v3/users/7ab85c06ce674552900be7d00d32077a` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:30.685347 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b47b7e9-9442-4fe3-abbd-5ce334705da4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ab85c06ce674552900be7d00d32077a)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:30.687737 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b47b7e9-9442-4fe3-abbd-5ce334705da4 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:30.689440 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c707aaca-2c7b-453b-8a28-300f9037d29a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6c687a38524de0bf23d87ae91d3b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:30.690310 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c707aaca-2c7b-453b-8a28-300f9037d29a service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:30.690754 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c707aaca-2c7b-453b-8a28-300f9037d29a service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:30.691856 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c707aaca-2c7b-453b-8a28-300f9037d29a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:30.694237 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-c707aaca-2c7b-453b-8a28-300f9037d29a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:30.754103 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:23:30.791135 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-5b47b7e9-9442-4fe3-abbd-5ce334705da4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ab85c06ce674552900be7d00d32077a'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:23:30.815063 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-5b47b7e9-9442-4fe3-abbd-5ce334705da4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ab85c06ce674552900be7d00d32077a'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:23:30.823603 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-5b47b7e9-9442-4fe3-abbd-5ce334705da4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ab85c06ce674552900be7d00d32077a'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:23:30.824550 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-5b47b7e9-9442-4fe3-abbd-5ce334705da4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ab85c06ce674552900be7d00d32077a'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:23:30.840259 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-5b47b7e9-9442-4fe3-abbd-5ce334705da4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ab85c06ce674552900be7d00d32077a'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:23:30.853767 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 829/1664] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:23:30 2022] DELETE /identity/v3/users/7ab85c06ce674552900be7d00d32077a => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:23:30.855908 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c707aaca-2c7b-453b-8a28-300f9037d29a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:30.860832 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c707aaca-2c7b-453b-8a28-300f9037d29a service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:30.896262 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 836/1665] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:23:30 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:23:31.058579 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b47b7e9-9442-4fe3-abbd-5ce334705da4 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:31.061411 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-5b47b7e9-9442-4fe3-abbd-5ce334705da4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:31.313223 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b47b7e9-9442-4fe3-abbd-5ce334705da4 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:31.328915 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c857958-a298-4292-a806-1d5ab9f943fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6c687a38524de0bf23d87ae91d3b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:31.329617 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c857958-a298-4292-a806-1d5ab9f943fa service cinder] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:31.329919 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c857958-a298-4292-a806-1d5ab9f943fa service cinder] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:31.330189 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c857958-a298-4292-a806-1d5ab9f943fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:31.332989 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c707aaca-2c7b-453b-8a28-300f9037d29a service cinder] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:31.333494 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-2c857958-a298-4292-a806-1d5ab9f943fa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:31.335706 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-c707aaca-2c7b-453b-8a28-300f9037d29a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:31.367596 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c707aaca-2c7b-453b-8a28-300f9037d29a service cinder] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:31.416461 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:23:31.503497 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a23753c-b8ba-45ec-a895-aac18774e7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:31.504509 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a23753c-b8ba-45ec-a895-aac18774e7de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:31.504787 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a23753c-b8ba-45ec-a895-aac18774e7de admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:31.505044 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a23753c-b8ba-45ec-a895-aac18774e7de admin admin] PATH_INFO: `/v3/projects/411579565c794b9b8dce1f8727103738` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:31.507364 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a23753c-b8ba-45ec-a895-aac18774e7de admin admin] RBAC: Authorizing `identity:delete_project(project_id=411579565c794b9b8dce1f8727103738)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:31.509613 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c857958-a298-4292-a806-1d5ab9f943fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:31.512344 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c857958-a298-4292-a806-1d5ab9f943fa service cinder] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:31.515197 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a23753c-b8ba-45ec-a895-aac18774e7de admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:31.527611 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 830/1666] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:23:31 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:23:31.658179 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-0a23753c-b8ba-45ec-a895-aac18774e7de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '411579565c794b9b8dce1f8727103738', 'request_id': 'req-0a23753c-b8ba-45ec-a895-aac18774e7de'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:23:31.671830 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-0a23753c-b8ba-45ec-a895-aac18774e7de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '411579565c794b9b8dce1f8727103738', 'request_id': 'req-0a23753c-b8ba-45ec-a895-aac18774e7de'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:23:31.681666 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-0a23753c-b8ba-45ec-a895-aac18774e7de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '411579565c794b9b8dce1f8727103738', 'request_id': 'req-0a23753c-b8ba-45ec-a895-aac18774e7de'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:23:31.706478 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-0a23753c-b8ba-45ec-a895-aac18774e7de admin admin] The token cache is being invalidate because project 411579565c794b9b8dce1f8727103738 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:23:31.706813 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-0a23753c-b8ba-45ec-a895-aac18774e7de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:23:31.709496 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-0a23753c-b8ba-45ec-a895-aac18774e7de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:23:31.715734 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 837/1667] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:23:31 2022] DELETE /identity/v3/projects/411579565c794b9b8dce1f8727103738 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 10:23:31.718706 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06819e85-8f6c-41ee-9aa4-83c8c63b6dbf None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:31.719038 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06819e85-8f6c-41ee-9aa4-83c8c63b6dbf None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:31.719302 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06819e85-8f6c-41ee-9aa4-83c8c63b6dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:31.766862 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-06819e85-8f6c-41ee-9aa4-83c8c63b6dbf None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:23:31.768065 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-06819e85-8f6c-41ee-9aa4-83c8c63b6dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:31.844969 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 831/1668] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:23:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:23:31.853462 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c52d9eb-86d2-416a-a707-35a6f5737d0b None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:31.853906 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c52d9eb-86d2-416a-a707-35a6f5737d0b None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:31.854295 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c52d9eb-86d2-416a-a707-35a6f5737d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:31.915684 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-6c52d9eb-86d2-416a-a707-35a6f5737d0b None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:23:31.922937 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-6c52d9eb-86d2-416a-a707-35a6f5737d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:31.968807 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 838/1669] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:23:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:23:31.970914 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06819e85-8f6c-41ee-9aa4-83c8c63b6dbf None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:31.977872 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:23:31.989436 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06819e85-8f6c-41ee-9aa4-83c8c63b6dbf None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:32.004074 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de141b7-3a39-4c08-8a4c-b735fc03da7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:32.005402 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de141b7-3a39-4c08-8a4c-b735fc03da7c admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:32.007021 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de141b7-3a39-4c08-8a4c-b735fc03da7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:32.008331 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de141b7-3a39-4c08-8a4c-b735fc03da7c admin admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:32.012211 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de141b7-3a39-4c08-8a4c-b735fc03da7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:23:32.012645 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de141b7-3a39-4c08-8a4c-b735fc03da7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:32.016755 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de141b7-3a39-4c08-8a4c-b735fc03da7c admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:32.047113 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 832/1670] 10.222.0.36 () {58 vars in 1153 bytes} [Tue Aug 9 10:23:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:23:32.052690 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c52d9eb-86d2-416a-a707-35a6f5737d0b None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:32.069294 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c52d9eb-86d2-416a-a707-35a6f5737d0b None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:32.074641 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce8e343-7e1d-4d02-8669-d140dda626ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:32.080668 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce8e343-7e1d-4d02-8669-d140dda626ba admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:32.080941 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce8e343-7e1d-4d02-8669-d140dda626ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:32.081217 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce8e343-7e1d-4d02-8669-d140dda626ba admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:32.082067 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce8e343-7e1d-4d02-8669-d140dda626ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:32.084156 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce8e343-7e1d-4d02-8669-d140dda626ba admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:32.120745 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d548e7c-8e54-4d85-953f-524fcf35b729 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:32.121099 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d548e7c-8e54-4d85-953f-524fcf35b729 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:32.121303 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d548e7c-8e54-4d85-953f-524fcf35b729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:32.171524 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 839/1671] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:23:32 2022] POST /identity/v3/projects => generated 381 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:23:32.174876 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce8e343-7e1d-4d02-8669-d140dda626ba admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:32.204039 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-9d548e7c-8e54-4d85-953f-524fcf35b729 None None] MFA Rules not processed for user `3d39820fab6041b9b655c54ce74e7e4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:23:32.207411 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-9d548e7c-8e54-4d85-953f-524fcf35b729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:32.408833 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce8e343-7e1d-4d02-8669-d140dda626ba admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:32.424467 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857e9c7f-4e9b-4f58-9a6f-33d298ac102b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:32.425102 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857e9c7f-4e9b-4f58-9a6f-33d298ac102b admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:32.425382 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857e9c7f-4e9b-4f58-9a6f-33d298ac102b admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:32.425651 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857e9c7f-4e9b-4f58-9a6f-33d298ac102b admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:32.426710 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857e9c7f-4e9b-4f58-9a6f-33d298ac102b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:32.430831 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857e9c7f-4e9b-4f58-9a6f-33d298ac102b admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:32.463923 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 833/1672] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:23:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:23:32.468217 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d548e7c-8e54-4d85-953f-524fcf35b729 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:32.473300 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-9d548e7c-8e54-4d85-953f-524fcf35b729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:32.498678 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 840/1673] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:23:32 2022] POST /identity/v3/users => generated 291 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:23:32.505050 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857e9c7f-4e9b-4f58-9a6f-33d298ac102b admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:32.546719 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857e9c7f-4e9b-4f58-9a6f-33d298ac102b admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:32.565213 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f446a1-feee-491c-a527-8d9b033309ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:32.565861 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f446a1-feee-491c-a527-8d9b033309ac admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:32.568912 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f446a1-feee-491c-a527-8d9b033309ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:32.569195 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f446a1-feee-491c-a527-8d9b033309ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:32.569900 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f446a1-feee-491c-a527-8d9b033309ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:32.575539 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f446a1-feee-491c-a527-8d9b033309ac admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:32.628568 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 841/1674] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:23:32 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:23:32.629936 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f446a1-feee-491c-a527-8d9b033309ac admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:32.651079 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:23:32.663545 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f446a1-feee-491c-a527-8d9b033309ac admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:32.683955 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38541924-8908-4412-9cbf-fc5e7757d531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:32.684532 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38541924-8908-4412-9cbf-fc5e7757d531 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:32.684814 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38541924-8908-4412-9cbf-fc5e7757d531 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:32.685081 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38541924-8908-4412-9cbf-fc5e7757d531 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:32.687086 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38541924-8908-4412-9cbf-fc5e7757d531 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:32.694068 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d548e7c-8e54-4d85-953f-524fcf35b729 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:32.697517 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38541924-8908-4412-9cbf-fc5e7757d531 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:32.707832 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a636d61a-40e9-464b-b556-ceb3727eaf4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb863beaaa9f495c8b64655996c061f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:32.708540 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a636d61a-40e9-464b-b556-ceb3727eaf4c service nova] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:32.708861 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a636d61a-40e9-464b-b556-ceb3727eaf4c service nova] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:32.709141 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a636d61a-40e9-464b-b556-ceb3727eaf4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:32.719799 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a636d61a-40e9-464b-b556-ceb3727eaf4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:32.721613 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a636d61a-40e9-464b-b556-ceb3727eaf4c service nova] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:32.743788 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 842/1675] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:23:32 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:23:32.744783 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38541924-8908-4412-9cbf-fc5e7757d531 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:32.762114 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 834/1676] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:23:32 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 10:23:32.788383 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38541924-8908-4412-9cbf-fc5e7757d531 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:32.801472 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ede56e9-d32a-4f5d-84b1-22a70691c742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:32.802444 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede56e9-d32a-4f5d-84b1-22a70691c742 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:32.802722 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede56e9-d32a-4f5d-84b1-22a70691c742 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:32.802996 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede56e9-d32a-4f5d-84b1-22a70691c742 admin admin] PATH_INFO: `/v3/projects/c0f8a40b3e504de283fa076692532cfe/users/c1dd0d17435a4925a69b1520003946ee/roles/a9895331e9694fa8b2b50908bb057bcb` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:32.868081 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ede56e9-d32a-4f5d-84b1-22a70691c742 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0f8a40b3e504de283fa076692532cfe, user_id=c1dd0d17435a4925a69b1520003946ee, role_id=a9895331e9694fa8b2b50908bb057bcb)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:32.873068 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a636d61a-40e9-464b-b556-ceb3727eaf4c service nova] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:32.875388 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-a636d61a-40e9-464b-b556-ceb3727eaf4c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:32.894975 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ede56e9-d32a-4f5d-84b1-22a70691c742 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:32.909492 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a636d61a-40e9-464b-b556-ceb3727eaf4c service nova] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:32.927177 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5563c8-7294-4891-a516-8f4bbb3d00bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:32.928132 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5563c8-7294-4891-a516-8f4bbb3d00bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:32.928412 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5563c8-7294-4891-a516-8f4bbb3d00bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:32.928684 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5563c8-7294-4891-a516-8f4bbb3d00bb admin admin] PATH_INFO: `/v3/projects/7e896272c4e24f0587acfe86b253a443` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:32.930687 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5563c8-7294-4891-a516-8f4bbb3d00bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e896272c4e24f0587acfe86b253a443)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:32.937176 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 843/1677] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:23:32 2022] PUT /identity/v3/projects/c0f8a40b3e504de283fa076692532cfe/users/c1dd0d17435a4925a69b1520003946ee/roles/a9895331e9694fa8b2b50908bb057bcb => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:23:32.941505 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5563c8-7294-4891-a516-8f4bbb3d00bb admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:32.960068 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e3eeee-d7d5-40dc-a9b6-a39afb555620 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:32.961205 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e3eeee-d7d5-40dc-a9b6-a39afb555620 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:32.963402 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e3eeee-d7d5-40dc-a9b6-a39afb555620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:33.039332 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-78e3eeee-d7d5-40dc-a9b6-a39afb555620 None None] MFA Rules not processed for user `c1dd0d17435a4925a69b1520003946ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:23:33.044432 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-78e3eeee-d7d5-40dc-a9b6-a39afb555620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:33.118666 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-0c5563c8-7294-4891-a516-8f4bbb3d00bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e896272c4e24f0587acfe86b253a443', 'request_id': 'req-0c5563c8-7294-4891-a516-8f4bbb3d00bb'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:23:33.144441 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-0c5563c8-7294-4891-a516-8f4bbb3d00bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e896272c4e24f0587acfe86b253a443', 'request_id': 'req-0c5563c8-7294-4891-a516-8f4bbb3d00bb'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:23:33.146322 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:23:33.172931 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-0c5563c8-7294-4891-a516-8f4bbb3d00bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e896272c4e24f0587acfe86b253a443', 'request_id': 'req-0c5563c8-7294-4891-a516-8f4bbb3d00bb'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:23:33.198232 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-0c5563c8-7294-4891-a516-8f4bbb3d00bb admin admin] The token cache is being invalidate because project 7e896272c4e24f0587acfe86b253a443 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80105) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:23:33.198324 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-0c5563c8-7294-4891-a516-8f4bbb3d00bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:23:33.205578 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-0c5563c8-7294-4891-a516-8f4bbb3d00bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:23:33.209508 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 835/1678] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:23:32 2022] DELETE /identity/v3/projects/7e896272c4e24f0587acfe86b253a443 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:23:33.214710 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46f98e7-d6a9-4d48-b3e9-9426023ac7a0 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:33.214991 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46f98e7-d6a9-4d48-b3e9-9426023ac7a0 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:33.215263 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46f98e7-d6a9-4d48-b3e9-9426023ac7a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:33.247258 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 844/1679] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:23:32 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:23:33.256888 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e3eeee-d7d5-40dc-a9b6-a39afb555620 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:33.259621 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-78e3eeee-d7d5-40dc-a9b6-a39afb555620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:33.283442 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-c46f98e7-d6a9-4d48-b3e9-9426023ac7a0 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:23:33.285178 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-c46f98e7-d6a9-4d48-b3e9-9426023ac7a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:33.410708 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 836/1680] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:23:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:23:33.419515 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d78806e-954a-4569-a9b3-1a5d4a6f66e0 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:33.419974 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d78806e-954a-4569-a9b3-1a5d4a6f66e0 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:33.420131 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d78806e-954a-4569-a9b3-1a5d4a6f66e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:33.447525 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e3eeee-d7d5-40dc-a9b6-a39afb555620 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:33.455251 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-5d78806e-954a-4569-a9b3-1a5d4a6f66e0 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:23:33.455468 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d94512-7775-4595-9932-a9a076910f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:33.456103 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d94512-7775-4595-9932-a9a076910f4a admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:33.456387 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d94512-7775-4595-9932-a9a076910f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:33.456499 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-5d78806e-954a-4569-a9b3-1a5d4a6f66e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:33.456712 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d94512-7775-4595-9932-a9a076910f4a admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:33.457477 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d94512-7775-4595-9932-a9a076910f4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:33.461101 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d94512-7775-4595-9932-a9a076910f4a admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:33.464781 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 837/1681] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:23:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 10:23:33.470902 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d78806e-954a-4569-a9b3-1a5d4a6f66e0 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:33.488224 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d78806e-954a-4569-a9b3-1a5d4a6f66e0 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:33.502860 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cf6126-9902-4984-b16b-760f10717685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:33.503634 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf6126-9902-4984-b16b-760f10717685 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:33.503977 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf6126-9902-4984-b16b-760f10717685 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:33.505094 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf6126-9902-4984-b16b-760f10717685 admin admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:33.505094 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cf6126-9902-4984-b16b-760f10717685 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:23:33.505440 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cf6126-9902-4984-b16b-760f10717685 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:33.510865 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cf6126-9902-4984-b16b-760f10717685 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:33.533589 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 845/1682] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:23:33 2022] POST /identity/v3/projects => generated 379 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:23:33.536297 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d94512-7775-4595-9932-a9a076910f4a admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:33.541274 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 838/1683] 10.222.0.36 () {58 vars in 1153 bytes} [Tue Aug 9 10:23:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:23:33.546222 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cf6126-9902-4984-b16b-760f10717685 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:33.572351 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cf6126-9902-4984-b16b-760f10717685 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:33.696047 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:23:33.722680 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543ef29c-1305-4e5c-b978-53be06e7c151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:33.723302 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ef29c-1305-4e5c-b978-53be06e7c151 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:33.723576 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ef29c-1305-4e5c-b978-53be06e7c151 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:33.723836 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ef29c-1305-4e5c-b978-53be06e7c151 admin admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:33.724475 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543ef29c-1305-4e5c-b978-53be06e7c151 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:33.726464 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543ef29c-1305-4e5c-b978-53be06e7c151 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:33.735841 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d94512-7775-4595-9932-a9a076910f4a admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:33.747363 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fa480b-953b-4e4a-97df-d8b9d3b2968d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:33.748075 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa480b-953b-4e4a-97df-d8b9d3b2968d admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:33.748365 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa480b-953b-4e4a-97df-d8b9d3b2968d admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:33.748645 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa480b-953b-4e4a-97df-d8b9d3b2968d admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:33.753318 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fa480b-953b-4e4a-97df-d8b9d3b2968d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:33.758958 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fa480b-953b-4e4a-97df-d8b9d3b2968d admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:33.817387 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 846/1684] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:23:33 2022] POST /identity/v3/users => generated 296 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:23:33.818940 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 839/1685] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:23:33 2022] POST /identity/v3/projects => generated 385 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:23:33.822919 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543ef29c-1305-4e5c-b978-53be06e7c151 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:33.823799 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fa480b-953b-4e4a-97df-d8b9d3b2968d admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:33.854117 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fa480b-953b-4e4a-97df-d8b9d3b2968d admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:33.974790 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:23:34.016669 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543ef29c-1305-4e5c-b978-53be06e7c151 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:34.038674 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67e8768-8fc8-4ce4-a84f-e480f467dbc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:34.039297 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e8768-8fc8-4ce4-a84f-e480f467dbc4 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:34.039569 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e8768-8fc8-4ce4-a84f-e480f467dbc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:34.039840 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e8768-8fc8-4ce4-a84f-e480f467dbc4 admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:34.040468 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67e8768-8fc8-4ce4-a84f-e480f467dbc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:34.042425 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67e8768-8fc8-4ce4-a84f-e480f467dbc4 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:34.042765 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f97996c-0dce-4447-aeae-a1e652122384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:34.043537 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97996c-0dce-4447-aeae-a1e652122384 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:34.043828 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97996c-0dce-4447-aeae-a1e652122384 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:34.044491 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97996c-0dce-4447-aeae-a1e652122384 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:34.045398 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f97996c-0dce-4447-aeae-a1e652122384 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:34.061705 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f97996c-0dce-4447-aeae-a1e652122384 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:34.104857 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 840/1686] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:23:33 2022] POST /identity/v3/users => generated 293 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:23:34.106413 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67e8768-8fc8-4ce4-a84f-e480f467dbc4 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:34.116736 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 847/1687] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:23:33 2022] GET /identity/v3/roles => generated 1420 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:23:34.117658 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f97996c-0dce-4447-aeae-a1e652122384 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:34.128228 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67e8768-8fc8-4ce4-a84f-e480f467dbc4 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:34.134871 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f97996c-0dce-4447-aeae-a1e652122384 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:34.139857 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf633711-58ca-4fc6-8ef6-33b26b97d6ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:34.139857 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf633711-58ca-4fc6-8ef6-33b26b97d6ac admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:34.140141 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf633711-58ca-4fc6-8ef6-33b26b97d6ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:34.140224 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf633711-58ca-4fc6-8ef6-33b26b97d6ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:34.140898 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf633711-58ca-4fc6-8ef6-33b26b97d6ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:34.142677 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf633711-58ca-4fc6-8ef6-33b26b97d6ac admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:34.151521 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abf3ec9-9b5d-4369-ab42-4114a16929f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:34.152199 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf3ec9-9b5d-4369-ab42-4114a16929f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:34.152476 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf3ec9-9b5d-4369-ab42-4114a16929f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:34.152745 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf3ec9-9b5d-4369-ab42-4114a16929f8 admin admin] PATH_INFO: `/v3/projects/b995c367c5db45ada70c9dda48cbbac1/users/7635cf16bf374307bf660f5ae043c909/roles/89ca30cbbb634be8a96e9921aa56626b` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:34.172253 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 841/1688] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:23:34 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:23:34.173191 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf633711-58ca-4fc6-8ef6-33b26b97d6ac admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:34.186837 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abf3ec9-9b5d-4369-ab42-4114a16929f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b995c367c5db45ada70c9dda48cbbac1, user_id=7635cf16bf374307bf660f5ae043c909, role_id=89ca30cbbb634be8a96e9921aa56626b)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:34.189742 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abf3ec9-9b5d-4369-ab42-4114a16929f8 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:34.196804 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf633711-58ca-4fc6-8ef6-33b26b97d6ac admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:34.217637 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d799137d-4601-4957-91a3-c088ef2044d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:34.218253 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d799137d-4601-4957-91a3-c088ef2044d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:34.218530 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d799137d-4601-4957-91a3-c088ef2044d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:34.218799 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d799137d-4601-4957-91a3-c088ef2044d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:34.219501 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d799137d-4601-4957-91a3-c088ef2044d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:34.221335 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d799137d-4601-4957-91a3-c088ef2044d0 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:34.230921 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 848/1689] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:23:34 2022] PUT /identity/v3/projects/b995c367c5db45ada70c9dda48cbbac1/users/7635cf16bf374307bf660f5ae043c909/roles/89ca30cbbb634be8a96e9921aa56626b => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:23:34.232037 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abf3ec9-9b5d-4369-ab42-4114a16929f8 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:34.257016 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 842/1690] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:23:34 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 10:23:34.261183 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d799137d-4601-4957-91a3-c088ef2044d0 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:34.304723 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d799137d-4601-4957-91a3-c088ef2044d0 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:34.378491 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abf3ec9-9b5d-4369-ab42-4114a16929f8 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:34.399128 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e624d5-4b95-402d-94c7-98346a2c725f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:34.400068 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e624d5-4b95-402d-94c7-98346a2c725f admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:34.400530 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e624d5-4b95-402d-94c7-98346a2c725f admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:34.401069 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e624d5-4b95-402d-94c7-98346a2c725f admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:34.401934 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e624d5-4b95-402d-94c7-98346a2c725f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:34.403736 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e624d5-4b95-402d-94c7-98346a2c725f admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:34.432299 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 849/1691] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:23:34 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:23:34.433241 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e624d5-4b95-402d-94c7-98346a2c725f admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:34.455158 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e624d5-4b95-402d-94c7-98346a2c725f admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:34.468296 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6c9c77-3401-401e-9b2b-47a8cbab6e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:34.469349 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c9c77-3401-401e-9b2b-47a8cbab6e69 admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:34.469505 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c9c77-3401-401e-9b2b-47a8cbab6e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:34.469945 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c9c77-3401-401e-9b2b-47a8cbab6e69 admin admin] PATH_INFO: `/v3/projects/4d72b01a55594e28b979e18a2f68a783/users/b7594c3d3efc43b78bb6afedcc2bcf56/roles/a9895331e9694fa8b2b50908bb057bcb` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:34.471628 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a57165-e174-41d2-b2cd-6f1e446f1685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:34.472298 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a57165-e174-41d2-b2cd-6f1e446f1685 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:34.472575 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a57165-e174-41d2-b2cd-6f1e446f1685 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:34.473020 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a57165-e174-41d2-b2cd-6f1e446f1685 admin admin] PATH_INFO: `/v3/projects/b995c367c5db45ada70c9dda48cbbac1/users/7635cf16bf374307bf660f5ae043c909/roles/89ca30cbbb634be8a96e9921aa56626b` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:34.476845 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a57165-e174-41d2-b2cd-6f1e446f1685 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b995c367c5db45ada70c9dda48cbbac1, user_id=7635cf16bf374307bf660f5ae043c909, role_id=89ca30cbbb634be8a96e9921aa56626b)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:34.479546 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a57165-e174-41d2-b2cd-6f1e446f1685 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:34.505720 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6c9c77-3401-401e-9b2b-47a8cbab6e69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d72b01a55594e28b979e18a2f68a783, user_id=b7594c3d3efc43b78bb6afedcc2bcf56, role_id=a9895331e9694fa8b2b50908bb057bcb)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:34.508455 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6c9c77-3401-401e-9b2b-47a8cbab6e69 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:34.519465 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 850/1692] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:23:34 2022] PUT /identity/v3/projects/b995c367c5db45ada70c9dda48cbbac1/users/7635cf16bf374307bf660f5ae043c909/roles/89ca30cbbb634be8a96e9921aa56626b => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:23:34.532574 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f37350-42e1-4d77-a621-8c0b2676a88d None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:34.532863 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f37350-42e1-4d77-a621-8c0b2676a88d None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:34.533134 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f37350-42e1-4d77-a621-8c0b2676a88d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:34.543891 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 843/1693] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:23:34 2022] PUT /identity/v3/projects/4d72b01a55594e28b979e18a2f68a783/users/b7594c3d3efc43b78bb6afedcc2bcf56/roles/a9895331e9694fa8b2b50908bb057bcb => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:23:34.555093 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8211414-40ea-425a-8476-e991b18080d7 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:34.555593 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8211414-40ea-425a-8476-e991b18080d7 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:34.556352 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8211414-40ea-425a-8476-e991b18080d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:34.589951 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-45f37350-42e1-4d77-a621-8c0b2676a88d None None] MFA Rules not processed for user `7635cf16bf374307bf660f5ae043c909`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:23:34.593087 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-45f37350-42e1-4d77-a621-8c0b2676a88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:34.624068 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:23:34.624700 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-d8211414-40ea-425a-8476-e991b18080d7 None None] MFA Rules not processed for user `b7594c3d3efc43b78bb6afedcc2bcf56`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:23:34.627741 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-d8211414-40ea-425a-8476-e991b18080d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:34.752501 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 851/1694] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:23:34 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 10:23:34.769488 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f37350-42e1-4d77-a621-8c0b2676a88d None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:34.770948 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-45f37350-42e1-4d77-a621-8c0b2676a88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:34.872651 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 844/1695] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:23:34 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:23:34.878514 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8211414-40ea-425a-8476-e991b18080d7 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:34.961649 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f37350-42e1-4d77-a621-8c0b2676a88d None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:34.969087 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28241b9-b1a6-42d4-b1de-895c2acb01cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6c687a38524de0bf23d87ae91d3b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:34.969700 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28241b9-b1a6-42d4-b1de-895c2acb01cd service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:34.970058 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28241b9-b1a6-42d4-b1de-895c2acb01cd service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:34.970477 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28241b9-b1a6-42d4-b1de-895c2acb01cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:34.980141 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:23:34.993234 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28241b9-b1a6-42d4-b1de-895c2acb01cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:34.994772 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28241b9-b1a6-42d4-b1de-895c2acb01cd service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:35.024673 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 852/1696] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:23:34 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 10:23:35.043949 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8211414-40ea-425a-8476-e991b18080d7 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:35.062996 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65378947-f836-4b88-b8a3-36f94f9e49d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:35.064013 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65378947-f836-4b88-b8a3-36f94f9e49d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:35.064699 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65378947-f836-4b88-b8a3-36f94f9e49d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:35.066804 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65378947-f836-4b88-b8a3-36f94f9e49d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:35.068007 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65378947-f836-4b88-b8a3-36f94f9e49d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:35.075436 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65378947-f836-4b88-b8a3-36f94f9e49d4 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:35.169463 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28241b9-b1a6-42d4-b1de-895c2acb01cd service cinder] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:35.171619 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 845/1697] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:23:34 2022] POST /identity/v3/projects => generated 385 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:23:35.191223 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28241b9-b1a6-42d4-b1de-895c2acb01cd service cinder] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:35.273367 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65378947-f836-4b88-b8a3-36f94f9e49d4 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:35.381698 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bb815d-3c5a-48c1-bf4c-07b95fd30127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:35.382869 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb815d-3c5a-48c1-bf4c-07b95fd30127 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:35.384408 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb815d-3c5a-48c1-bf4c-07b95fd30127 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:35.388004 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb815d-3c5a-48c1-bf4c-07b95fd30127 admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:35.390807 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bb815d-3c5a-48c1-bf4c-07b95fd30127 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:35.394341 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bb815d-3c5a-48c1-bf4c-07b95fd30127 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:35.404086 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65378947-f836-4b88-b8a3-36f94f9e49d4 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:35.409236 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2187d9-974a-47ee-a7a8-32c992e50043 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6c687a38524de0bf23d87ae91d3b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:35.409873 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2187d9-974a-47ee-a7a8-32c992e50043 service cinder] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:35.410153 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2187d9-974a-47ee-a7a8-32c992e50043 service cinder] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:35.410421 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2187d9-974a-47ee-a7a8-32c992e50043 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:35.472419 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 853/1698] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:23:35 2022] POST /identity/v3/users => generated 293 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 10:23:35.490240 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bb815d-3c5a-48c1-bf4c-07b95fd30127 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:35.535221 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bb815d-3c5a-48c1-bf4c-07b95fd30127 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:35.572118 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac993805-024d-4af4-af2b-719eb6a3d403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:35.573224 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac993805-024d-4af4-af2b-719eb6a3d403 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:35.573691 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac993805-024d-4af4-af2b-719eb6a3d403 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:35.574160 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac993805-024d-4af4-af2b-719eb6a3d403 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:35.575405 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac993805-024d-4af4-af2b-719eb6a3d403 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:35.580661 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac993805-024d-4af4-af2b-719eb6a3d403 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:35.631820 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 854/1699] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:23:35 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:23:35.644993 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2187d9-974a-47ee-a7a8-32c992e50043 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:35.646487 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2187d9-974a-47ee-a7a8-32c992e50043 service cinder] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:35.656215 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac993805-024d-4af4-af2b-719eb6a3d403 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:35.696363 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 846/1700] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:23:35 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 10:23:35.701492 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac993805-024d-4af4-af2b-719eb6a3d403 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:35.727439 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b445f94-b587-4cc7-a951-3ed667a214c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:35.728071 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b445f94-b587-4cc7-a951-3ed667a214c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:35.728353 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b445f94-b587-4cc7-a951-3ed667a214c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:35.728613 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b445f94-b587-4cc7-a951-3ed667a214c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:35.729563 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b445f94-b587-4cc7-a951-3ed667a214c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:35.730899 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b445f94-b587-4cc7-a951-3ed667a214c2 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:35.835233 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2187d9-974a-47ee-a7a8-32c992e50043 service cinder] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:35.849418 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 855/1701] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:23:35 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:23:35.853296 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2187d9-974a-47ee-a7a8-32c992e50043 service cinder] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:35.867376 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1855e15-44e4-4c20-9d64-7c8aa59c22d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:35.871469 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1855e15-44e4-4c20-9d64-7c8aa59c22d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:35.872153 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1855e15-44e4-4c20-9d64-7c8aa59c22d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:35.879614 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1855e15-44e4-4c20-9d64-7c8aa59c22d0 admin admin] PATH_INFO: `/v3/projects/d39167c72ded46099630d034c2c9c055/users/1a1392a5e5dd4388a6f54bc94036207e/roles/a9895331e9694fa8b2b50908bb057bcb` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:35.945963 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1855e15-44e4-4c20-9d64-7c8aa59c22d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d39167c72ded46099630d034c2c9c055, user_id=1a1392a5e5dd4388a6f54bc94036207e, role_id=a9895331e9694fa8b2b50908bb057bcb)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:35.950166 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1855e15-44e4-4c20-9d64-7c8aa59c22d0 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:35.986573 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 847/1702] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:23:35 2022] PUT /identity/v3/projects/d39167c72ded46099630d034c2c9c055/users/1a1392a5e5dd4388a6f54bc94036207e/roles/a9895331e9694fa8b2b50908bb057bcb => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 10:23:35.999482 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0d8cac-5d0f-426a-b2ae-48304dede1dd None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:35.999773 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0d8cac-5d0f-426a-b2ae-48304dede1dd None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:36.000060 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0d8cac-5d0f-426a-b2ae-48304dede1dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:36.065642 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-1c0d8cac-5d0f-426a-b2ae-48304dede1dd None None] MFA Rules not processed for user `1a1392a5e5dd4388a6f54bc94036207e`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:23:36.067777 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-1c0d8cac-5d0f-426a-b2ae-48304dede1dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:36.114165 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:23:36.290701 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1855e15-44e4-4c20-9d64-7c8aa59c22d0 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:36.293774 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 856/1703] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:23:35 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:23:36.413075 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:23:36.426084 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1855e15-44e4-4c20-9d64-7c8aa59c22d0 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:36.436822 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab72b594-2405-4f1c-ad17-f1d42e59569c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:36.437780 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab72b594-2405-4f1c-ad17-f1d42e59569c admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:36.438214 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab72b594-2405-4f1c-ad17-f1d42e59569c admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:36.438494 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab72b594-2405-4f1c-ad17-f1d42e59569c admin admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:36.439447 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab72b594-2405-4f1c-ad17-f1d42e59569c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:36.443105 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab72b594-2405-4f1c-ad17-f1d42e59569c admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:36.485379 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0d8cac-5d0f-426a-b2ae-48304dede1dd None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:36.486514 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 848/1704] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:23:36 2022] POST /identity/v3/projects => generated 387 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:23:36.503066 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0d8cac-5d0f-426a-b2ae-48304dede1dd None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:36.632954 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5a63fe-af29-4cd3-b110-4dae47f907c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:36.633718 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a63fe-af29-4cd3-b110-4dae47f907c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:36.634077 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a63fe-af29-4cd3-b110-4dae47f907c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:36.634359 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a63fe-af29-4cd3-b110-4dae47f907c7 admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:36.635276 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5a63fe-af29-4cd3-b110-4dae47f907c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:36.639773 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1b1c8b-5fd0-4800-898b-7e599e11afcd None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:36.640090 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1b1c8b-5fd0-4800-898b-7e599e11afcd None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:36.640371 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1b1c8b-5fd0-4800-898b-7e599e11afcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:36.640822 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5a63fe-af29-4cd3-b110-4dae47f907c7 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:36.691515 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 857/1705] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:23:36 2022] POST /identity/v3/users => generated 300 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:23:36.692813 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5a63fe-af29-4cd3-b110-4dae47f907c7 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:36.712322 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5a63fe-af29-4cd3-b110-4dae47f907c7 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:36.718535 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-0d1b1c8b-5fd0-4800-898b-7e599e11afcd None None] MFA Rules not processed for user `83f35273053c4f728a6137a42c63a066`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:23:36.721826 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-0d1b1c8b-5fd0-4800-898b-7e599e11afcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:36.744455 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad84810c-7310-4d87-88a1-640215028cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:36.745894 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84810c-7310-4d87-88a1-640215028cc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:36.747374 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84810c-7310-4d87-88a1-640215028cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:36.747726 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84810c-7310-4d87-88a1-640215028cc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:36.749623 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad84810c-7310-4d87-88a1-640215028cc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:36.755389 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad84810c-7310-4d87-88a1-640215028cc5 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:36.806281 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 858/1706] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:23:36 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:23:36.810508 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad84810c-7310-4d87-88a1-640215028cc5 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:36.842740 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad84810c-7310-4d87-88a1-640215028cc5 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:36.855442 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bf6eb1-01ee-40fe-a70e-65f011aeb7d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:36.856366 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf6eb1-01ee-40fe-a70e-65f011aeb7d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:36.857894 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf6eb1-01ee-40fe-a70e-65f011aeb7d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:36.858775 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf6eb1-01ee-40fe-a70e-65f011aeb7d1 admin admin] PATH_INFO: `/v3/projects/9e0e946a314f4326968c88af0d3a9b83/users/b8feaa158c0c43a9bbefb600818048f8/roles/89ca30cbbb634be8a96e9921aa56626b` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:36.899641 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bf6eb1-01ee-40fe-a70e-65f011aeb7d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e0e946a314f4326968c88af0d3a9b83, user_id=b8feaa158c0c43a9bbefb600818048f8, role_id=89ca30cbbb634be8a96e9921aa56626b)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:36.907514 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bf6eb1-01ee-40fe-a70e-65f011aeb7d1 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:36.949579 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 859/1707] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:23:36 2022] PUT /identity/v3/projects/9e0e946a314f4326968c88af0d3a9b83/users/b8feaa158c0c43a9bbefb600818048f8/roles/89ca30cbbb634be8a96e9921aa56626b => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:23:36.954254 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bf6eb1-01ee-40fe-a70e-65f011aeb7d1 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:36.982206 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 849/1708] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:23:36 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 10:23:36.983611 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae63bfea-3ad6-4b25-82dd-1c61d1270e39 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:36.983902 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae63bfea-3ad6-4b25-82dd-1c61d1270e39 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:36.984176 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae63bfea-3ad6-4b25-82dd-1c61d1270e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:37.006746 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-ae63bfea-3ad6-4b25-82dd-1c61d1270e39 None None] MFA Rules not processed for user `83f35273053c4f728a6137a42c63a066`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:23:37.007987 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-ae63bfea-3ad6-4b25-82dd-1c61d1270e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:37.095972 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 850/1709] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:23:36 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:23:37.111055 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae63bfea-3ad6-4b25-82dd-1c61d1270e39 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:37.113872 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-ae63bfea-3ad6-4b25-82dd-1c61d1270e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:37.149119 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bf6eb1-01ee-40fe-a70e-65f011aeb7d1 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:37.161342 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e5bc36-8f91-49ff-b8bc-1eb3633a88f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:37.167448 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e5bc36-8f91-49ff-b8bc-1eb3633a88f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:37.167924 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e5bc36-8f91-49ff-b8bc-1eb3633a88f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:37.168971 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e5bc36-8f91-49ff-b8bc-1eb3633a88f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:37.170729 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e5bc36-8f91-49ff-b8bc-1eb3633a88f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:37.174068 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e5bc36-8f91-49ff-b8bc-1eb3633a88f5 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:37.203766 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 860/1710] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:23:36 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:23:37.206036 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e5bc36-8f91-49ff-b8bc-1eb3633a88f5 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:37.220994 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:23:37.240799 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e5bc36-8f91-49ff-b8bc-1eb3633a88f5 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:37.257410 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eb6cb9-9f04-4e72-ba16-f433080d88fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:37.258126 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb6cb9-9f04-4e72-ba16-f433080d88fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:37.258406 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb6cb9-9f04-4e72-ba16-f433080d88fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:37.258678 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb6cb9-9f04-4e72-ba16-f433080d88fe admin admin] PATH_INFO: `/v3/projects/9e0e946a314f4326968c88af0d3a9b83/users/b8feaa158c0c43a9bbefb600818048f8/roles/89ca30cbbb634be8a96e9921aa56626b` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:37.260628 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eb6cb9-9f04-4e72-ba16-f433080d88fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e0e946a314f4326968c88af0d3a9b83, user_id=b8feaa158c0c43a9bbefb600818048f8, role_id=89ca30cbbb634be8a96e9921aa56626b)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:37.263824 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eb6cb9-9f04-4e72-ba16-f433080d88fe admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:37.301882 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 861/1711] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:23:37 2022] PUT /identity/v3/projects/9e0e946a314f4326968c88af0d3a9b83/users/b8feaa158c0c43a9bbefb600818048f8/roles/89ca30cbbb634be8a96e9921aa56626b => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:23:37.310140 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7387dcc-47be-479b-8318-7a02debd9206 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:37.312052 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7387dcc-47be-479b-8318-7a02debd9206 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:37.312353 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7387dcc-47be-479b-8318-7a02debd9206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:37.358762 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae63bfea-3ad6-4b25-82dd-1c61d1270e39 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:37.372033 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:23:37.387316 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-e7387dcc-47be-479b-8318-7a02debd9206 None None] MFA Rules not processed for user `b8feaa158c0c43a9bbefb600818048f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:23:37.390647 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-e7387dcc-47be-479b-8318-7a02debd9206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:37.546938 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd7f374-e547-424c-ba48-becbe5ae69b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb863beaaa9f495c8b64655996c061f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:37.549426 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7f374-e547-424c-ba48-becbe5ae69b2 service nova] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:37.550617 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7f374-e547-424c-ba48-becbe5ae69b2 service nova] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:37.551241 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7f374-e547-424c-ba48-becbe5ae69b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:37.620365 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 862/1712] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:23:37 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:23:37.699331 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd7f374-e547-424c-ba48-becbe5ae69b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:37.703248 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd7f374-e547-424c-ba48-becbe5ae69b2 service nova] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:37.720473 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7387dcc-47be-479b-8318-7a02debd9206 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:37.739097 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 851/1713] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:23:37 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 618 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:23:37.863957 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7387dcc-47be-479b-8318-7a02debd9206 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:37.877635 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50f87b7-1c75-42c7-b33f-fce3057ae326 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6c687a38524de0bf23d87ae91d3b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:37.878305 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f87b7-1c75-42c7-b33f-fce3057ae326 service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:37.879700 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f87b7-1c75-42c7-b33f-fce3057ae326 service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:37.879700 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f87b7-1c75-42c7-b33f-fce3057ae326 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:37.907193 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50f87b7-1c75-42c7-b33f-fce3057ae326 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:37.910987 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50f87b7-1c75-42c7-b33f-fce3057ae326 service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:37.936923 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 863/1714] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:23:37 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 10:23:38.765404 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9701ea59-37c1-459a-979d-f5f2856cb882 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:38.765904 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9701ea59-37c1-459a-979d-f5f2856cb882 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:38.765978 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9701ea59-37c1-459a-979d-f5f2856cb882 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:38.767435 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 852/1715] 10.222.0.36 () {54 vars in 912 bytes} [Tue Aug 9 10:23:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:23:38.781995 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baa1354-01d5-4bc6-907a-9d17bb08b467 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:38.782603 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baa1354-01d5-4bc6-907a-9d17bb08b467 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:38.782603 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baa1354-01d5-4bc6-907a-9d17bb08b467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:38.891647 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-1baa1354-01d5-4bc6-907a-9d17bb08b467 None None] MFA Rules not processed for user `9169847a16764da3a2a1dbb5f5f56438`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:23:38.892896 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-1baa1354-01d5-4bc6-907a-9d17bb08b467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:38.915003 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397bd61f-4c77-4254-9f0d-eb07a561116f None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:38.915602 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397bd61f-4c77-4254-9f0d-eb07a561116f None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:38.915602 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397bd61f-4c77-4254-9f0d-eb07a561116f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:38.969146 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-397bd61f-4c77-4254-9f0d-eb07a561116f None None] MFA Rules not processed for user `3d39820fab6041b9b655c54ce74e7e4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:23:38.970416 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-397bd61f-4c77-4254-9f0d-eb07a561116f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:39.052898 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 864/1716] 10.222.0.36 () {58 vars in 1009 bytes} [Tue Aug 9 10:23:38 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:23:39.069096 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baa1354-01d5-4bc6-907a-9d17bb08b467 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:39.080847 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-1baa1354-01d5-4bc6-907a-9d17bb08b467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:39.105094 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baa1354-01d5-4bc6-907a-9d17bb08b467 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:39.116009 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070ce1b7-4b64-4604-aab0-2ead4caeb8e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:39.117236 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ce1b7-4b64-4604-aab0-2ead4caeb8e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:39.119385 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ce1b7-4b64-4604-aab0-2ead4caeb8e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:39.119963 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070ce1b7-4b64-4604-aab0-2ead4caeb8e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:39.124730 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 853/1717] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:23:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 10:23:39.163178 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070ce1b7-4b64-4604-aab0-2ead4caeb8e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:39.166139 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070ce1b7-4b64-4604-aab0-2ead4caeb8e6 service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:39.191754 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 865/1718] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:23:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:23:39.284525 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397bd61f-4c77-4254-9f0d-eb07a561116f None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:39.300262 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397bd61f-4c77-4254-9f0d-eb07a561116f None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:39.306398 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e07744-f153-450a-a039-9c3c569cf124 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6c687a38524de0bf23d87ae91d3b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:39.307326 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e07744-f153-450a-a039-9c3c569cf124 service cinder] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:39.308219 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e07744-f153-450a-a039-9c3c569cf124 service cinder] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:39.308691 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e07744-f153-450a-a039-9c3c569cf124 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:39.416228 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:23:39.441445 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e07744-f153-450a-a039-9c3c569cf124 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:39.443641 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e07744-f153-450a-a039-9c3c569cf124 service cinder] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:39.479344 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 854/1719] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:23:39 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:23:40.191492 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec9999-611d-48d7-8848-1a8f47f572db None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:40.198118 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec9999-611d-48d7-8848-1a8f47f572db None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:40.198607 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec9999-611d-48d7-8848-1a8f47f572db None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:40.208061 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 866/1720] 10.222.0.36 () {54 vars in 961 bytes} [Tue Aug 9 10:23:40 2022] GET /identity => generated 270 bytes in 20 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:23:40.234435 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89308b9a-9259-4eb5-b1cc-db13b3e8a8ee None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:40.234923 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89308b9a-9259-4eb5-b1cc-db13b3e8a8ee None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:40.235117 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89308b9a-9259-4eb5-b1cc-db13b3e8a8ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:40.285712 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-89308b9a-9259-4eb5-b1cc-db13b3e8a8ee None None] MFA Rules not processed for user `c4d3b6a332394adf9e1b81ee9c171c48`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:23:40.288982 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-89308b9a-9259-4eb5-b1cc-db13b3e8a8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:40.384663 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a3aa75-5fe7-40c6-91b1-2f0f479c604a None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:40.386139 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a3aa75-5fe7-40c6-91b1-2f0f479c604a None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:40.387952 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a3aa75-5fe7-40c6-91b1-2f0f479c604a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:40.409759 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:23:40.464071 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-b5a3aa75-5fe7-40c6-91b1-2f0f479c604a None None] MFA Rules not processed for user `83f35273053c4f728a6137a42c63a066`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:23:40.467724 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-b5a3aa75-5fe7-40c6-91b1-2f0f479c604a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:40.485622 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 855/1721] 10.222.0.36 () {58 vars in 1058 bytes} [Tue Aug 9 10:23:40 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:23:40.507023 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89308b9a-9259-4eb5-b1cc-db13b3e8a8ee None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:40.508738 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 867/1722] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:23:40 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 10:23:40.526887 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89308b9a-9259-4eb5-b1cc-db13b3e8a8ee None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:40.536234 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd2051f-9ccf-4210-94b8-3d12805a89e8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4d3b6a332394adf9e1b81ee9c171c48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:40.537439 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd2051f-9ccf-4210-94b8-3d12805a89e8 service placement] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:40.538069 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd2051f-9ccf-4210-94b8-3d12805a89e8 service placement] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:40.538606 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd2051f-9ccf-4210-94b8-3d12805a89e8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:40.545866 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-7fd2051f-9ccf-4210-94b8-3d12805a89e8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:40.577258 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd2051f-9ccf-4210-94b8-3d12805a89e8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:40.580094 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd2051f-9ccf-4210-94b8-3d12805a89e8 service placement] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:40.615288 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 856/1723] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:23:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:23:40.621808 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef72eecb-67ba-4269-a099-e3b9af2d842d None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:40.622258 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef72eecb-67ba-4269-a099-e3b9af2d842d None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:40.624428 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef72eecb-67ba-4269-a099-e3b9af2d842d None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:40.627205 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 868/1724] 10.222.0.36 () {54 vars in 912 bytes} [Tue Aug 9 10:23:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:23:40.642865 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2622371-f444-4530-b850-566819cc41e9 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:40.643349 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2622371-f444-4530-b850-566819cc41e9 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:40.643867 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2622371-f444-4530-b850-566819cc41e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:40.670396 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-b2622371-f444-4530-b850-566819cc41e9 None None] MFA Rules not processed for user `9169847a16764da3a2a1dbb5f5f56438`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:23:40.671885 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-b2622371-f444-4530-b850-566819cc41e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:40.680288 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 857/1725] 10.222.0.36 () {58 vars in 1009 bytes} [Tue Aug 9 10:23:40 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:23:40.698786 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef72eecb-67ba-4269-a099-e3b9af2d842d None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:40.713389 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef72eecb-67ba-4269-a099-e3b9af2d842d None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:40.719182 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3789c47d-a0a2-4c5d-972d-5c081a210820 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:40.720050 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3789c47d-a0a2-4c5d-972d-5c081a210820 service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:40.720545 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3789c47d-a0a2-4c5d-972d-5c081a210820 service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:40.721027 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3789c47d-a0a2-4c5d-972d-5c081a210820 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:40.735038 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3789c47d-a0a2-4c5d-972d-5c081a210820 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:40.739898 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3789c47d-a0a2-4c5d-972d-5c081a210820 service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:40.755580 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 869/1726] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:23:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:23:42.557995 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2622371-f444-4530-b850-566819cc41e9 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:42.560228 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-b2622371-f444-4530-b850-566819cc41e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:42.853545 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2622371-f444-4530-b850-566819cc41e9 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:42.871651 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f6d680-7446-4248-a4d6-2233eb8317e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:42.873091 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f6d680-7446-4248-a4d6-2233eb8317e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:42.874644 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f6d680-7446-4248-a4d6-2233eb8317e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:42.875172 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f6d680-7446-4248-a4d6-2233eb8317e6 admin admin] PATH_INFO: `/v3/users/4d8c04e47f7042bebb5564434b6c4389` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:42.877368 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f6d680-7446-4248-a4d6-2233eb8317e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d8c04e47f7042bebb5564434b6c4389)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:42.882237 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f6d680-7446-4248-a4d6-2233eb8317e6 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:43.044744 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-c1f6d680-7446-4248-a4d6-2233eb8317e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d8c04e47f7042bebb5564434b6c4389'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:23:43.106111 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-c1f6d680-7446-4248-a4d6-2233eb8317e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d8c04e47f7042bebb5564434b6c4389'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:23:43.115412 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:23:43.130891 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-c1f6d680-7446-4248-a4d6-2233eb8317e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d8c04e47f7042bebb5564434b6c4389'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:23:43.133050 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-c1f6d680-7446-4248-a4d6-2233eb8317e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d8c04e47f7042bebb5564434b6c4389'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:23:43.155369 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-c1f6d680-7446-4248-a4d6-2233eb8317e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d8c04e47f7042bebb5564434b6c4389'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:23:43.166874 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 858/1727] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:23:42 2022] DELETE /identity/v3/users/4d8c04e47f7042bebb5564434b6c4389 => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:23:43.168245 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c31d8-3e22-4f28-b6b8-088fff0f0f5e None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:43.169131 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c31d8-3e22-4f28-b6b8-088fff0f0f5e None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:43.169701 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c31d8-3e22-4f28-b6b8-088fff0f0f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:43.221519 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-da0c31d8-3e22-4f28-b6b8-088fff0f0f5e None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:23:43.225144 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-da0c31d8-3e22-4f28-b6b8-088fff0f0f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:43.441451 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 870/1728] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:23:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 10:23:43.453357 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f6d680-7446-4248-a4d6-2233eb8317e6 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:43.455650 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-c1f6d680-7446-4248-a4d6-2233eb8317e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:43.662897 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f6d680-7446-4248-a4d6-2233eb8317e6 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:43.670238 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a301b-85f9-43b9-8640-18c5658f7e58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:43.672015 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a301b-85f9-43b9-8640-18c5658f7e58 service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:43.672710 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a301b-85f9-43b9-8640-18c5658f7e58 service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:43.673377 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a301b-85f9-43b9-8640-18c5658f7e58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:43.708766 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6a301b-85f9-43b9-8640-18c5658f7e58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:43.715933 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6a301b-85f9-43b9-8640-18c5658f7e58 service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:43.770692 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 859/1729] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:23:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 10:23:44.631578 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0c31d8-3e22-4f28-b6b8-088fff0f0f5e None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:44.634080 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-da0c31d8-3e22-4f28-b6b8-088fff0f0f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:44.668789 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a301b-85f9-43b9-8640-18c5658f7e58 service neutron] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:44.671127 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-6d6a301b-85f9-43b9-8640-18c5658f7e58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:44.683634 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0c31d8-3e22-4f28-b6b8-088fff0f0f5e None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:44.696125 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555b353e-8226-4195-afb2-a11301cefdbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:44.698887 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555b353e-8226-4195-afb2-a11301cefdbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:44.699356 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555b353e-8226-4195-afb2-a11301cefdbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:44.702039 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555b353e-8226-4195-afb2-a11301cefdbd admin admin] PATH_INFO: `/v3/projects/76d1ed073e5143abaaa1ab76994f1ac9` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:44.704565 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555b353e-8226-4195-afb2-a11301cefdbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=76d1ed073e5143abaaa1ab76994f1ac9)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:44.708419 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555b353e-8226-4195-afb2-a11301cefdbd admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:44.774242 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-555b353e-8226-4195-afb2-a11301cefdbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76d1ed073e5143abaaa1ab76994f1ac9', 'request_id': 'req-555b353e-8226-4195-afb2-a11301cefdbd'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:23:44.784328 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-555b353e-8226-4195-afb2-a11301cefdbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76d1ed073e5143abaaa1ab76994f1ac9', 'request_id': 'req-555b353e-8226-4195-afb2-a11301cefdbd'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:23:44.794609 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-555b353e-8226-4195-afb2-a11301cefdbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76d1ed073e5143abaaa1ab76994f1ac9', 'request_id': 'req-555b353e-8226-4195-afb2-a11301cefdbd'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:23:44.814765 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-555b353e-8226-4195-afb2-a11301cefdbd admin admin] The token cache is being invalidate because project 76d1ed073e5143abaaa1ab76994f1ac9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:23:44.815082 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-555b353e-8226-4195-afb2-a11301cefdbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:23:44.816174 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-555b353e-8226-4195-afb2-a11301cefdbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:23:44.818948 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 871/1730] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:23:44 2022] DELETE /identity/v3/projects/76d1ed073e5143abaaa1ab76994f1ac9 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:23:44.824060 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555b353e-8226-4195-afb2-a11301cefdbd admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:44.827092 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-555b353e-8226-4195-afb2-a11301cefdbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:44.840794 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a301b-85f9-43b9-8640-18c5658f7e58 service neutron] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:44.986454 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09beff1d-8929-4d76-a7df-883f886ad31e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6c687a38524de0bf23d87ae91d3b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:44.987078 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09beff1d-8929-4d76-a7df-883f886ad31e service cinder] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:44.987366 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09beff1d-8929-4d76-a7df-883f886ad31e service cinder] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:44.987638 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09beff1d-8929-4d76-a7df-883f886ad31e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:44.993054 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-09beff1d-8929-4d76-a7df-883f886ad31e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:45.100815 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555b353e-8226-4195-afb2-a11301cefdbd admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:45.120425 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a82c9f-a46f-41a5-ab44-e6b46d66f918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:45.123182 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a82c9f-a46f-41a5-ab44-e6b46d66f918 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:45.137335 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a82c9f-a46f-41a5-ab44-e6b46d66f918 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:45.137925 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a82c9f-a46f-41a5-ab44-e6b46d66f918 admin admin] PATH_INFO: `/v3/users/886a0b2bebd447da80875fe374df61a3` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:45.139834 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a82c9f-a46f-41a5-ab44-e6b46d66f918 admin admin] RBAC: Authorizing `identity:delete_user(user_id=886a0b2bebd447da80875fe374df61a3)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:45.144021 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a82c9f-a46f-41a5-ab44-e6b46d66f918 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:45.151662 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:23:45.192512 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:23:45.206046 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09beff1d-8929-4d76-a7df-883f886ad31e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:45.209227 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09beff1d-8929-4d76-a7df-883f886ad31e service cinder] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:45.277047 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 860/1731] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:23:44 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 609 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:23:45.280208 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09beff1d-8929-4d76-a7df-883f886ad31e service cinder] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:45.295064 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-27a82c9f-a46f-41a5-ab44-e6b46d66f918 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '886a0b2bebd447da80875fe374df61a3'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:23:45.296443 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-09beff1d-8929-4d76-a7df-883f886ad31e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:45.340088 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-27a82c9f-a46f-41a5-ab44-e6b46d66f918 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '886a0b2bebd447da80875fe374df61a3'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:23:45.359881 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09beff1d-8929-4d76-a7df-883f886ad31e service cinder] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:45.379947 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38831c3e-25d2-424d-9dd2-bcad1d5c8c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:45.380649 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38831c3e-25d2-424d-9dd2-bcad1d5c8c25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:45.380932 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38831c3e-25d2-424d-9dd2-bcad1d5c8c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:45.383459 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38831c3e-25d2-424d-9dd2-bcad1d5c8c25 admin admin] PATH_INFO: `/v3/users/c1dd0d17435a4925a69b1520003946ee` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:45.387237 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38831c3e-25d2-424d-9dd2-bcad1d5c8c25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1dd0d17435a4925a69b1520003946ee)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:45.393419 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38831c3e-25d2-424d-9dd2-bcad1d5c8c25 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:45.393999 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-27a82c9f-a46f-41a5-ab44-e6b46d66f918 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '886a0b2bebd447da80875fe374df61a3'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:23:45.395843 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-27a82c9f-a46f-41a5-ab44-e6b46d66f918 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '886a0b2bebd447da80875fe374df61a3'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:23:45.440442 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-27a82c9f-a46f-41a5-ab44-e6b46d66f918 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '886a0b2bebd447da80875fe374df61a3'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:23:45.472698 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 872/1732] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:23:44 2022] DELETE /identity/v3/users/886a0b2bebd447da80875fe374df61a3 => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:23:45.487704 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf5127f-5211-42fd-8f90-fb9d3e602bd3 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:45.488152 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf5127f-5211-42fd-8f90-fb9d3e602bd3 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:45.488451 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf5127f-5211-42fd-8f90-fb9d3e602bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:45.672310 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-38831c3e-25d2-424d-9dd2-bcad1d5c8c25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1dd0d17435a4925a69b1520003946ee'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:23:45.676485 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-2bf5127f-5211-42fd-8f90-fb9d3e602bd3 None None] MFA Rules not processed for user `cedc4d6c59c44c6d8fb7179070db5e91`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:23:45.681989 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-2bf5127f-5211-42fd-8f90-fb9d3e602bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:45.773233 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-38831c3e-25d2-424d-9dd2-bcad1d5c8c25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1dd0d17435a4925a69b1520003946ee'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:23:45.813365 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-38831c3e-25d2-424d-9dd2-bcad1d5c8c25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1dd0d17435a4925a69b1520003946ee'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:23:45.815813 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-38831c3e-25d2-424d-9dd2-bcad1d5c8c25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1dd0d17435a4925a69b1520003946ee'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:23:45.854918 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-38831c3e-25d2-424d-9dd2-bcad1d5c8c25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1dd0d17435a4925a69b1520003946ee'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:23:45.897988 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 861/1733] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:23:45 2022] DELETE /identity/v3/users/c1dd0d17435a4925a69b1520003946ee => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:23:45.906940 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc8b49e-591a-422e-97ce-449055a97369 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:45.908985 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc8b49e-591a-422e-97ce-449055a97369 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:45.909835 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc8b49e-591a-422e-97ce-449055a97369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:45.953484 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 873/1734] 10.222.0.36 () {58 vars in 1009 bytes} [Tue Aug 9 10:23:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 480 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:23:46.020414 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-bbc8b49e-591a-422e-97ce-449055a97369 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:23:46.022903 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-bbc8b49e-591a-422e-97ce-449055a97369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:46.216736 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 862/1735] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:23:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:23:46.259354 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf5127f-5211-42fd-8f90-fb9d3e602bd3 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:46.262594 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-2bf5127f-5211-42fd-8f90-fb9d3e602bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:46.310832 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc8b49e-591a-422e-97ce-449055a97369 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:46.312536 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-bbc8b49e-591a-422e-97ce-449055a97369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:46.423324 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf5127f-5211-42fd-8f90-fb9d3e602bd3 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:46.462886 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:23:46.525675 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:23:46.602303 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc8b49e-591a-422e-97ce-449055a97369 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:46.605882 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b137347-6381-4a39-9e5c-9031ad3173a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:46.606456 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b137347-6381-4a39-9e5c-9031ad3173a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:46.606958 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b137347-6381-4a39-9e5c-9031ad3173a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:46.607709 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b137347-6381-4a39-9e5c-9031ad3173a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:46.626634 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38325708-a53e-4c8e-8168-0e5a980b875f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '841c5dbaae774944b637c533ebd75b29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:46.627273 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38325708-a53e-4c8e-8168-0e5a980b875f service swift] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:46.627555 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38325708-a53e-4c8e-8168-0e5a980b875f service swift] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:46.627831 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38325708-a53e-4c8e-8168-0e5a980b875f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:46.640206 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b137347-6381-4a39-9e5c-9031ad3173a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:46.641704 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b137347-6381-4a39-9e5c-9031ad3173a0 service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:46.696663 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 874/1736] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:23:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:23:46.774765 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38325708-a53e-4c8e-8168-0e5a980b875f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:46.778460 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38325708-a53e-4c8e-8168-0e5a980b875f service swift] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:46.790033 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 863/1737] 10.222.0.36 () {60 vars in 1384 bytes} [Tue Aug 9 10:23:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 09 10:23:47.891906 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210d099-2281-47fd-896b-8ed0575746cc None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:47.892487 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210d099-2281-47fd-896b-8ed0575746cc None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:47.892487 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210d099-2281-47fd-896b-8ed0575746cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:48.001026 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-d210d099-2281-47fd-896b-8ed0575746cc None None] MFA Rules not processed for user `efd69dedc75842f495bde0c20799a340`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:23:48.002313 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-d210d099-2281-47fd-896b-8ed0575746cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:48.265654 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 875/1738] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:23:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:23:48.279461 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38325708-a53e-4c8e-8168-0e5a980b875f service swift] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:48.281594 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-38325708-a53e-4c8e-8168-0e5a980b875f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:48.433547 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38325708-a53e-4c8e-8168-0e5a980b875f service swift] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:48.442046 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d0c330-1d17-46af-9c4f-523c62286c89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb863beaaa9f495c8b64655996c061f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:48.443015 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d0c330-1d17-46af-9c4f-523c62286c89 service nova] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:48.443567 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d0c330-1d17-46af-9c4f-523c62286c89 service nova] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:48.444034 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d0c330-1d17-46af-9c4f-523c62286c89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:48.458613 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d0c330-1d17-46af-9c4f-523c62286c89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:48.460783 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d0c330-1d17-46af-9c4f-523c62286c89 service nova] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:48.511757 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 864/1739] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:23:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:23:48.831628 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d210d099-2281-47fd-896b-8ed0575746cc None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:48.833704 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-d210d099-2281-47fd-896b-8ed0575746cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:48.889644 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d210d099-2281-47fd-896b-8ed0575746cc None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:48.904717 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140276ad-4a7a-49e9-a194-d09f07cf63db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:48.910112 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140276ad-4a7a-49e9-a194-d09f07cf63db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:48.910948 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140276ad-4a7a-49e9-a194-d09f07cf63db admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:48.917783 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140276ad-4a7a-49e9-a194-d09f07cf63db admin admin] PATH_INFO: `/v3/users/b7594c3d3efc43b78bb6afedcc2bcf56` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:48.920347 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140276ad-4a7a-49e9-a194-d09f07cf63db admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7594c3d3efc43b78bb6afedcc2bcf56)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:48.929456 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140276ad-4a7a-49e9-a194-d09f07cf63db admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:49.108989 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-140276ad-4a7a-49e9-a194-d09f07cf63db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7594c3d3efc43b78bb6afedcc2bcf56'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:23:49.160715 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-140276ad-4a7a-49e9-a194-d09f07cf63db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7594c3d3efc43b78bb6afedcc2bcf56'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:23:49.186074 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-140276ad-4a7a-49e9-a194-d09f07cf63db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7594c3d3efc43b78bb6afedcc2bcf56'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:23:49.186889 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-140276ad-4a7a-49e9-a194-d09f07cf63db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7594c3d3efc43b78bb6afedcc2bcf56'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:23:49.207879 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-140276ad-4a7a-49e9-a194-d09f07cf63db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7594c3d3efc43b78bb6afedcc2bcf56'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:23:49.230240 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 876/1740] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:23:48 2022] DELETE /identity/v3/users/b7594c3d3efc43b78bb6afedcc2bcf56 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:23:49.235314 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b268e3-7cfe-468c-90d8-848af81789d7 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:49.236166 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b268e3-7cfe-468c-90d8-848af81789d7 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:49.236667 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b268e3-7cfe-468c-90d8-848af81789d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:49.287789 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-38b268e3-7cfe-468c-90d8-848af81789d7 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:23:49.292249 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-38b268e3-7cfe-468c-90d8-848af81789d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:49.554935 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 865/1741] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:23:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:23:49.704620 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140276ad-4a7a-49e9-a194-d09f07cf63db admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:49.711957 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-140276ad-4a7a-49e9-a194-d09f07cf63db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:49.736366 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b268e3-7cfe-468c-90d8-848af81789d7 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:49.739494 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-38b268e3-7cfe-468c-90d8-848af81789d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:49.780762 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140276ad-4a7a-49e9-a194-d09f07cf63db admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:49.787001 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55956725-2293-4b55-a1b7-f211f702902b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:49.788314 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55956725-2293-4b55-a1b7-f211f702902b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:49.789117 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55956725-2293-4b55-a1b7-f211f702902b admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:49.789789 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55956725-2293-4b55-a1b7-f211f702902b admin admin] PATH_INFO: `/v3/projects/00262a9e53e24ae8913b0c740faae6c9` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:49.805735 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55956725-2293-4b55-a1b7-f211f702902b admin admin] RBAC: Authorizing `identity:delete_project(project_id=00262a9e53e24ae8913b0c740faae6c9)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:49.810063 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55956725-2293-4b55-a1b7-f211f702902b admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:49.816316 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:23:49.847232 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:23:49.955365 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b268e3-7cfe-468c-90d8-848af81789d7 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:49.973074 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-55956725-2293-4b55-a1b7-f211f702902b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00262a9e53e24ae8913b0c740faae6c9', 'request_id': 'req-55956725-2293-4b55-a1b7-f211f702902b'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:23:49.991514 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-55956725-2293-4b55-a1b7-f211f702902b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00262a9e53e24ae8913b0c740faae6c9', 'request_id': 'req-55956725-2293-4b55-a1b7-f211f702902b'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:23:50.010162 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-55956725-2293-4b55-a1b7-f211f702902b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00262a9e53e24ae8913b0c740faae6c9', 'request_id': 'req-55956725-2293-4b55-a1b7-f211f702902b'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:23:50.034467 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-55956725-2293-4b55-a1b7-f211f702902b admin admin] The token cache is being invalidate because project 00262a9e53e24ae8913b0c740faae6c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:23:50.034960 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-55956725-2293-4b55-a1b7-f211f702902b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:23:50.039008 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-55956725-2293-4b55-a1b7-f211f702902b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:23:50.046475 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 877/1742] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:23:49 2022] DELETE /identity/v3/projects/00262a9e53e24ae8913b0c740faae6c9 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:23:50.048141 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae83a493-2308-48ad-859f-2e388682e7bf None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:50.050764 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae83a493-2308-48ad-859f-2e388682e7bf None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:50.051318 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae83a493-2308-48ad-859f-2e388682e7bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:50.108841 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-ae83a493-2308-48ad-859f-2e388682e7bf None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:23:50.112271 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-ae83a493-2308-48ad-859f-2e388682e7bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:50.123729 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76ab1e8-6e37-4b03-94b0-9be0e3747c9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:50.123729 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ab1e8-6e37-4b03-94b0-9be0e3747c9b service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:50.124052 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ab1e8-6e37-4b03-94b0-9be0e3747c9b service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:50.124499 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ab1e8-6e37-4b03-94b0-9be0e3747c9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:50.130935 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-c76ab1e8-6e37-4b03-94b0-9be0e3747c9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:50.317310 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76ab1e8-6e37-4b03-94b0-9be0e3747c9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:50.321420 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76ab1e8-6e37-4b03-94b0-9be0e3747c9b service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:50.368259 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 866/1743] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:23:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 633 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 10:23:50.395970 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8772a7-a12d-419e-be83-3e5801e34895 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:50.396419 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8772a7-a12d-419e-be83-3e5801e34895 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:50.396705 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8772a7-a12d-419e-be83-3e5801e34895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:50.400606 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 878/1744] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:23:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:23:50.443363 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-3d8772a7-a12d-419e-be83-3e5801e34895 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:23:50.448446 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-3d8772a7-a12d-419e-be83-3e5801e34895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:50.474473 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1200e6-966a-4319-ade1-47747125e4ad None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:50.474839 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1200e6-966a-4319-ade1-47747125e4ad None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:50.475125 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1200e6-966a-4319-ade1-47747125e4ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:50.488879 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 867/1745] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:23:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:23:50.489870 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8772a7-a12d-419e-be83-3e5801e34895 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:50.530896 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8772a7-a12d-419e-be83-3e5801e34895 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:50.537898 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-7f1200e6-966a-4319-ade1-47747125e4ad None None] MFA Rules not processed for user `9169847a16764da3a2a1dbb5f5f56438`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:23:50.544154 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-7f1200e6-966a-4319-ade1-47747125e4ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:50.551286 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9db1b1-371c-40fd-ad8e-523144a7dbf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:50.551930 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9db1b1-371c-40fd-ad8e-523144a7dbf0 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:50.552215 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9db1b1-371c-40fd-ad8e-523144a7dbf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:50.552474 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9db1b1-371c-40fd-ad8e-523144a7dbf0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:50.553144 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9db1b1-371c-40fd-ad8e-523144a7dbf0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:23:50.553448 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9db1b1-371c-40fd-ad8e-523144a7dbf0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:50.555147 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9db1b1-371c-40fd-ad8e-523144a7dbf0 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:50.571713 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 879/1746] 10.222.0.30 () {58 vars in 1015 bytes} [Tue Aug 9 10:23:50 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:23:50.600642 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 868/1747] 10.222.0.36 () {58 vars in 1153 bytes} [Tue Aug 9 10:23:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:23:50.605398 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1200e6-966a-4319-ade1-47747125e4ad None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:50.625817 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1200e6-966a-4319-ade1-47747125e4ad None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:50.649092 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9db1b1-371c-40fd-ad8e-523144a7dbf0 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:50.656225 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-fb9db1b1-371c-40fd-ad8e-523144a7dbf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:50.663437 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7f76ae-c45b-48bd-a66c-750aa1efa8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:50.664091 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f76ae-c45b-48bd-a66c-750aa1efa8fa admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:50.664361 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f76ae-c45b-48bd-a66c-750aa1efa8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:50.664640 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f76ae-c45b-48bd-a66c-750aa1efa8fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:50.672731 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7f76ae-c45b-48bd-a66c-750aa1efa8fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:50.681506 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7f76ae-c45b-48bd-a66c-750aa1efa8fa admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:50.695583 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9db1b1-371c-40fd-ad8e-523144a7dbf0 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:50.718184 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce881eb6-2766-4a99-9f58-9b528e582e51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:50.718810 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce881eb6-2766-4a99-9f58-9b528e582e51 service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:50.719152 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce881eb6-2766-4a99-9f58-9b528e582e51 service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:50.719433 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce881eb6-2766-4a99-9f58-9b528e582e51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:50.796473 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce881eb6-2766-4a99-9f58-9b528e582e51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:50.797926 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce881eb6-2766-4a99-9f58-9b528e582e51 service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:50.842548 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 869/1748] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:23:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:23:50.847642 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a74f16-8abb-40b0-a673-78dbbde97461 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:50.847933 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a74f16-8abb-40b0-a673-78dbbde97461 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:50.852356 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a74f16-8abb-40b0-a673-78dbbde97461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:50.867703 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 880/1749] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:23:50 2022] POST /identity/v3/projects => generated 407 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:23:50.871636 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d25d5-2e12-48c2-9f6f-2b980a440eb1 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:50.874841 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d25d5-2e12-48c2-9f6f-2b980a440eb1 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:50.876092 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d25d5-2e12-48c2-9f6f-2b980a440eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:50.985672 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-dc2d25d5-2e12-48c2-9f6f-2b980a440eb1 None None] MFA Rules not processed for user `e475e2e663794a3c83cfc9e82947a70f`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:23:50.992064 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-dc2d25d5-2e12-48c2-9f6f-2b980a440eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:50.997886 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-46a74f16-8abb-40b0-a673-78dbbde97461 None None] MFA Rules not processed for user `74925532a3b64d21b4e861ec70bc4345`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:23:51.000351 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-46a74f16-8abb-40b0-a673-78dbbde97461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:51.115545 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:23:51.193634 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 870/1750] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:23:50 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:23:51.197194 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a74f16-8abb-40b0-a673-78dbbde97461 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:51.276849 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 881/1751] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:23:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 407 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:23:51.279068 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2d25d5-2e12-48c2-9f6f-2b980a440eb1 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:51.287099 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-dc2d25d5-2e12-48c2-9f6f-2b980a440eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:51.296675 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:23:51.357339 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a74f16-8abb-40b0-a673-78dbbde97461 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:51.370978 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f2afc3-5f3e-4b08-be24-b801f16fa289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:51.371732 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f2afc3-5f3e-4b08-be24-b801f16fa289 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:51.373705 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f2afc3-5f3e-4b08-be24-b801f16fa289 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:51.374749 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f2afc3-5f3e-4b08-be24-b801f16fa289 admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:51.377444 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f2afc3-5f3e-4b08-be24-b801f16fa289 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:51.388894 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f2afc3-5f3e-4b08-be24-b801f16fa289 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:51.390067 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2d25d5-2e12-48c2-9f6f-2b980a440eb1 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:51.396277 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8403df3c-5b51-432e-be93-e3c8c9db153c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:51.397133 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8403df3c-5b51-432e-be93-e3c8c9db153c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:51.397609 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8403df3c-5b51-432e-be93-e3c8c9db153c admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:51.398094 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8403df3c-5b51-432e-be93-e3c8c9db153c admin admin] PATH_INFO: `/v3/projects/c0f8a40b3e504de283fa076692532cfe` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:51.399571 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8403df3c-5b51-432e-be93-e3c8c9db153c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0f8a40b3e504de283fa076692532cfe)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:51.402571 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8403df3c-5b51-432e-be93-e3c8c9db153c admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:51.479881 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 871/1752] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:23:51 2022] POST /identity/v3/users => generated 304 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:23:51.482469 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f2afc3-5f3e-4b08-be24-b801f16fa289 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:51.483561 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-8403df3c-5b51-432e-be93-e3c8c9db153c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0f8a40b3e504de283fa076692532cfe', 'request_id': 'req-8403df3c-5b51-432e-be93-e3c8c9db153c'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:23:51.495709 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-77f2afc3-5f3e-4b08-be24-b801f16fa289 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:51.502202 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-8403df3c-5b51-432e-be93-e3c8c9db153c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0f8a40b3e504de283fa076692532cfe', 'request_id': 'req-8403df3c-5b51-432e-be93-e3c8c9db153c'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:23:51.511620 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-8403df3c-5b51-432e-be93-e3c8c9db153c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0f8a40b3e504de283fa076692532cfe', 'request_id': 'req-8403df3c-5b51-432e-be93-e3c8c9db153c'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:23:51.554196 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-8403df3c-5b51-432e-be93-e3c8c9db153c admin admin] The token cache is being invalidate because project c0f8a40b3e504de283fa076692532cfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:23:51.555199 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-8403df3c-5b51-432e-be93-e3c8c9db153c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:23:51.556080 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-8403df3c-5b51-432e-be93-e3c8c9db153c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:23:51.559619 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 882/1753] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:23:51 2022] DELETE /identity/v3/projects/c0f8a40b3e504de283fa076692532cfe => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:23:51.570412 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd689186-5195-4c2d-b533-d23a384a534d None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:51.570829 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd689186-5195-4c2d-b533-d23a384a534d None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:51.572287 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd689186-5195-4c2d-b533-d23a384a534d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:51.622331 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-cd689186-5195-4c2d-b533-d23a384a534d None None] MFA Rules not processed for user `e475e2e663794a3c83cfc9e82947a70f`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:23:51.624873 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-cd689186-5195-4c2d-b533-d23a384a534d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:51.762345 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 883/1754] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:23:51 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:23:51.765719 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f2afc3-5f3e-4b08-be24-b801f16fa289 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:51.767794 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd689186-5195-4c2d-b533-d23a384a534d None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:51.769242 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-cd689186-5195-4c2d-b533-d23a384a534d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:51.852163 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:23:51.966568 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd689186-5195-4c2d-b533-d23a384a534d None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:51.980712 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcd627f-d407-4587-a00e-80799c54957a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:51.981505 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcd627f-d407-4587-a00e-80799c54957a admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:51.981874 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcd627f-d407-4587-a00e-80799c54957a admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:51.982279 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcd627f-d407-4587-a00e-80799c54957a admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:51.984093 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcd627f-d407-4587-a00e-80799c54957a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:51.985772 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcd627f-d407-4587-a00e-80799c54957a admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:52.024997 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 884/1755] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:23:51 2022] GET /identity/v3/roles => generated 1420 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:23:52.026698 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcd627f-d407-4587-a00e-80799c54957a admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:52.026840 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:23:52.029970 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-8dcd627f-d407-4587-a00e-80799c54957a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:52.050596 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aa2b39-a33c-4f03-8f99-b6771c998358 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb863beaaa9f495c8b64655996c061f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:52.051232 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa2b39-a33c-4f03-8f99-b6771c998358 service nova] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:52.051815 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa2b39-a33c-4f03-8f99-b6771c998358 service nova] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:52.051815 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa2b39-a33c-4f03-8f99-b6771c998358 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:52.058501 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-a7aa2b39-a33c-4f03-8f99-b6771c998358 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:52.071820 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcd627f-d407-4587-a00e-80799c54957a admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:52.111529 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75bebd8-a907-4022-b096-6a9f17b67b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:52.113572 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75bebd8-a907-4022-b096-6a9f17b67b31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:52.114212 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75bebd8-a907-4022-b096-6a9f17b67b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:52.114589 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75bebd8-a907-4022-b096-6a9f17b67b31 admin admin] PATH_INFO: `/v3/users/7635cf16bf374307bf660f5ae043c909` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:52.122435 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75bebd8-a907-4022-b096-6a9f17b67b31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7635cf16bf374307bf660f5ae043c909)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:52.125338 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75bebd8-a907-4022-b096-6a9f17b67b31 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:52.259067 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-e75bebd8-a907-4022-b096-6a9f17b67b31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7635cf16bf374307bf660f5ae043c909'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:23:52.291941 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aa2b39-a33c-4f03-8f99-b6771c998358 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:52.293612 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aa2b39-a33c-4f03-8f99-b6771c998358 service nova] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:52.303719 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-e75bebd8-a907-4022-b096-6a9f17b67b31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7635cf16bf374307bf660f5ae043c909'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:23:52.323100 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 872/1756] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:23:51 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 843 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:23:52.324284 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aa2b39-a33c-4f03-8f99-b6771c998358 service nova] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:52.330482 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-e75bebd8-a907-4022-b096-6a9f17b67b31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7635cf16bf374307bf660f5ae043c909'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:23:52.331561 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-e75bebd8-a907-4022-b096-6a9f17b67b31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7635cf16bf374307bf660f5ae043c909'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:23:52.360517 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-e75bebd8-a907-4022-b096-6a9f17b67b31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7635cf16bf374307bf660f5ae043c909'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:23:52.370314 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aa2b39-a33c-4f03-8f99-b6771c998358 service nova] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:52.381231 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412733cd-a90c-489a-b86f-32bab54f3c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:52.381879 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412733cd-a90c-489a-b86f-32bab54f3c3c admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:52.382162 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412733cd-a90c-489a-b86f-32bab54f3c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:52.382439 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412733cd-a90c-489a-b86f-32bab54f3c3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:52.386219 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412733cd-a90c-489a-b86f-32bab54f3c3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:52.390611 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 885/1757] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:23:52 2022] DELETE /identity/v3/users/7635cf16bf374307bf660f5ae043c909 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:23:52.392659 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412733cd-a90c-489a-b86f-32bab54f3c3c admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:52.422496 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 873/1758] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:23:52 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:23:52.426431 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75bebd8-a907-4022-b096-6a9f17b67b31 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:52.428586 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-e75bebd8-a907-4022-b096-6a9f17b67b31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:52.493341 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412733cd-a90c-489a-b86f-32bab54f3c3c admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:52.495387 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-412733cd-a90c-489a-b86f-32bab54f3c3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:52.539696 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412733cd-a90c-489a-b86f-32bab54f3c3c admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:52.660091 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75bebd8-a907-4022-b096-6a9f17b67b31 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:52.674873 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686ed388-c23b-4050-9d88-7844d5a7314a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:52.679092 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ed388-c23b-4050-9d88-7844d5a7314a admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:52.682953 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ed388-c23b-4050-9d88-7844d5a7314a admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:52.684012 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ed388-c23b-4050-9d88-7844d5a7314a admin admin] PATH_INFO: `/v3/projects/e76dc718da4b4363ac4dc637b2e82563/users/17cf4adc847a4f1ebd5a8884db8b79fd/roles/a9895331e9694fa8b2b50908bb057bcb` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:52.741815 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686ed388-c23b-4050-9d88-7844d5a7314a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e76dc718da4b4363ac4dc637b2e82563, user_id=17cf4adc847a4f1ebd5a8884db8b79fd, role_id=a9895331e9694fa8b2b50908bb057bcb)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:52.756002 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686ed388-c23b-4050-9d88-7844d5a7314a admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:52.796190 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d6ff9e-aa36-477e-a7ea-54a883f5c74f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb863beaaa9f495c8b64655996c061f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:52.797078 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d6ff9e-aa36-477e-a7ea-54a883f5c74f service nova] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:52.797468 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d6ff9e-aa36-477e-a7ea-54a883f5c74f service nova] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:52.797892 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d6ff9e-aa36-477e-a7ea-54a883f5c74f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:52.802126 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-13d6ff9e-aa36-477e-a7ea-54a883f5c74f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:52.804656 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 886/1759] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:23:52 2022] PUT /identity/v3/projects/e76dc718da4b4363ac4dc637b2e82563/users/17cf4adc847a4f1ebd5a8884db8b79fd/roles/a9895331e9694fa8b2b50908bb057bcb => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:23:52.818516 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33205e-0f88-4f7e-ab5b-8081a0fee779 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:52.818879 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33205e-0f88-4f7e-ab5b-8081a0fee779 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:52.819064 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33205e-0f88-4f7e-ab5b-8081a0fee779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:52.914208 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-ec33205e-0f88-4f7e-ab5b-8081a0fee779 None None] MFA Rules not processed for user `17cf4adc847a4f1ebd5a8884db8b79fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:23:52.919093 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-ec33205e-0f88-4f7e-ab5b-8081a0fee779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:52.959594 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:23:53.016981 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d6ff9e-aa36-477e-a7ea-54a883f5c74f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:53.018726 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d6ff9e-aa36-477e-a7ea-54a883f5c74f service nova] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:53.045323 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 874/1760] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:23:52 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 10:23:53.156248 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 887/1761] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:23:52 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:23:53.159328 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d6ff9e-aa36-477e-a7ea-54a883f5c74f service nova] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:53.174907 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d6ff9e-aa36-477e-a7ea-54a883f5c74f service nova] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:53.256342 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:23:53.321736 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42430861-6ccf-4eb0-8177-8568c2dfe908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:53.322625 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42430861-6ccf-4eb0-8177-8568c2dfe908 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:53.323098 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42430861-6ccf-4eb0-8177-8568c2dfe908 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:53.323445 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42430861-6ccf-4eb0-8177-8568c2dfe908 admin admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:53.324248 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42430861-6ccf-4eb0-8177-8568c2dfe908 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:53.326836 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42430861-6ccf-4eb0-8177-8568c2dfe908 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:53.377455 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 875/1762] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:23:53 2022] POST /identity/v3/projects => generated 409 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:23:53.382074 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec33205e-0f88-4f7e-ab5b-8081a0fee779 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:53.400116 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec33205e-0f88-4f7e-ab5b-8081a0fee779 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:53.564346 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d79346f-c868-44c8-82e4-a62884f4856b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:53.565973 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d79346f-c868-44c8-82e4-a62884f4856b admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:53.566258 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d79346f-c868-44c8-82e4-a62884f4856b admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:53.566528 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d79346f-c868-44c8-82e4-a62884f4856b admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:53.567173 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d79346f-c868-44c8-82e4-a62884f4856b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:53.575860 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d79346f-c868-44c8-82e4-a62884f4856b admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:53.648791 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 888/1763] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:23:53 2022] POST /identity/v3/users => generated 311 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:23:53.652194 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42430861-6ccf-4eb0-8177-8568c2dfe908 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:53.672484 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42430861-6ccf-4eb0-8177-8568c2dfe908 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:53.690187 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357bcad2-e645-4126-88b4-d5d7996812ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:53.692955 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357bcad2-e645-4126-88b4-d5d7996812ba admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:53.692955 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357bcad2-e645-4126-88b4-d5d7996812ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:53.693282 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357bcad2-e645-4126-88b4-d5d7996812ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:53.695236 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357bcad2-e645-4126-88b4-d5d7996812ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:53.702910 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357bcad2-e645-4126-88b4-d5d7996812ba admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:53.751678 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 876/1764] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:23:53 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 10:23:53.753840 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d79346f-c868-44c8-82e4-a62884f4856b admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:53.786032 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d79346f-c868-44c8-82e4-a62884f4856b admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:53.812262 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6af47b9-a8b0-46b6-acb0-1eb5ec35f1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:53.814510 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6af47b9-a8b0-46b6-acb0-1eb5ec35f1b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:53.814835 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6af47b9-a8b0-46b6-acb0-1eb5ec35f1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:53.816631 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6af47b9-a8b0-46b6-acb0-1eb5ec35f1b0 admin admin] PATH_INFO: `/v3/projects/c2c1686c63c14038b9117e3a8698da2c/users/6cb37977149141e696a38909860ac936/roles/89ca30cbbb634be8a96e9921aa56626b` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:53.867997 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6af47b9-a8b0-46b6-acb0-1eb5ec35f1b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2c1686c63c14038b9117e3a8698da2c, user_id=6cb37977149141e696a38909860ac936, role_id=89ca30cbbb634be8a96e9921aa56626b)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:53.874645 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6af47b9-a8b0-46b6-acb0-1eb5ec35f1b0 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:53.880727 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357bcad2-e645-4126-88b4-d5d7996812ba admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:53.882771 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-357bcad2-e645-4126-88b4-d5d7996812ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:53.936285 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357bcad2-e645-4126-88b4-d5d7996812ba admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:53.958515 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 889/1765] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:23:53 2022] PUT /identity/v3/projects/c2c1686c63c14038b9117e3a8698da2c/users/6cb37977149141e696a38909860ac936/roles/89ca30cbbb634be8a96e9921aa56626b => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:23:53.961144 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6af47b9-a8b0-46b6-acb0-1eb5ec35f1b0 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:54.040059 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe004b4e-09ad-4e5d-8b67-a25b3aa8a954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:54.040704 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe004b4e-09ad-4e5d-8b67-a25b3aa8a954 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:54.041033 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe004b4e-09ad-4e5d-8b67-a25b3aa8a954 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:54.041335 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe004b4e-09ad-4e5d-8b67-a25b3aa8a954 admin admin] PATH_INFO: `/v3/projects/b995c367c5db45ada70c9dda48cbbac1` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:54.042527 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe004b4e-09ad-4e5d-8b67-a25b3aa8a954 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b995c367c5db45ada70c9dda48cbbac1)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:54.047301 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe004b4e-09ad-4e5d-8b67-a25b3aa8a954 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:54.168724 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-fe004b4e-09ad-4e5d-8b67-a25b3aa8a954 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b995c367c5db45ada70c9dda48cbbac1', 'request_id': 'req-fe004b4e-09ad-4e5d-8b67-a25b3aa8a954'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:23:54.183375 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-fe004b4e-09ad-4e5d-8b67-a25b3aa8a954 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b995c367c5db45ada70c9dda48cbbac1', 'request_id': 'req-fe004b4e-09ad-4e5d-8b67-a25b3aa8a954'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:23:54.198586 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-fe004b4e-09ad-4e5d-8b67-a25b3aa8a954 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b995c367c5db45ada70c9dda48cbbac1', 'request_id': 'req-fe004b4e-09ad-4e5d-8b67-a25b3aa8a954'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:23:54.213033 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6af47b9-a8b0-46b6-acb0-1eb5ec35f1b0 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:54.225270 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-fe004b4e-09ad-4e5d-8b67-a25b3aa8a954 admin admin] The token cache is being invalidate because project b995c367c5db45ada70c9dda48cbbac1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80105) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:23:54.225575 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-fe004b4e-09ad-4e5d-8b67-a25b3aa8a954 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:23:54.227337 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-fe004b4e-09ad-4e5d-8b67-a25b3aa8a954 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:23:54.234516 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 877/1766] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:23:53 2022] DELETE /identity/v3/projects/b995c367c5db45ada70c9dda48cbbac1 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 10:23:54.238428 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeab613-b036-4ce0-bcaf-74c92dedd071 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:54.238789 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeab613-b036-4ce0-bcaf-74c92dedd071 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:54.242486 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeab613-b036-4ce0-bcaf-74c92dedd071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:54.299923 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-cdeab613-b036-4ce0-bcaf-74c92dedd071 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:23:54.306521 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-cdeab613-b036-4ce0-bcaf-74c92dedd071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:54.370414 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:23:54.391423 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:23:54.475934 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b67df8-31ec-487a-a8fb-d648268a199d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:54.477104 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b67df8-31ec-487a-a8fb-d648268a199d admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:54.477633 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b67df8-31ec-487a-a8fb-d648268a199d admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:54.478373 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b67df8-31ec-487a-a8fb-d648268a199d admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:54.479418 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b67df8-31ec-487a-a8fb-d648268a199d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:54.485756 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b67df8-31ec-487a-a8fb-d648268a199d admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:54.494463 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 878/1767] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:23:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:23:54.496042 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81acf8c4-2fee-4ddd-a531-17f6d4595f5e None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:54.496303 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81acf8c4-2fee-4ddd-a531-17f6d4595f5e None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:54.496580 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81acf8c4-2fee-4ddd-a531-17f6d4595f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:54.527646 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-81acf8c4-2fee-4ddd-a531-17f6d4595f5e None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:23:54.530915 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-81acf8c4-2fee-4ddd-a531-17f6d4595f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:54.549900 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 879/1768] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:23:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:23:54.552198 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81acf8c4-2fee-4ddd-a531-17f6d4595f5e None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:54.572078 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81acf8c4-2fee-4ddd-a531-17f6d4595f5e None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:54.574698 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 890/1769] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:23:53 2022] GET /identity/v3/roles => generated 1420 bytes in 614 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:23:54.588204 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b67df8-31ec-487a-a8fb-d648268a199d admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:54.591954 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752a5fca-7a58-4260-a0b7-8724c521a768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:54.592975 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752a5fca-7a58-4260-a0b7-8724c521a768 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:54.593370 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752a5fca-7a58-4260-a0b7-8724c521a768 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:54.593597 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752a5fca-7a58-4260-a0b7-8724c521a768 admin admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:54.594256 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752a5fca-7a58-4260-a0b7-8724c521a768 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:23:54.594848 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752a5fca-7a58-4260-a0b7-8724c521a768 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:54.596038 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-b3b67df8-31ec-487a-a8fb-d648268a199d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:54.596530 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752a5fca-7a58-4260-a0b7-8724c521a768 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:54.624615 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 880/1770] 10.222.0.36 () {58 vars in 1153 bytes} [Tue Aug 9 10:23:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:23:54.626399 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752a5fca-7a58-4260-a0b7-8724c521a768 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:54.657379 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752a5fca-7a58-4260-a0b7-8724c521a768 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:54.691680 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dba0f15-65d7-4fd6-80eb-f000425a704a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:54.694970 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dba0f15-65d7-4fd6-80eb-f000425a704a admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:54.697781 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dba0f15-65d7-4fd6-80eb-f000425a704a admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:54.700211 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dba0f15-65d7-4fd6-80eb-f000425a704a admin admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:54.705290 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b67df8-31ec-487a-a8fb-d648268a199d admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:54.708534 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dba0f15-65d7-4fd6-80eb-f000425a704a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:54.719436 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dba0f15-65d7-4fd6-80eb-f000425a704a admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:54.728504 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a08e2-d3c9-4169-bc7c-f284bee4f059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:54.732538 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a08e2-d3c9-4169-bc7c-f284bee4f059 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:54.733090 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a08e2-d3c9-4169-bc7c-f284bee4f059 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:54.734196 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a08e2-d3c9-4169-bc7c-f284bee4f059 admin admin] PATH_INFO: `/v3/projects/c2c1686c63c14038b9117e3a8698da2c/users/6cb37977149141e696a38909860ac936/roles/89ca30cbbb634be8a96e9921aa56626b` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:54.742729 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96a08e2-d3c9-4169-bc7c-f284bee4f059 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2c1686c63c14038b9117e3a8698da2c, user_id=6cb37977149141e696a38909860ac936, role_id=89ca30cbbb634be8a96e9921aa56626b)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:54.754355 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96a08e2-d3c9-4169-bc7c-f284bee4f059 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:54.817782 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 891/1771] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:23:54 2022] PUT /identity/v3/projects/c2c1686c63c14038b9117e3a8698da2c/users/6cb37977149141e696a38909860ac936/roles/89ca30cbbb634be8a96e9921aa56626b => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:23:54.821613 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a08e2-d3c9-4169-bc7c-f284bee4f059 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:54.834865 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-f96a08e2-d3c9-4169-bc7c-f284bee4f059 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:54.852941 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 881/1772] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:23:54 2022] POST /identity/v3/projects => generated 363 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:23:54.859207 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ebf2e-ac32-4f82-858a-aa5cd9d2e65a None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:54.859637 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ebf2e-ac32-4f82-858a-aa5cd9d2e65a None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:54.864357 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ebf2e-ac32-4f82-858a-aa5cd9d2e65a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:54.956072 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-5c1ebf2e-ac32-4f82-858a-aa5cd9d2e65a None None] MFA Rules not processed for user `6cb37977149141e696a38909860ac936`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:23:54.960072 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-5c1ebf2e-ac32-4f82-858a-aa5cd9d2e65a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:55.185993 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 882/1773] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:23:54 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:23:55.187227 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1ebf2e-ac32-4f82-858a-aa5cd9d2e65a None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:55.192764 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a08e2-d3c9-4169-bc7c-f284bee4f059 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:55.347712 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1ebf2e-ac32-4f82-858a-aa5cd9d2e65a None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:55.362591 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58de9f9e-17e5-4164-b7eb-60c2018b6569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:55.363575 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58de9f9e-17e5-4164-b7eb-60c2018b6569 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:55.363863 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58de9f9e-17e5-4164-b7eb-60c2018b6569 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:55.364137 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58de9f9e-17e5-4164-b7eb-60c2018b6569 admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:55.364965 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58de9f9e-17e5-4164-b7eb-60c2018b6569 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:55.369494 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58de9f9e-17e5-4164-b7eb-60c2018b6569 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:55.399590 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7916a0-6f4d-4036-a0d3-8f0b511a9f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:55.400486 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7916a0-6f4d-4036-a0d3-8f0b511a9f74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:55.400562 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7916a0-6f4d-4036-a0d3-8f0b511a9f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:55.400828 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7916a0-6f4d-4036-a0d3-8f0b511a9f74 admin admin] PATH_INFO: `/v3/projects/4d72b01a55594e28b979e18a2f68a783` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:55.420274 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7916a0-6f4d-4036-a0d3-8f0b511a9f74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d72b01a55594e28b979e18a2f68a783)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:55.432927 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 883/1774] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:23:55 2022] POST /identity/v3/users => generated 282 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:23:55.435324 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58de9f9e-17e5-4164-b7eb-60c2018b6569 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:55.438752 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-58de9f9e-17e5-4164-b7eb-60c2018b6569 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:55.443392 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7916a0-6f4d-4036-a0d3-8f0b511a9f74 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:55.464074 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:23:55.646797 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58de9f9e-17e5-4164-b7eb-60c2018b6569 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:55.686823 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-9b7916a0-6f4d-4036-a0d3-8f0b511a9f74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d72b01a55594e28b979e18a2f68a783', 'request_id': 'req-9b7916a0-6f4d-4036-a0d3-8f0b511a9f74'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:23:55.714697 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-9b7916a0-6f4d-4036-a0d3-8f0b511a9f74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d72b01a55594e28b979e18a2f68a783', 'request_id': 'req-9b7916a0-6f4d-4036-a0d3-8f0b511a9f74'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:23:55.745376 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-9b7916a0-6f4d-4036-a0d3-8f0b511a9f74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d72b01a55594e28b979e18a2f68a783', 'request_id': 'req-9b7916a0-6f4d-4036-a0d3-8f0b511a9f74'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:23:55.760085 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:23:55.803908 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-9b7916a0-6f4d-4036-a0d3-8f0b511a9f74 admin admin] The token cache is being invalidate because project 4d72b01a55594e28b979e18a2f68a783 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:23:55.804209 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-9b7916a0-6f4d-4036-a0d3-8f0b511a9f74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:23:55.811369 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-9b7916a0-6f4d-4036-a0d3-8f0b511a9f74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:23:55.819388 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 892/1775] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:23:54 2022] DELETE /identity/v3/projects/4d72b01a55594e28b979e18a2f68a783 => generated 0 bytes in 999 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:23:55.828289 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7916a0-6f4d-4036-a0d3-8f0b511a9f74 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:55.834255 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-9b7916a0-6f4d-4036-a0d3-8f0b511a9f74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:55.851557 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60d992f-0d47-4c5e-9cc4-61ef218e8097 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6c687a38524de0bf23d87ae91d3b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:55.852322 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60d992f-0d47-4c5e-9cc4-61ef218e8097 service cinder] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:55.852719 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60d992f-0d47-4c5e-9cc4-61ef218e8097 service cinder] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:55.853156 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60d992f-0d47-4c5e-9cc4-61ef218e8097 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:55.866813 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-c60d992f-0d47-4c5e-9cc4-61ef218e8097 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:56.151366 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7916a0-6f4d-4036-a0d3-8f0b511a9f74 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:56.153179 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60d992f-0d47-4c5e-9cc4-61ef218e8097 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:56.154745 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60d992f-0d47-4c5e-9cc4-61ef218e8097 service cinder] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:56.186930 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a525db78-492c-41bf-9ef1-952e7919df88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:56.187584 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a525db78-492c-41bf-9ef1-952e7919df88 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:56.187868 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a525db78-492c-41bf-9ef1-952e7919df88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:56.188143 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a525db78-492c-41bf-9ef1-952e7919df88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:56.188876 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a525db78-492c-41bf-9ef1-952e7919df88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:56.195139 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a525db78-492c-41bf-9ef1-952e7919df88 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:56.211568 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 884/1776] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:23:55 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 778 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:23:56.214719 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60d992f-0d47-4c5e-9cc4-61ef218e8097 service cinder] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:56.219520 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-c60d992f-0d47-4c5e-9cc4-61ef218e8097 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:56.237530 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 893/1777] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:23:55 2022] GET /identity/v3/roles => generated 1420 bytes in 418 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:23:56.248005 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a525db78-492c-41bf-9ef1-952e7919df88 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:56.267071 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60d992f-0d47-4c5e-9cc4-61ef218e8097 service cinder] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:56.279736 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a525db78-492c-41bf-9ef1-952e7919df88 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:56.292486 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39135d4a-3332-4e10-803c-ca8c32e8cf16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:56.293139 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39135d4a-3332-4e10-803c-ca8c32e8cf16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:56.293419 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39135d4a-3332-4e10-803c-ca8c32e8cf16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:56.294321 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39135d4a-3332-4e10-803c-ca8c32e8cf16 admin admin] PATH_INFO: `/v3/users/1a1392a5e5dd4388a6f54bc94036207e` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:56.299790 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39135d4a-3332-4e10-803c-ca8c32e8cf16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a1392a5e5dd4388a6f54bc94036207e)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:56.313745 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39135d4a-3332-4e10-803c-ca8c32e8cf16 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:56.316130 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2014d3be-0ccf-4468-9fd5-dcf6d96cece4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:56.316777 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2014d3be-0ccf-4468-9fd5-dcf6d96cece4 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:56.317200 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2014d3be-0ccf-4468-9fd5-dcf6d96cece4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:56.317493 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2014d3be-0ccf-4468-9fd5-dcf6d96cece4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:56.319202 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2014d3be-0ccf-4468-9fd5-dcf6d96cece4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:56.320900 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2014d3be-0ccf-4468-9fd5-dcf6d96cece4 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:56.374723 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 894/1778] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:23:56 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:23:56.375484 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2014d3be-0ccf-4468-9fd5-dcf6d96cece4 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:56.398883 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2014d3be-0ccf-4468-9fd5-dcf6d96cece4 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:56.411812 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350978de-fda4-4094-9fbe-5c6f67efbee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:56.412592 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350978de-fda4-4094-9fbe-5c6f67efbee8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:56.413064 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350978de-fda4-4094-9fbe-5c6f67efbee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:56.413360 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350978de-fda4-4094-9fbe-5c6f67efbee8 admin admin] PATH_INFO: `/v3/projects/3e31bc3915074a46bfd189988d4e4610/users/c627ae444ed846a9ae6d9b91c0cc2041/roles/a9895331e9694fa8b2b50908bb057bcb` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:56.475225 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350978de-fda4-4094-9fbe-5c6f67efbee8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e31bc3915074a46bfd189988d4e4610, user_id=c627ae444ed846a9ae6d9b91c0cc2041, role_id=a9895331e9694fa8b2b50908bb057bcb)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:56.491077 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350978de-fda4-4094-9fbe-5c6f67efbee8 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:56.526527 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-39135d4a-3332-4e10-803c-ca8c32e8cf16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a1392a5e5dd4388a6f54bc94036207e'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:23:56.560408 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 895/1779] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:23:56 2022] PUT /identity/v3/projects/3e31bc3915074a46bfd189988d4e4610/users/c627ae444ed846a9ae6d9b91c0cc2041/roles/a9895331e9694fa8b2b50908bb057bcb => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:23:56.569533 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-39135d4a-3332-4e10-803c-ca8c32e8cf16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a1392a5e5dd4388a6f54bc94036207e'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:23:56.582060 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:23:56.582327 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931dc151-864b-4125-81c4-44d76871dab1 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:56.592178 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931dc151-864b-4125-81c4-44d76871dab1 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:56.592486 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931dc151-864b-4125-81c4-44d76871dab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:56.609624 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-39135d4a-3332-4e10-803c-ca8c32e8cf16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a1392a5e5dd4388a6f54bc94036207e'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:23:56.612930 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-39135d4a-3332-4e10-803c-ca8c32e8cf16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a1392a5e5dd4388a6f54bc94036207e'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:23:56.636601 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-39135d4a-3332-4e10-803c-ca8c32e8cf16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a1392a5e5dd4388a6f54bc94036207e'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:23:56.661023 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 885/1780] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:23:56 2022] DELETE /identity/v3/users/1a1392a5e5dd4388a6f54bc94036207e => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:23:56.748384 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39135d4a-3332-4e10-803c-ca8c32e8cf16 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:56.750558 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-931dc151-864b-4125-81c4-44d76871dab1 None None] MFA Rules not processed for user `c627ae444ed846a9ae6d9b91c0cc2041`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:23:56.751512 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-39135d4a-3332-4e10-803c-ca8c32e8cf16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:56.756027 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-931dc151-864b-4125-81c4-44d76871dab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:56.975239 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 896/1781] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:23:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 399 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:23:56.976233 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931dc151-864b-4125-81c4-44d76871dab1 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:56.980968 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-931dc151-864b-4125-81c4-44d76871dab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:57.022117 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39135d4a-3332-4e10-803c-ca8c32e8cf16 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:57.034781 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d01c0b7-ea54-4dd9-9c4c-0c8cc5f5461b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6c687a38524de0bf23d87ae91d3b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:57.037581 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d01c0b7-ea54-4dd9-9c4c-0c8cc5f5461b service cinder] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:57.041932 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d01c0b7-ea54-4dd9-9c4c-0c8cc5f5461b service cinder] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:57.042468 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d01c0b7-ea54-4dd9-9c4c-0c8cc5f5461b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:57.051190 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-9d01c0b7-ea54-4dd9-9c4c-0c8cc5f5461b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:57.165326 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:INSERT=2,keystone:DELETE=1,keystone:SELECT=97 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:23:57.234023 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931dc151-864b-4125-81c4-44d76871dab1 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:57.250842 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389d2153-6c38-4338-9f86-29b687cfd76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:57.251472 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389d2153-6c38-4338-9f86-29b687cfd76f admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:57.251747 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389d2153-6c38-4338-9f86-29b687cfd76f admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:57.252019 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389d2153-6c38-4338-9f86-29b687cfd76f admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:57.252648 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389d2153-6c38-4338-9f86-29b687cfd76f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:57.255672 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389d2153-6c38-4338-9f86-29b687cfd76f admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:57.287796 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d01c0b7-ea54-4dd9-9c4c-0c8cc5f5461b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:57.291870 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d01c0b7-ea54-4dd9-9c4c-0c8cc5f5461b service cinder] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:57.332236 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 886/1782] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:23:56 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 584 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 10:23:57.343602 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 897/1783] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:23:56 2022] POST /identity/v3/projects => generated 365 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:23:57.348379 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d01c0b7-ea54-4dd9-9c4c-0c8cc5f5461b service cinder] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:57.386326 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d01c0b7-ea54-4dd9-9c4c-0c8cc5f5461b service cinder] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:57.558932 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6072d2f-9f2d-4d03-bdec-5fde5d18f99d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:57.560731 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6072d2f-9f2d-4d03-bdec-5fde5d18f99d admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:57.561167 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6072d2f-9f2d-4d03-bdec-5fde5d18f99d admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:57.561590 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6072d2f-9f2d-4d03-bdec-5fde5d18f99d admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:57.562401 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6072d2f-9f2d-4d03-bdec-5fde5d18f99d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:57.564517 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6072d2f-9f2d-4d03-bdec-5fde5d18f99d admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:57.625643 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 887/1784] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:23:57 2022] POST /identity/v3/users => generated 289 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:23:57.630013 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389d2153-6c38-4338-9f86-29b687cfd76f admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:57.659699 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389d2153-6c38-4338-9f86-29b687cfd76f admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:57.674816 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc768e0-b9ae-473d-b887-e21fd04572ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:57.675756 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc768e0-b9ae-473d-b887-e21fd04572ec admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:57.675963 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc768e0-b9ae-473d-b887-e21fd04572ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:57.676255 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc768e0-b9ae-473d-b887-e21fd04572ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:57.676961 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc768e0-b9ae-473d-b887-e21fd04572ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:57.691965 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc768e0-b9ae-473d-b887-e21fd04572ec admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:57.720079 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 898/1785] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:23:57 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:23:57.724629 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6072d2f-9f2d-4d03-bdec-5fde5d18f99d admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:57.738395 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6072d2f-9f2d-4d03-bdec-5fde5d18f99d admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:57.760436 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52836da-dd68-454a-998e-752193a83f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:57.764631 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52836da-dd68-454a-998e-752193a83f8b admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:57.768297 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52836da-dd68-454a-998e-752193a83f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:57.772208 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52836da-dd68-454a-998e-752193a83f8b admin admin] PATH_INFO: `/v3/projects/656bb19b739b4f658fd9894f0898f5a4/users/75a4e292bc6e44089ed05a9a4acd89c5/roles/89ca30cbbb634be8a96e9921aa56626b` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:57.815128 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52836da-dd68-454a-998e-752193a83f8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=656bb19b739b4f658fd9894f0898f5a4, user_id=75a4e292bc6e44089ed05a9a4acd89c5, role_id=89ca30cbbb634be8a96e9921aa56626b)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:57.828255 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52836da-dd68-454a-998e-752193a83f8b admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:57.866359 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 888/1786] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:23:57 2022] PUT /identity/v3/projects/656bb19b739b4f658fd9894f0898f5a4/users/75a4e292bc6e44089ed05a9a4acd89c5/roles/89ca30cbbb634be8a96e9921aa56626b => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:23:57.867647 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc768e0-b9ae-473d-b887-e21fd04572ec admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:57.881957 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc768e0-b9ae-473d-b887-e21fd04572ec admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:57.971134 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f673987f-e257-4826-abae-92eee39216c8 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:57.971835 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f673987f-e257-4826-abae-92eee39216c8 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:57.972323 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f673987f-e257-4826-abae-92eee39216c8 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:57.974218 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 889/1787] 10.222.0.36 () {54 vars in 921 bytes} [Tue Aug 9 10:23:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 10:23:58.066816 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac646098-7feb-4c0e-83d3-1f8512fcedb3 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:58.067442 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac646098-7feb-4c0e-83d3-1f8512fcedb3 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:58.068073 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac646098-7feb-4c0e-83d3-1f8512fcedb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:58.081962 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:23:58.109591 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-ac646098-7feb-4c0e-83d3-1f8512fcedb3 None None] MFA Rules not processed for user `eb863beaaa9f495c8b64655996c061f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:23:58.111472 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf233381-cb64-4eaa-a672-d8b12ee8c5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:58.112111 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf233381-cb64-4eaa-a672-d8b12ee8c5a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:58.112397 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf233381-cb64-4eaa-a672-d8b12ee8c5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:58.113429 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-ac646098-7feb-4c0e-83d3-1f8512fcedb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:58.114712 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf233381-cb64-4eaa-a672-d8b12ee8c5a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:58.116207 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf233381-cb64-4eaa-a672-d8b12ee8c5a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:58.121544 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf233381-cb64-4eaa-a672-d8b12ee8c5a8 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:58.173284 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 899/1788] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:23:57 2022] GET /identity/v3/roles => generated 1420 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:23:58.174768 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf233381-cb64-4eaa-a672-d8b12ee8c5a8 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:58.211696 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf233381-cb64-4eaa-a672-d8b12ee8c5a8 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:58.262938 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad64bd8-d9ce-46ad-a494-e124f73c546c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:58.265730 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad64bd8-d9ce-46ad-a494-e124f73c546c admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:58.266033 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad64bd8-d9ce-46ad-a494-e124f73c546c admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:58.266311 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad64bd8-d9ce-46ad-a494-e124f73c546c admin admin] PATH_INFO: `/v3/projects/656bb19b739b4f658fd9894f0898f5a4/users/75a4e292bc6e44089ed05a9a4acd89c5/roles/89ca30cbbb634be8a96e9921aa56626b` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:58.269020 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad64bd8-d9ce-46ad-a494-e124f73c546c admin admin] RBAC: Authorizing `identity:create_grant(project_id=656bb19b739b4f658fd9894f0898f5a4, user_id=75a4e292bc6e44089ed05a9a4acd89c5, role_id=89ca30cbbb634be8a96e9921aa56626b)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:58.272243 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad64bd8-d9ce-46ad-a494-e124f73c546c admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:58.296080 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 900/1789] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:23:58 2022] PUT /identity/v3/projects/656bb19b739b4f658fd9894f0898f5a4/users/75a4e292bc6e44089ed05a9a4acd89c5/roles/89ca30cbbb634be8a96e9921aa56626b => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:23:58.318753 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c4f550-1115-46bb-89e6-b4c46ce8ac89 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:58.319444 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c4f550-1115-46bb-89e6-b4c46ce8ac89 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:58.319649 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c4f550-1115-46bb-89e6-b4c46ce8ac89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:58.329951 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 890/1790] 10.222.0.36 () {58 vars in 1018 bytes} [Tue Aug 9 10:23:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 10:23:58.404366 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-33c4f550-1115-46bb-89e6-b4c46ce8ac89 None None] MFA Rules not processed for user `75a4e292bc6e44089ed05a9a4acd89c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:23:58.405877 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-33c4f550-1115-46bb-89e6-b4c46ce8ac89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:58.578132 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 901/1791] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:23:58 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:23:58.589458 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac646098-7feb-4c0e-83d3-1f8512fcedb3 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:58.773428 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac646098-7feb-4c0e-83d3-1f8512fcedb3 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:58.929322 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250d0597-71a1-439c-a707-a73bd402ff19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6c687a38524de0bf23d87ae91d3b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:58.933894 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d0597-71a1-439c-a707-a73bd402ff19 service cinder] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:58.934669 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d0597-71a1-439c-a707-a73bd402ff19 service cinder] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:58.939888 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d0597-71a1-439c-a707-a73bd402ff19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:58.951961 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e018c-5595-4c4e-8a4a-d63483301c7d None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:58.959848 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e018c-5595-4c4e-8a4a-d63483301c7d None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:58.961003 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e018c-5595-4c4e-8a4a-d63483301c7d None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:58.964312 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 902/1792] 10.222.0.36 () {54 vars in 921 bytes} [Tue Aug 9 10:23:58 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:23:58.965998 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250d0597-71a1-439c-a707-a73bd402ff19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:58.967789 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250d0597-71a1-439c-a707-a73bd402ff19 service cinder] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:58.994586 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 891/1793] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:23:58 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:23:59.178070 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4259ca90-c05d-4383-b9fc-3e09e90d2edc None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:59.178344 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4259ca90-c05d-4383-b9fc-3e09e90d2edc None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:59.178641 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4259ca90-c05d-4383-b9fc-3e09e90d2edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:59.195174 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250d0597-71a1-439c-a707-a73bd402ff19 service cinder] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:59.210412 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250d0597-71a1-439c-a707-a73bd402ff19 service cinder] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:59.243893 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0d4046-f727-4bf1-a181-e58539ee72ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6c687a38524de0bf23d87ae91d3b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:59.249030 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0d4046-f727-4bf1-a181-e58539ee72ea service cinder] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:59.249372 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0d4046-f727-4bf1-a181-e58539ee72ea service cinder] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:59.253993 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0d4046-f727-4bf1-a181-e58539ee72ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:59.294601 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-4259ca90-c05d-4383-b9fc-3e09e90d2edc None None] MFA Rules not processed for user `eb863beaaa9f495c8b64655996c061f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:23:59.299184 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-4259ca90-c05d-4383-b9fc-3e09e90d2edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:59.376586 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:23:59.477382 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:23:59.486221 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0d4046-f727-4bf1-a181-e58539ee72ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:59.489541 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0d4046-f727-4bf1-a181-e58539ee72ea service cinder] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:59.493511 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 903/1794] 10.222.0.36 () {58 vars in 1018 bytes} [Tue Aug 9 10:23:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:23:59.547543 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 892/1795] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:23:59 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 10:23:59.706621 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4259ca90-c05d-4383-b9fc-3e09e90d2edc None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:23:59.708669 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-4259ca90-c05d-4383-b9fc-3e09e90d2edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:23:59.761415 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4259ca90-c05d-4383-b9fc-3e09e90d2edc None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:23:59.796954 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6511481c-241f-4b56-95a6-9af81b66ce7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb863beaaa9f495c8b64655996c061f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:23:59.797644 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6511481c-241f-4b56-95a6-9af81b66ce7c service nova] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:23:59.798117 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6511481c-241f-4b56-95a6-9af81b66ce7c service nova] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:23:59.798586 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6511481c-241f-4b56-95a6-9af81b66ce7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:23:59.848680 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6511481c-241f-4b56-95a6-9af81b66ce7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:23:59.850339 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6511481c-241f-4b56-95a6-9af81b66ce7c service nova] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:23:59.913924 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 904/1796] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:23:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:24:00.497162 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0d4046-f727-4bf1-a181-e58539ee72ea service cinder] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:00.498836 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-7f0d4046-f727-4bf1-a181-e58539ee72ea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:00.781905 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0d4046-f727-4bf1-a181-e58539ee72ea service cinder] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:00.790392 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac047120-85ea-41be-84d0-03b38238c8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:00.791279 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac047120-85ea-41be-84d0-03b38238c8d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:00.792681 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac047120-85ea-41be-84d0-03b38238c8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:00.793168 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac047120-85ea-41be-84d0-03b38238c8d5 admin admin] PATH_INFO: `/v3/projects/d39167c72ded46099630d034c2c9c055` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:00.795602 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac047120-85ea-41be-84d0-03b38238c8d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d39167c72ded46099630d034c2c9c055)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:00.798281 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac047120-85ea-41be-84d0-03b38238c8d5 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:00.911372 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-ac047120-85ea-41be-84d0-03b38238c8d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd39167c72ded46099630d034c2c9c055', 'request_id': 'req-ac047120-85ea-41be-84d0-03b38238c8d5'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:00.932677 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-ac047120-85ea-41be-84d0-03b38238c8d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd39167c72ded46099630d034c2c9c055', 'request_id': 'req-ac047120-85ea-41be-84d0-03b38238c8d5'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:00.987102 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-ac047120-85ea-41be-84d0-03b38238c8d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd39167c72ded46099630d034c2c9c055', 'request_id': 'req-ac047120-85ea-41be-84d0-03b38238c8d5'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:01.033949 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-ac047120-85ea-41be-84d0-03b38238c8d5 admin admin] The token cache is being invalidate because project d39167c72ded46099630d034c2c9c055 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80105) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:24:01.038019 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-ac047120-85ea-41be-84d0-03b38238c8d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:01.041005 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-ac047120-85ea-41be-84d0-03b38238c8d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:01.049764 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 893/1797] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:24:00 2022] DELETE /identity/v3/projects/d39167c72ded46099630d034c2c9c055 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:24:01.052470 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6511481c-241f-4b56-95a6-9af81b66ce7c service nova] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:01.112242 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6511481c-241f-4b56-95a6-9af81b66ce7c service nova] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:01.334765 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564e7e99-6eed-4493-bdd6-00f7cdfb6407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:01.336698 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564e7e99-6eed-4493-bdd6-00f7cdfb6407 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:01.336941 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564e7e99-6eed-4493-bdd6-00f7cdfb6407 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:01.337160 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564e7e99-6eed-4493-bdd6-00f7cdfb6407 admin admin] PATH_INFO: `/v3/users/b8feaa158c0c43a9bbefb600818048f8` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:01.338626 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564e7e99-6eed-4493-bdd6-00f7cdfb6407 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8feaa158c0c43a9bbefb600818048f8)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:01.341393 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564e7e99-6eed-4493-bdd6-00f7cdfb6407 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:01.516239 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-564e7e99-6eed-4493-bdd6-00f7cdfb6407 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8feaa158c0c43a9bbefb600818048f8'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:01.552726 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-564e7e99-6eed-4493-bdd6-00f7cdfb6407 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8feaa158c0c43a9bbefb600818048f8'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:01.575671 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-564e7e99-6eed-4493-bdd6-00f7cdfb6407 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8feaa158c0c43a9bbefb600818048f8'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:01.576749 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-564e7e99-6eed-4493-bdd6-00f7cdfb6407 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8feaa158c0c43a9bbefb600818048f8'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:01.599231 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-564e7e99-6eed-4493-bdd6-00f7cdfb6407 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8feaa158c0c43a9bbefb600818048f8'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:01.615863 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 905/1798] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:24:01 2022] DELETE /identity/v3/users/b8feaa158c0c43a9bbefb600818048f8 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:24:02.208185 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac047120-85ea-41be-84d0-03b38238c8d5 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:02.210888 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-ac047120-85ea-41be-84d0-03b38238c8d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:02.369554 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac047120-85ea-41be-84d0-03b38238c8d5 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:02.419841 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:24:02.491067 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f213918-9ad3-4190-aa35-8e58c756c859 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb863beaaa9f495c8b64655996c061f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:02.491692 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f213918-9ad3-4190-aa35-8e58c756c859 service nova] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:02.491977 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f213918-9ad3-4190-aa35-8e58c756c859 service nova] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:02.492253 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f213918-9ad3-4190-aa35-8e58c756c859 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:02.494164 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-0f213918-9ad3-4190-aa35-8e58c756c859 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:02.508050 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f213918-9ad3-4190-aa35-8e58c756c859 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:02.509782 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f213918-9ad3-4190-aa35-8e58c756c859 service nova] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:02.521502 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 894/1799] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:24:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:24:02.722840 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85efa31-89d4-4aba-b281-f21fbd6398aa None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:02.723340 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85efa31-89d4-4aba-b281-f21fbd6398aa None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:02.723617 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85efa31-89d4-4aba-b281-f21fbd6398aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:02.744837 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-a85efa31-89d4-4aba-b281-f21fbd6398aa None None] MFA Rules not processed for user `efd69dedc75842f495bde0c20799a340`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:24:02.746191 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-a85efa31-89d4-4aba-b281-f21fbd6398aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:02.775330 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:24:02.836974 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 906/1800] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:24:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:24:03.375380 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f213918-9ad3-4190-aa35-8e58c756c859 service nova] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:03.377737 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-0f213918-9ad3-4190-aa35-8e58c756c859 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:03.466059 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f213918-9ad3-4190-aa35-8e58c756c859 service nova] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:03.473670 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9ef7de-3a9b-4de8-92fb-8f2f36329baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:03.475111 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9ef7de-3a9b-4de8-92fb-8f2f36329baa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:03.475685 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9ef7de-3a9b-4de8-92fb-8f2f36329baa admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:03.476375 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9ef7de-3a9b-4de8-92fb-8f2f36329baa admin admin] PATH_INFO: `/v3/users/c627ae444ed846a9ae6d9b91c0cc2041` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:03.478165 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9ef7de-3a9b-4de8-92fb-8f2f36329baa admin admin] RBAC: Authorizing `identity:delete_user(user_id=c627ae444ed846a9ae6d9b91c0cc2041)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:03.480481 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9ef7de-3a9b-4de8-92fb-8f2f36329baa admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:03.525933 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85efa31-89d4-4aba-b281-f21fbd6398aa None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:03.528119 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-a85efa31-89d4-4aba-b281-f21fbd6398aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:03.548632 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85efa31-89d4-4aba-b281-f21fbd6398aa None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:03.550414 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-4e9ef7de-3a9b-4de8-92fb-8f2f36329baa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c627ae444ed846a9ae6d9b91c0cc2041'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:03.557560 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d4e5da-b316-44a9-bee2-48b3d7707b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:03.558835 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d4e5da-b316-44a9-bee2-48b3d7707b8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:03.559931 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d4e5da-b316-44a9-bee2-48b3d7707b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:03.560893 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d4e5da-b316-44a9-bee2-48b3d7707b8f admin admin] PATH_INFO: `/v3/projects/9e0e946a314f4326968c88af0d3a9b83` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:03.562597 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d4e5da-b316-44a9-bee2-48b3d7707b8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e0e946a314f4326968c88af0d3a9b83)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:03.565412 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d4e5da-b316-44a9-bee2-48b3d7707b8f admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:03.570453 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-4e9ef7de-3a9b-4de8-92fb-8f2f36329baa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c627ae444ed846a9ae6d9b91c0cc2041'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:03.580450 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-4e9ef7de-3a9b-4de8-92fb-8f2f36329baa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c627ae444ed846a9ae6d9b91c0cc2041'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:03.581327 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-4e9ef7de-3a9b-4de8-92fb-8f2f36329baa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c627ae444ed846a9ae6d9b91c0cc2041'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:03.595940 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-4e9ef7de-3a9b-4de8-92fb-8f2f36329baa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c627ae444ed846a9ae6d9b91c0cc2041'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:03.609931 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 895/1801] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:24:03 2022] DELETE /identity/v3/users/c627ae444ed846a9ae6d9b91c0cc2041 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 10:24:03.613747 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b1863-43e4-4739-97e6-f932be1efb65 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:03.614064 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b1863-43e4-4739-97e6-f932be1efb65 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:03.614339 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b1863-43e4-4739-97e6-f932be1efb65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:03.627230 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-03d4e5da-b316-44a9-bee2-48b3d7707b8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e0e946a314f4326968c88af0d3a9b83', 'request_id': 'req-03d4e5da-b316-44a9-bee2-48b3d7707b8f'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:03.633904 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-03d4e5da-b316-44a9-bee2-48b3d7707b8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e0e946a314f4326968c88af0d3a9b83', 'request_id': 'req-03d4e5da-b316-44a9-bee2-48b3d7707b8f'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:03.641699 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-03d4e5da-b316-44a9-bee2-48b3d7707b8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e0e946a314f4326968c88af0d3a9b83', 'request_id': 'req-03d4e5da-b316-44a9-bee2-48b3d7707b8f'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:03.644538 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-4b7b1863-43e4-4739-97e6-f932be1efb65 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:24:03.646462 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-4b7b1863-43e4-4739-97e6-f932be1efb65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:03.662303 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-03d4e5da-b316-44a9-bee2-48b3d7707b8f admin admin] The token cache is being invalidate because project 9e0e946a314f4326968c88af0d3a9b83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:24:03.663038 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-03d4e5da-b316-44a9-bee2-48b3d7707b8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:03.664605 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-03d4e5da-b316-44a9-bee2-48b3d7707b8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:03.669892 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 907/1802] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:24:03 2022] DELETE /identity/v3/projects/9e0e946a314f4326968c88af0d3a9b83 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:24:03.672178 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77868c35-0001-48fc-bbc9-d66b5cd50683 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:03.672576 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77868c35-0001-48fc-bbc9-d66b5cd50683 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:03.672985 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77868c35-0001-48fc-bbc9-d66b5cd50683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:03.680876 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:24:03.706357 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-77868c35-0001-48fc-bbc9-d66b5cd50683 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:24:03.709774 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-77868c35-0001-48fc-bbc9-d66b5cd50683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:03.752210 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 896/1803] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:24:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:24:03.753817 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7b1863-43e4-4739-97e6-f932be1efb65 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:03.756052 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-4b7b1863-43e4-4739-97e6-f932be1efb65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:03.810051 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 908/1804] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:24:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:24:03.818907 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de151ce-8bcd-40ae-8578-f509341c7ccc None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:03.819405 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de151ce-8bcd-40ae-8578-f509341c7ccc None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:03.819829 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de151ce-8bcd-40ae-8578-f509341c7ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:03.838154 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7b1863-43e4-4739-97e6-f932be1efb65 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:03.843780 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a230ed-fb4b-472a-8741-d32f30b80050 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:03.844313 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a230ed-fb4b-472a-8741-d32f30b80050 service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:03.844696 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a230ed-fb4b-472a-8741-d32f30b80050 service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:03.845361 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a230ed-fb4b-472a-8741-d32f30b80050 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:03.854974 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-5de151ce-8bcd-40ae-8578-f509341c7ccc None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:24:03.858033 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-5de151ce-8bcd-40ae-8578-f509341c7ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:03.861679 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a230ed-fb4b-472a-8741-d32f30b80050 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:03.863888 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a230ed-fb4b-472a-8741-d32f30b80050 service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:03.872257 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 909/1805] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:24:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:24:03.877806 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 897/1806] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:24:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:24:03.878833 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de151ce-8bcd-40ae-8578-f509341c7ccc None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:03.891489 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de151ce-8bcd-40ae-8578-f509341c7ccc None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:03.899343 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7d2a25-fd58-493d-96d2-c888050edba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:03.899972 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7d2a25-fd58-493d-96d2-c888050edba7 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:03.900253 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7d2a25-fd58-493d-96d2-c888050edba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:03.900518 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7d2a25-fd58-493d-96d2-c888050edba7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:03.901546 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7d2a25-fd58-493d-96d2-c888050edba7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:24:03.902375 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7d2a25-fd58-493d-96d2-c888050edba7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:03.905671 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7d2a25-fd58-493d-96d2-c888050edba7 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:03.924793 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 910/1807] 10.222.0.36 () {58 vars in 1153 bytes} [Tue Aug 9 10:24:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:24:03.937901 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a230ed-fb4b-472a-8741-d32f30b80050 service neutron] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:03.943399 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a230ed-fb4b-472a-8741-d32f30b80050 service neutron] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:03.948781 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83dbcf9-89c1-43fd-bd51-988775eca521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:03.950556 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83dbcf9-89c1-43fd-bd51-988775eca521 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:03.950929 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83dbcf9-89c1-43fd-bd51-988775eca521 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:03.951135 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83dbcf9-89c1-43fd-bd51-988775eca521 admin admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:03.952584 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83dbcf9-89c1-43fd-bd51-988775eca521 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:03.955403 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83dbcf9-89c1-43fd-bd51-988775eca521 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:04.004105 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 898/1808] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:24:03 2022] POST /identity/v3/projects => generated 389 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:24:04.006938 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7d2a25-fd58-493d-96d2-c888050edba7 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:04.023025 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7d2a25-fd58-493d-96d2-c888050edba7 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:04.067401 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:24:04.112795 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1093db4c-a2e4-4466-b57b-ea19c5dbf5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:04.113486 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1093db4c-a2e4-4466-b57b-ea19c5dbf5f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:04.113771 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1093db4c-a2e4-4466-b57b-ea19c5dbf5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:04.114125 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1093db4c-a2e4-4466-b57b-ea19c5dbf5f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:04.114924 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1093db4c-a2e4-4466-b57b-ea19c5dbf5f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:04.117313 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1093db4c-a2e4-4466-b57b-ea19c5dbf5f7 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:04.142726 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 911/1809] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:24:04 2022] POST /identity/v3/users => generated 295 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:24:04.146874 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83dbcf9-89c1-43fd-bd51-988775eca521 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:04.159543 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83dbcf9-89c1-43fd-bd51-988775eca521 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:04.164466 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db97002-5af1-41c4-8f2a-7d686a53e163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:04.165285 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db97002-5af1-41c4-8f2a-7d686a53e163 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:04.165443 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db97002-5af1-41c4-8f2a-7d686a53e163 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:04.165914 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db97002-5af1-41c4-8f2a-7d686a53e163 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:04.166439 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db97002-5af1-41c4-8f2a-7d686a53e163 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:04.168284 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db97002-5af1-41c4-8f2a-7d686a53e163 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:04.180408 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 899/1810] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:24:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:24:04.185101 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1093db4c-a2e4-4466-b57b-ea19c5dbf5f7 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:04.197687 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1093db4c-a2e4-4466-b57b-ea19c5dbf5f7 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:04.204126 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7baa1c-d4ed-4c5d-b4d1-ab9fd9706364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:04.204773 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7baa1c-d4ed-4c5d-b4d1-ab9fd9706364 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:04.205225 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7baa1c-d4ed-4c5d-b4d1-ab9fd9706364 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:04.205506 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7baa1c-d4ed-4c5d-b4d1-ab9fd9706364 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:04.206197 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7baa1c-d4ed-4c5d-b4d1-ab9fd9706364 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:04.207815 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7baa1c-d4ed-4c5d-b4d1-ab9fd9706364 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:04.221782 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 912/1811] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:24:04 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:24:04.225554 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db97002-5af1-41c4-8f2a-7d686a53e163 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:04.237030 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db97002-5af1-41c4-8f2a-7d686a53e163 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:04.244103 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825836a2-7927-46cd-bc3f-c34befddcd47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:04.245061 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825836a2-7927-46cd-bc3f-c34befddcd47 admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:04.245584 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825836a2-7927-46cd-bc3f-c34befddcd47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:04.245993 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825836a2-7927-46cd-bc3f-c34befddcd47 admin admin] PATH_INFO: `/v3/projects/020b83fb990749ddb5b316fc231cda34/users/8d7b760d83f247f7a54981d1239558ff/roles/a9895331e9694fa8b2b50908bb057bcb` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:04.265513 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825836a2-7927-46cd-bc3f-c34befddcd47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=020b83fb990749ddb5b316fc231cda34, user_id=8d7b760d83f247f7a54981d1239558ff, role_id=a9895331e9694fa8b2b50908bb057bcb)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:04.268301 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825836a2-7927-46cd-bc3f-c34befddcd47 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:04.287995 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 900/1812] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:24:04 2022] PUT /identity/v3/projects/020b83fb990749ddb5b316fc231cda34/users/8d7b760d83f247f7a54981d1239558ff/roles/a9895331e9694fa8b2b50908bb057bcb => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 10:24:04.301252 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9178e6a4-6266-4c74-9f2d-f6f17690c954 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:04.301602 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9178e6a4-6266-4c74-9f2d-f6f17690c954 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:04.301806 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9178e6a4-6266-4c74-9f2d-f6f17690c954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:04.331355 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-9178e6a4-6266-4c74-9f2d-f6f17690c954 None None] MFA Rules not processed for user `8d7b760d83f247f7a54981d1239558ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:24:04.332704 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-9178e6a4-6266-4c74-9f2d-f6f17690c954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:04.374372 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825836a2-7927-46cd-bc3f-c34befddcd47 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:04.376213 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-825836a2-7927-46cd-bc3f-c34befddcd47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:04.435560 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 913/1813] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:24:04 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:24:04.440093 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9178e6a4-6266-4c74-9f2d-f6f17690c954 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:04.467002 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825836a2-7927-46cd-bc3f-c34befddcd47 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:04.472685 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193998be-603d-4a81-b541-ef02f7f6a9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:04.473364 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193998be-603d-4a81-b541-ef02f7f6a9d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:04.473631 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193998be-603d-4a81-b541-ef02f7f6a9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:04.473930 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193998be-603d-4a81-b541-ef02f7f6a9d6 admin admin] PATH_INFO: `/v3/projects/3e31bc3915074a46bfd189988d4e4610` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:04.475201 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193998be-603d-4a81-b541-ef02f7f6a9d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e31bc3915074a46bfd189988d4e4610)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:04.477148 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193998be-603d-4a81-b541-ef02f7f6a9d6 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:04.506167 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:24:04.560930 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9178e6a4-6266-4c74-9f2d-f6f17690c954 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:04.562981 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-193998be-603d-4a81-b541-ef02f7f6a9d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e31bc3915074a46bfd189988d4e4610', 'request_id': 'req-193998be-603d-4a81-b541-ef02f7f6a9d6'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:04.570501 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-193998be-603d-4a81-b541-ef02f7f6a9d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e31bc3915074a46bfd189988d4e4610', 'request_id': 'req-193998be-603d-4a81-b541-ef02f7f6a9d6'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:04.579373 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-193998be-603d-4a81-b541-ef02f7f6a9d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e31bc3915074a46bfd189988d4e4610', 'request_id': 'req-193998be-603d-4a81-b541-ef02f7f6a9d6'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:04.599245 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-193998be-603d-4a81-b541-ef02f7f6a9d6 admin admin] The token cache is being invalidate because project 3e31bc3915074a46bfd189988d4e4610 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80105) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:24:04.600012 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-193998be-603d-4a81-b541-ef02f7f6a9d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:04.602682 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-193998be-603d-4a81-b541-ef02f7f6a9d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:04.606981 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 901/1814] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:24:04 2022] DELETE /identity/v3/projects/3e31bc3915074a46bfd189988d4e4610 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 10:24:04.610853 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193998be-603d-4a81-b541-ef02f7f6a9d6 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:04.613480 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-193998be-603d-4a81-b541-ef02f7f6a9d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:04.685411 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:24:04.733403 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193998be-603d-4a81-b541-ef02f7f6a9d6 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:04.741748 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f765fd-2efa-4856-888a-ff878f9216ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:04.742179 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f765fd-2efa-4856-888a-ff878f9216ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:04.742464 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f765fd-2efa-4856-888a-ff878f9216ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:04.742740 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f765fd-2efa-4856-888a-ff878f9216ba admin admin] PATH_INFO: `/v3/users/75a4e292bc6e44089ed05a9a4acd89c5` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:04.755883 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685b299c-e608-4790-ba5b-057b9aff4c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:04.756514 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b299c-e608-4790-ba5b-057b9aff4c44 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:04.756796 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b299c-e608-4790-ba5b-057b9aff4c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:04.757097 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b299c-e608-4790-ba5b-057b9aff4c44 admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:04.758391 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f765fd-2efa-4856-888a-ff878f9216ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=75a4e292bc6e44089ed05a9a4acd89c5)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:04.760508 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f765fd-2efa-4856-888a-ff878f9216ba admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:04.763295 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685b299c-e608-4790-ba5b-057b9aff4c44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:04.770429 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685b299c-e608-4790-ba5b-057b9aff4c44 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:04.833997 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 914/1815] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:24:04 2022] POST /identity/v3/projects => generated 387 bytes in 394 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 10:24:04.835726 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685b299c-e608-4790-ba5b-057b9aff4c44 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:04.838666 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-685b299c-e608-4790-ba5b-057b9aff4c44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:04.861524 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-a3f765fd-2efa-4856-888a-ff878f9216ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75a4e292bc6e44089ed05a9a4acd89c5'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:04.883400 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-a3f765fd-2efa-4856-888a-ff878f9216ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75a4e292bc6e44089ed05a9a4acd89c5'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:04.897287 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-a3f765fd-2efa-4856-888a-ff878f9216ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75a4e292bc6e44089ed05a9a4acd89c5'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:04.898548 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-a3f765fd-2efa-4856-888a-ff878f9216ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75a4e292bc6e44089ed05a9a4acd89c5'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:04.914099 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-a3f765fd-2efa-4856-888a-ff878f9216ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75a4e292bc6e44089ed05a9a4acd89c5'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:04.916047 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685b299c-e608-4790-ba5b-057b9aff4c44 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:04.924902 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 902/1816] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:24:04 2022] DELETE /identity/v3/users/75a4e292bc6e44089ed05a9a4acd89c5 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 10:24:04.929357 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f765fd-2efa-4856-888a-ff878f9216ba admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:04.932020 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-a3f765fd-2efa-4856-888a-ff878f9216ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:04.946518 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedebacf-f0b2-46fc-a7c5-0b3588f5ace8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:04.947455 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedebacf-f0b2-46fc-a7c5-0b3588f5ace8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:04.947532 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedebacf-f0b2-46fc-a7c5-0b3588f5ace8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:04.950471 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedebacf-f0b2-46fc-a7c5-0b3588f5ace8 admin admin] PATH_INFO: `/v3/users/17cf4adc847a4f1ebd5a8884db8b79fd` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:04.952755 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedebacf-f0b2-46fc-a7c5-0b3588f5ace8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17cf4adc847a4f1ebd5a8884db8b79fd)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:04.961540 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedebacf-f0b2-46fc-a7c5-0b3588f5ace8 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:04.975444 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:24:05.043725 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f765fd-2efa-4856-888a-ff878f9216ba admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:05.049266 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80032a37-b4db-4ec5-96af-60046a23b7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:05.049975 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80032a37-b4db-4ec5-96af-60046a23b7ec admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:05.050173 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80032a37-b4db-4ec5-96af-60046a23b7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:05.051272 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80032a37-b4db-4ec5-96af-60046a23b7ec admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:05.051877 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80032a37-b4db-4ec5-96af-60046a23b7ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:05.053000 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-cedebacf-f0b2-46fc-a7c5-0b3588f5ace8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17cf4adc847a4f1ebd5a8884db8b79fd'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:05.054335 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80032a37-b4db-4ec5-96af-60046a23b7ec admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:05.075039 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-cedebacf-f0b2-46fc-a7c5-0b3588f5ace8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17cf4adc847a4f1ebd5a8884db8b79fd'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:05.083966 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 903/1817] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:24:04 2022] POST /identity/v3/users => generated 300 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:24:05.087079 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-cedebacf-f0b2-46fc-a7c5-0b3588f5ace8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17cf4adc847a4f1ebd5a8884db8b79fd'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:05.087787 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80032a37-b4db-4ec5-96af-60046a23b7ec admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:05.087898 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-cedebacf-f0b2-46fc-a7c5-0b3588f5ace8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17cf4adc847a4f1ebd5a8884db8b79fd'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:05.097471 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-cedebacf-f0b2-46fc-a7c5-0b3588f5ace8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17cf4adc847a4f1ebd5a8884db8b79fd'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:05.101018 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80032a37-b4db-4ec5-96af-60046a23b7ec admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:05.105348 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 915/1818] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:24:04 2022] DELETE /identity/v3/users/17cf4adc847a4f1ebd5a8884db8b79fd => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:24:05.106234 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b32517f-6a14-48ec-80b5-a376ee4e741b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:05.106915 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32517f-6a14-48ec-80b5-a376ee4e741b admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:05.107279 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32517f-6a14-48ec-80b5-a376ee4e741b admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:05.107637 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32517f-6a14-48ec-80b5-a376ee4e741b admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:05.108357 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b32517f-6a14-48ec-80b5-a376ee4e741b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:05.110038 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a161aea-9148-4445-bdc0-5a3b8c121606 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:05.110149 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b32517f-6a14-48ec-80b5-a376ee4e741b admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:05.110329 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a161aea-9148-4445-bdc0-5a3b8c121606 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:05.110630 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a161aea-9148-4445-bdc0-5a3b8c121606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:05.121883 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 904/1819] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:24:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:24:05.125673 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b32517f-6a14-48ec-80b5-a376ee4e741b admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:05.128484 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-8b32517f-6a14-48ec-80b5-a376ee4e741b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:05.133453 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-9a161aea-9148-4445-bdc0-5a3b8c121606 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:24:05.134865 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-9a161aea-9148-4445-bdc0-5a3b8c121606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:05.143339 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b32517f-6a14-48ec-80b5-a376ee4e741b admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:05.203189 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:24:05.221795 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df8aeed-0258-4213-aa82-419228a1fdc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:05.222558 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df8aeed-0258-4213-aa82-419228a1fdc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:05.223168 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 916/1820] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:24:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:24:05.226095 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df8aeed-0258-4213-aa82-419228a1fdc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:05.226417 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df8aeed-0258-4213-aa82-419228a1fdc0 admin admin] PATH_INFO: `/v3/projects/be03e4b468db4d4da7ef4eb9924b56fb/users/72b4c95dfae94482a04a291b2d1908d7/roles/89ca30cbbb634be8a96e9921aa56626b` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:05.232835 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a161aea-9148-4445-bdc0-5a3b8c121606 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:05.239270 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-9a161aea-9148-4445-bdc0-5a3b8c121606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:05.246281 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df8aeed-0258-4213-aa82-419228a1fdc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be03e4b468db4d4da7ef4eb9924b56fb, user_id=72b4c95dfae94482a04a291b2d1908d7, role_id=89ca30cbbb634be8a96e9921aa56626b)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:05.253595 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df8aeed-0258-4213-aa82-419228a1fdc0 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:05.273952 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 905/1821] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:24:05 2022] PUT /identity/v3/projects/be03e4b468db4d4da7ef4eb9924b56fb/users/72b4c95dfae94482a04a291b2d1908d7/roles/89ca30cbbb634be8a96e9921aa56626b => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 10:24:05.278548 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df8aeed-0258-4213-aa82-419228a1fdc0 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:05.367950 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a161aea-9148-4445-bdc0-5a3b8c121606 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:05.383102 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df8aeed-0258-4213-aa82-419228a1fdc0 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:05.392199 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9477cc0b-4316-4541-9625-e4377c657383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:05.400341 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9477cc0b-4316-4541-9625-e4377c657383 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:05.400577 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9477cc0b-4316-4541-9625-e4377c657383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:05.400807 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9477cc0b-4316-4541-9625-e4377c657383 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:05.402187 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9477cc0b-4316-4541-9625-e4377c657383 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:05.409107 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9477cc0b-4316-4541-9625-e4377c657383 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:05.454680 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 906/1822] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:24:05 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:24:05.458002 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9477cc0b-4316-4541-9625-e4377c657383 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:05.487009 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9477cc0b-4316-4541-9625-e4377c657383 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:05.501469 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c518a117-4b98-447b-9b94-f5229b4e989a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:05.504915 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c518a117-4b98-447b-9b94-f5229b4e989a admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:05.505232 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c518a117-4b98-447b-9b94-f5229b4e989a admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:05.506357 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c518a117-4b98-447b-9b94-f5229b4e989a admin admin] PATH_INFO: `/v3/projects/be03e4b468db4d4da7ef4eb9924b56fb/users/72b4c95dfae94482a04a291b2d1908d7/roles/89ca30cbbb634be8a96e9921aa56626b` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:05.513869 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c518a117-4b98-447b-9b94-f5229b4e989a admin admin] RBAC: Authorizing `identity:create_grant(project_id=be03e4b468db4d4da7ef4eb9924b56fb, user_id=72b4c95dfae94482a04a291b2d1908d7, role_id=89ca30cbbb634be8a96e9921aa56626b)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:05.525013 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c518a117-4b98-447b-9b94-f5229b4e989a admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:05.541159 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48232c05-1edd-4f9c-a28b-97cfef48428e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:05.541799 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48232c05-1edd-4f9c-a28b-97cfef48428e service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:05.542124 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48232c05-1edd-4f9c-a28b-97cfef48428e service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:05.542401 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48232c05-1edd-4f9c-a28b-97cfef48428e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:05.556157 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 907/1823] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:24:05 2022] PUT /identity/v3/projects/be03e4b468db4d4da7ef4eb9924b56fb/users/72b4c95dfae94482a04a291b2d1908d7/roles/89ca30cbbb634be8a96e9921aa56626b => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:24:05.564608 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48232c05-1edd-4f9c-a28b-97cfef48428e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:05.567077 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d1ae5-e44e-419f-a3cf-fcb2069f5603 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:05.567766 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d1ae5-e44e-419f-a3cf-fcb2069f5603 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:05.567881 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d1ae5-e44e-419f-a3cf-fcb2069f5603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:05.568744 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48232c05-1edd-4f9c-a28b-97cfef48428e service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:05.596217 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 917/1824] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:24:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 10:24:05.624510 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:24:05.648278 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-d28d1ae5-e44e-419f-a3cf-fcb2069f5603 None None] MFA Rules not processed for user `72b4c95dfae94482a04a291b2d1908d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:24:05.650412 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-d28d1ae5-e44e-419f-a3cf-fcb2069f5603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:05.783033 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d18b86-da2b-497d-983e-4c24d67a37a3 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:05.783331 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d18b86-da2b-497d-983e-4c24d67a37a3 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:05.783611 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d18b86-da2b-497d-983e-4c24d67a37a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:05.811240 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-86d18b86-da2b-497d-983e-4c24d67a37a3 None None] MFA Rules not processed for user `74925532a3b64d21b4e861ec70bc4345`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:24:05.813170 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-86d18b86-da2b-497d-983e-4c24d67a37a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:05.829303 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 908/1825] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:24:05 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:24:05.842118 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28d1ae5-e44e-419f-a3cf-fcb2069f5603 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:05.844630 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-d28d1ae5-e44e-419f-a3cf-fcb2069f5603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:05.929606 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 918/1826] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:24:05 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:24:05.990027 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28d1ae5-e44e-419f-a3cf-fcb2069f5603 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:05.997219 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ffae0b-b60d-4344-961a-a5b698681377 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6c687a38524de0bf23d87ae91d3b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:05.997912 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ffae0b-b60d-4344-961a-a5b698681377 service cinder] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:05.999097 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ffae0b-b60d-4344-961a-a5b698681377 service cinder] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:05.999097 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ffae0b-b60d-4344-961a-a5b698681377 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:06.030750 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ffae0b-b60d-4344-961a-a5b698681377 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:06.034338 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ffae0b-b60d-4344-961a-a5b698681377 service cinder] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:06.069245 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 909/1827] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:24:05 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:24:06.132703 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d18b86-da2b-497d-983e-4c24d67a37a3 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:06.134027 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-86d18b86-da2b-497d-983e-4c24d67a37a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:06.273024 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:24:06.282024 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d18b86-da2b-497d-983e-4c24d67a37a3 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:06.298163 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea809717-ad11-47bc-8726-d8373f062185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:06.298825 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea809717-ad11-47bc-8726-d8373f062185 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:06.299716 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea809717-ad11-47bc-8726-d8373f062185 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:06.299996 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea809717-ad11-47bc-8726-d8373f062185 admin admin] PATH_INFO: `/v3/projects/e76dc718da4b4363ac4dc637b2e82563` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:06.301420 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea809717-ad11-47bc-8726-d8373f062185 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e76dc718da4b4363ac4dc637b2e82563)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:06.303719 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea809717-ad11-47bc-8726-d8373f062185 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:06.316003 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ffae0b-b60d-4344-961a-a5b698681377 service cinder] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:06.326604 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ffae0b-b60d-4344-961a-a5b698681377 service cinder] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:06.333331 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9887d9cb-8e37-4ded-b3a8-e717835edf26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:06.336294 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9887d9cb-8e37-4ded-b3a8-e717835edf26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:06.336583 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9887d9cb-8e37-4ded-b3a8-e717835edf26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:06.336863 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9887d9cb-8e37-4ded-b3a8-e717835edf26 admin admin] PATH_INFO: `/v3/users/8d7b760d83f247f7a54981d1239558ff` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:06.338191 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9887d9cb-8e37-4ded-b3a8-e717835edf26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d7b760d83f247f7a54981d1239558ff)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:06.342572 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9887d9cb-8e37-4ded-b3a8-e717835edf26 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:06.390515 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-ea809717-ad11-47bc-8726-d8373f062185 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e76dc718da4b4363ac4dc637b2e82563', 'request_id': 'req-ea809717-ad11-47bc-8726-d8373f062185'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:06.397823 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-ea809717-ad11-47bc-8726-d8373f062185 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e76dc718da4b4363ac4dc637b2e82563', 'request_id': 'req-ea809717-ad11-47bc-8726-d8373f062185'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:06.406827 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-ea809717-ad11-47bc-8726-d8373f062185 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e76dc718da4b4363ac4dc637b2e82563', 'request_id': 'req-ea809717-ad11-47bc-8726-d8373f062185'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:06.414482 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-9887d9cb-8e37-4ded-b3a8-e717835edf26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d7b760d83f247f7a54981d1239558ff'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:06.428590 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-9887d9cb-8e37-4ded-b3a8-e717835edf26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d7b760d83f247f7a54981d1239558ff'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:06.437348 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-9887d9cb-8e37-4ded-b3a8-e717835edf26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d7b760d83f247f7a54981d1239558ff'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:06.438094 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-9887d9cb-8e37-4ded-b3a8-e717835edf26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d7b760d83f247f7a54981d1239558ff'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:06.457469 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-9887d9cb-8e37-4ded-b3a8-e717835edf26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d7b760d83f247f7a54981d1239558ff'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:06.458752 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-ea809717-ad11-47bc-8726-d8373f062185 admin admin] The token cache is being invalidate because project e76dc718da4b4363ac4dc637b2e82563 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:24:06.459035 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-ea809717-ad11-47bc-8726-d8373f062185 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:06.460241 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-ea809717-ad11-47bc-8726-d8373f062185 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:06.467465 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 919/1828] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:24:06 2022] DELETE /identity/v3/projects/e76dc718da4b4363ac4dc637b2e82563 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:24:06.470462 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea809717-ad11-47bc-8726-d8373f062185 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:06.470876 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 910/1829] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:24:06 2022] DELETE /identity/v3/users/8d7b760d83f247f7a54981d1239558ff => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 10:24:06.472995 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37d09f-ac80-454c-a909-b476beef3e02 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:06.473340 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37d09f-ac80-454c-a909-b476beef3e02 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:06.473561 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37d09f-ac80-454c-a909-b476beef3e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:06.476601 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-ea809717-ad11-47bc-8726-d8373f062185 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:06.491552 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:24:06.499776 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-8f37d09f-ac80-454c-a909-b476beef3e02 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:24:06.504187 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-8f37d09f-ac80-454c-a909-b476beef3e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:06.577719 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea809717-ad11-47bc-8726-d8373f062185 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:06.582623 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb93c98-a1e3-4973-ab9f-a256ae12d577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:06.583283 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb93c98-a1e3-4973-ab9f-a256ae12d577 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:06.583560 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb93c98-a1e3-4973-ab9f-a256ae12d577 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:06.584052 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 911/1830] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:24:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:24:06.586025 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb93c98-a1e3-4973-ab9f-a256ae12d577 admin admin] PATH_INFO: `/v3/users/6cb37977149141e696a38909860ac936` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:06.587361 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb93c98-a1e3-4973-ab9f-a256ae12d577 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cb37977149141e696a38909860ac936)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:06.589483 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb93c98-a1e3-4973-ab9f-a256ae12d577 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:06.595791 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f37d09f-ac80-454c-a909-b476beef3e02 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:06.597655 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-8f37d09f-ac80-454c-a909-b476beef3e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:06.651553 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-9cb93c98-a1e3-4973-ab9f-a256ae12d577 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cb37977149141e696a38909860ac936'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:06.668729 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f37d09f-ac80-454c-a909-b476beef3e02 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:06.673369 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f6aee7-6762-4f36-bb8f-34fec0457419 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:06.673653 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-9cb93c98-a1e3-4973-ab9f-a256ae12d577 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cb37977149141e696a38909860ac936'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:06.674373 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f6aee7-6762-4f36-bb8f-34fec0457419 service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:06.674997 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f6aee7-6762-4f36-bb8f-34fec0457419 service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:06.675462 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f6aee7-6762-4f36-bb8f-34fec0457419 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:06.683474 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-9cb93c98-a1e3-4973-ab9f-a256ae12d577 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cb37977149141e696a38909860ac936'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:06.685246 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-9cb93c98-a1e3-4973-ab9f-a256ae12d577 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cb37977149141e696a38909860ac936'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:06.687974 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f6aee7-6762-4f36-bb8f-34fec0457419 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:06.689406 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f6aee7-6762-4f36-bb8f-34fec0457419 service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:06.694484 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-9cb93c98-a1e3-4973-ab9f-a256ae12d577 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cb37977149141e696a38909860ac936'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:06.702427 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 920/1831] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:24:06 2022] DELETE /identity/v3/users/6cb37977149141e696a38909860ac936 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:24:06.708442 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 912/1832] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:24:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 10:24:06.802752 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb93c98-a1e3-4973-ab9f-a256ae12d577 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:06.804350 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-9cb93c98-a1e3-4973-ab9f-a256ae12d577 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:06.815075 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:24:06.950033 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb93c98-a1e3-4973-ab9f-a256ae12d577 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:06.956026 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfc8159-a0e5-4b1c-a240-01bd48a8b406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:06.956745 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc8159-a0e5-4b1c-a240-01bd48a8b406 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:06.957026 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc8159-a0e5-4b1c-a240-01bd48a8b406 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:06.957534 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc8159-a0e5-4b1c-a240-01bd48a8b406 admin admin] PATH_INFO: `/v3/projects/656bb19b739b4f658fd9894f0898f5a4` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:06.959296 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfc8159-a0e5-4b1c-a240-01bd48a8b406 admin admin] RBAC: Authorizing `identity:delete_project(project_id=656bb19b739b4f658fd9894f0898f5a4)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:06.964594 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfc8159-a0e5-4b1c-a240-01bd48a8b406 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:07.023924 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-edfc8159-a0e5-4b1c-a240-01bd48a8b406 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '656bb19b739b4f658fd9894f0898f5a4', 'request_id': 'req-edfc8159-a0e5-4b1c-a240-01bd48a8b406'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:07.033150 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-edfc8159-a0e5-4b1c-a240-01bd48a8b406 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '656bb19b739b4f658fd9894f0898f5a4', 'request_id': 'req-edfc8159-a0e5-4b1c-a240-01bd48a8b406'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:07.042567 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-edfc8159-a0e5-4b1c-a240-01bd48a8b406 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '656bb19b739b4f658fd9894f0898f5a4', 'request_id': 'req-edfc8159-a0e5-4b1c-a240-01bd48a8b406'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:07.070510 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-edfc8159-a0e5-4b1c-a240-01bd48a8b406 admin admin] The token cache is being invalidate because project 656bb19b739b4f658fd9894f0898f5a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:24:07.070841 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-edfc8159-a0e5-4b1c-a240-01bd48a8b406 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:07.071497 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-edfc8159-a0e5-4b1c-a240-01bd48a8b406 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:07.073091 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 921/1833] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:24:06 2022] DELETE /identity/v3/projects/656bb19b739b4f658fd9894f0898f5a4 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:24:07.078486 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c8989c-9563-46a4-8518-9f392dd65fe3 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:07.078866 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c8989c-9563-46a4-8518-9f392dd65fe3 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:07.079240 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c8989c-9563-46a4-8518-9f392dd65fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:07.108172 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-d7c8989c-9563-46a4-8518-9f392dd65fe3 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:24:07.109778 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-d7c8989c-9563-46a4-8518-9f392dd65fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:07.203532 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 913/1834] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:24:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:24:07.211791 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470181a7-0fb7-4eca-b518-5d2e55eb9b9c None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:07.212076 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470181a7-0fb7-4eca-b518-5d2e55eb9b9c None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:07.212376 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470181a7-0fb7-4eca-b518-5d2e55eb9b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:07.268590 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-470181a7-0fb7-4eca-b518-5d2e55eb9b9c None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:24:07.271725 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-470181a7-0fb7-4eca-b518-5d2e55eb9b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:07.289363 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 922/1835] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:24:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:24:07.294448 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c8989c-9563-46a4-8518-9f392dd65fe3 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:07.304625 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c8989c-9563-46a4-8518-9f392dd65fe3 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:07.310026 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd38ca07-0eb7-4b3b-8d4a-3c8e4e75dc13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:07.310724 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd38ca07-0eb7-4b3b-8d4a-3c8e4e75dc13 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:07.311069 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd38ca07-0eb7-4b3b-8d4a-3c8e4e75dc13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:07.311406 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd38ca07-0eb7-4b3b-8d4a-3c8e4e75dc13 admin admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:07.312141 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd38ca07-0eb7-4b3b-8d4a-3c8e4e75dc13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:24:07.312838 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd38ca07-0eb7-4b3b-8d4a-3c8e4e75dc13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:07.315011 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd38ca07-0eb7-4b3b-8d4a-3c8e4e75dc13 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:07.338418 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 914/1836] 10.222.0.36 () {58 vars in 1153 bytes} [Tue Aug 9 10:24:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:24:07.342747 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470181a7-0fb7-4eca-b518-5d2e55eb9b9c None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:07.353750 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470181a7-0fb7-4eca-b518-5d2e55eb9b9c None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:07.359581 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee50055-52f7-471f-8590-6129375ba791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:07.360133 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee50055-52f7-471f-8590-6129375ba791 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:07.360481 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee50055-52f7-471f-8590-6129375ba791 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:07.360678 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee50055-52f7-471f-8590-6129375ba791 admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:07.361315 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee50055-52f7-471f-8590-6129375ba791 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:07.363389 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee50055-52f7-471f-8590-6129375ba791 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:07.400774 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 923/1837] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:24:07 2022] POST /identity/v3/projects => generated 375 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:24:07.401971 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd38ca07-0eb7-4b3b-8d4a-3c8e4e75dc13 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:07.419163 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd38ca07-0eb7-4b3b-8d4a-3c8e4e75dc13 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:07.474687 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:24:07.535462 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9260780-84fb-4ecb-8cfe-20fb77ed79f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:07.536337 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9260780-84fb-4ecb-8cfe-20fb77ed79f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:07.536519 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9260780-84fb-4ecb-8cfe-20fb77ed79f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:07.536792 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9260780-84fb-4ecb-8cfe-20fb77ed79f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:07.537447 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9260780-84fb-4ecb-8cfe-20fb77ed79f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:07.539571 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9260780-84fb-4ecb-8cfe-20fb77ed79f3 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:07.573113 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee50055-52f7-471f-8590-6129375ba791 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:07.575012 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-fee50055-52f7-471f-8590-6129375ba791 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:07.585019 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 915/1838] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:24:07 2022] POST /identity/v3/users => generated 288 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:24:07.589358 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9260780-84fb-4ecb-8cfe-20fb77ed79f3 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:07.605039 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee50055-52f7-471f-8590-6129375ba791 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:07.605234 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9260780-84fb-4ecb-8cfe-20fb77ed79f3 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:07.628728 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ddc9d2-34a4-40f7-b946-cec9feb1fd6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:07.629401 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ddc9d2-34a4-40f7-b946-cec9feb1fd6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:07.629681 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ddc9d2-34a4-40f7-b946-cec9feb1fd6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:07.629979 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ddc9d2-34a4-40f7-b946-cec9feb1fd6b admin admin] PATH_INFO: `/v3/projects/c2c1686c63c14038b9117e3a8698da2c` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:07.631343 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03587271-a0a4-4daa-b849-5915c1395009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:07.632093 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03587271-a0a4-4daa-b849-5915c1395009 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:07.632384 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03587271-a0a4-4daa-b849-5915c1395009 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:07.632726 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03587271-a0a4-4daa-b849-5915c1395009 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:07.633465 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03587271-a0a4-4daa-b849-5915c1395009 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:07.635173 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ddc9d2-34a4-40f7-b946-cec9feb1fd6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2c1686c63c14038b9117e3a8698da2c)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:07.635490 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03587271-a0a4-4daa-b849-5915c1395009 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:07.637682 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ddc9d2-34a4-40f7-b946-cec9feb1fd6b admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:07.663883 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 916/1839] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:24:07 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:24:07.670964 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03587271-a0a4-4daa-b849-5915c1395009 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:07.689113 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03587271-a0a4-4daa-b849-5915c1395009 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:07.695151 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cea871-0fbd-420f-8e11-f06ff0d2fd0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:07.696197 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cea871-0fbd-420f-8e11-f06ff0d2fd0f admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:07.696614 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cea871-0fbd-420f-8e11-f06ff0d2fd0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:07.697028 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cea871-0fbd-420f-8e11-f06ff0d2fd0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:07.697819 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cea871-0fbd-420f-8e11-f06ff0d2fd0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:07.700269 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cea871-0fbd-420f-8e11-f06ff0d2fd0f admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:07.714582 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 917/1840] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:24:07 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:24:07.716023 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cea871-0fbd-420f-8e11-f06ff0d2fd0f admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:07.719116 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-20cea871-0fbd-420f-8e11-f06ff0d2fd0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:07.736652 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cea871-0fbd-420f-8e11-f06ff0d2fd0f admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:07.755314 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-09ddc9d2-34a4-40f7-b946-cec9feb1fd6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2c1686c63c14038b9117e3a8698da2c', 'request_id': 'req-09ddc9d2-34a4-40f7-b946-cec9feb1fd6b'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:07.770730 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-09ddc9d2-34a4-40f7-b946-cec9feb1fd6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2c1686c63c14038b9117e3a8698da2c', 'request_id': 'req-09ddc9d2-34a4-40f7-b946-cec9feb1fd6b'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:07.774990 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:24:07.785737 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-09ddc9d2-34a4-40f7-b946-cec9feb1fd6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2c1686c63c14038b9117e3a8698da2c', 'request_id': 'req-09ddc9d2-34a4-40f7-b946-cec9feb1fd6b'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:07.824694 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-09ddc9d2-34a4-40f7-b946-cec9feb1fd6b admin admin] The token cache is being invalidate because project c2c1686c63c14038b9117e3a8698da2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:24:07.825075 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-09ddc9d2-34a4-40f7-b946-cec9feb1fd6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:07.829525 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-09ddc9d2-34a4-40f7-b946-cec9feb1fd6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:07.833286 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b9c6ac-e3d1-4b5e-9a80-e798b53cd9f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:07.835969 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b9c6ac-e3d1-4b5e-9a80-e798b53cd9f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:07.836334 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 924/1841] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:24:07 2022] DELETE /identity/v3/projects/c2c1686c63c14038b9117e3a8698da2c => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:24:07.837245 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ddc9d2-34a4-40f7-b946-cec9feb1fd6b admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:07.838072 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b9c6ac-e3d1-4b5e-9a80-e798b53cd9f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:07.838373 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b9c6ac-e3d1-4b5e-9a80-e798b53cd9f5 admin admin] PATH_INFO: `/v3/projects/020b83fb990749ddb5b316fc231cda34` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:07.841778 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-09ddc9d2-34a4-40f7-b946-cec9feb1fd6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:07.843424 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b9c6ac-e3d1-4b5e-9a80-e798b53cd9f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=020b83fb990749ddb5b316fc231cda34)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:07.845832 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b9c6ac-e3d1-4b5e-9a80-e798b53cd9f5 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:07.881793 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ddc9d2-34a4-40f7-b946-cec9feb1fd6b admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:07.898558 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95e59a7-b03d-4441-8c32-4229ab857d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:07.899552 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e59a7-b03d-4441-8c32-4229ab857d0e admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:07.899839 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e59a7-b03d-4441-8c32-4229ab857d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:07.902479 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e59a7-b03d-4441-8c32-4229ab857d0e admin admin] PATH_INFO: `/v3/projects/04c6cccdd2bd42189bc0b8e8c3ae95b9/users/8193c8a5563049c6b88678a11e6d3d17/roles/a9895331e9694fa8b2b50908bb057bcb` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:07.935580 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-b1b9c6ac-e3d1-4b5e-9a80-e798b53cd9f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '020b83fb990749ddb5b316fc231cda34', 'request_id': 'req-b1b9c6ac-e3d1-4b5e-9a80-e798b53cd9f5'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:07.938088 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95e59a7-b03d-4441-8c32-4229ab857d0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=04c6cccdd2bd42189bc0b8e8c3ae95b9, user_id=8193c8a5563049c6b88678a11e6d3d17, role_id=a9895331e9694fa8b2b50908bb057bcb)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:07.944862 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95e59a7-b03d-4441-8c32-4229ab857d0e admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:07.947343 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-b1b9c6ac-e3d1-4b5e-9a80-e798b53cd9f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '020b83fb990749ddb5b316fc231cda34', 'request_id': 'req-b1b9c6ac-e3d1-4b5e-9a80-e798b53cd9f5'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:07.959912 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-b1b9c6ac-e3d1-4b5e-9a80-e798b53cd9f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '020b83fb990749ddb5b316fc231cda34', 'request_id': 'req-b1b9c6ac-e3d1-4b5e-9a80-e798b53cd9f5'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:07.975142 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-b1b9c6ac-e3d1-4b5e-9a80-e798b53cd9f5 admin admin] The token cache is being invalidate because project 020b83fb990749ddb5b316fc231cda34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80105) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:24:07.975594 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-b1b9c6ac-e3d1-4b5e-9a80-e798b53cd9f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:07.976357 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-b1b9c6ac-e3d1-4b5e-9a80-e798b53cd9f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:07.978689 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 918/1842] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:24:07 2022] DELETE /identity/v3/projects/020b83fb990749ddb5b316fc231cda34 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:24:07.980252 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14eb467-7d50-41ea-831a-d2ce20522a61 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:07.981621 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14eb467-7d50-41ea-831a-d2ce20522a61 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:07.982513 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14eb467-7d50-41ea-831a-d2ce20522a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:07.995608 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 925/1843] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:24:07 2022] PUT /identity/v3/projects/04c6cccdd2bd42189bc0b8e8c3ae95b9/users/8193c8a5563049c6b88678a11e6d3d17/roles/a9895331e9694fa8b2b50908bb057bcb => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:24:07.997171 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95e59a7-b03d-4441-8c32-4229ab857d0e admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:07.999990 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-c95e59a7-b03d-4441-8c32-4229ab857d0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:08.005707 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-a14eb467-7d50-41ea-831a-d2ce20522a61 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:24:08.007565 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-a14eb467-7d50-41ea-831a-d2ce20522a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:08.056880 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:24:08.103152 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 919/1844] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:24:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:24:08.104487 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d000d57e-16a8-410c-ab70-cfc27ed7b745 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:08.104777 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d000d57e-16a8-410c-ab70-cfc27ed7b745 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:08.105048 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d000d57e-16a8-410c-ab70-cfc27ed7b745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:08.111699 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95e59a7-b03d-4441-8c32-4229ab857d0e admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:08.120222 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b318249-323d-4e2f-a487-f77f9ef9784f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:08.120868 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b318249-323d-4e2f-a487-f77f9ef9784f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:08.121211 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b318249-323d-4e2f-a487-f77f9ef9784f admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:08.122328 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b318249-323d-4e2f-a487-f77f9ef9784f admin admin] PATH_INFO: `/v3/users/72b4c95dfae94482a04a291b2d1908d7` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:08.124453 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b318249-323d-4e2f-a487-f77f9ef9784f admin admin] RBAC: Authorizing `identity:delete_user(user_id=72b4c95dfae94482a04a291b2d1908d7)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:08.130282 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b318249-323d-4e2f-a487-f77f9ef9784f admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:08.174363 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-d000d57e-16a8-410c-ab70-cfc27ed7b745 None None] MFA Rules not processed for user `8193c8a5563049c6b88678a11e6d3d17`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:24:08.174363 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-d000d57e-16a8-410c-ab70-cfc27ed7b745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:08.225991 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-7b318249-323d-4e2f-a487-f77f9ef9784f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72b4c95dfae94482a04a291b2d1908d7'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:08.248497 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-7b318249-323d-4e2f-a487-f77f9ef9784f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72b4c95dfae94482a04a291b2d1908d7'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:08.263279 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-7b318249-323d-4e2f-a487-f77f9ef9784f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72b4c95dfae94482a04a291b2d1908d7'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:08.264492 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-7b318249-323d-4e2f-a487-f77f9ef9784f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72b4c95dfae94482a04a291b2d1908d7'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:08.275161 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 920/1845] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:24:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:24:08.275161 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc3d485-52d9-4483-98d5-ff25dcc39445 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:08.275161 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc3d485-52d9-4483-98d5-ff25dcc39445 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:08.275161 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc3d485-52d9-4483-98d5-ff25dcc39445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:08.279839 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-7b318249-323d-4e2f-a487-f77f9ef9784f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72b4c95dfae94482a04a291b2d1908d7'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:08.294992 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 926/1846] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:24:07 2022] DELETE /identity/v3/users/72b4c95dfae94482a04a291b2d1908d7 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:24:08.296278 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b318249-323d-4e2f-a487-f77f9ef9784f admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:08.302913 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-7b318249-323d-4e2f-a487-f77f9ef9784f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:08.303917 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-acc3d485-52d9-4483-98d5-ff25dcc39445 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:24:08.305161 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-acc3d485-52d9-4483-98d5-ff25dcc39445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:08.371374 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=86,keystone:INSERT=3,keystone:DELETE=11 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:24:08.399922 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 921/1847] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:24:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:24:08.407804 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc3d485-52d9-4483-98d5-ff25dcc39445 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:08.450227 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc3d485-52d9-4483-98d5-ff25dcc39445 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:08.465995 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2afe68-ad22-44d7-87bc-83109ac5ddcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:08.466524 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2afe68-ad22-44d7-87bc-83109ac5ddcf admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:08.467314 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2afe68-ad22-44d7-87bc-83109ac5ddcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:08.467625 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2afe68-ad22-44d7-87bc-83109ac5ddcf admin admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:08.469459 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2afe68-ad22-44d7-87bc-83109ac5ddcf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:24:08.469823 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2afe68-ad22-44d7-87bc-83109ac5ddcf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:08.473976 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2afe68-ad22-44d7-87bc-83109ac5ddcf admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:08.498714 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b318249-323d-4e2f-a487-f77f9ef9784f admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:08.507379 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 922/1848] 10.222.0.36 () {58 vars in 1153 bytes} [Tue Aug 9 10:24:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:24:08.509298 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2afe68-ad22-44d7-87bc-83109ac5ddcf admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:08.520360 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8608a4e6-47e6-4ed0-9538-2200a895b986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:08.521007 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608a4e6-47e6-4ed0-9538-2200a895b986 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:08.521289 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608a4e6-47e6-4ed0-9538-2200a895b986 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:08.521528 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2afe68-ad22-44d7-87bc-83109ac5ddcf admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:08.521655 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608a4e6-47e6-4ed0-9538-2200a895b986 admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:08.522245 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8608a4e6-47e6-4ed0-9538-2200a895b986 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:08.526896 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ff4ee4-920b-4ca5-b70c-f4deea10d4ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:08.528310 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ff4ee4-920b-4ca5-b70c-f4deea10d4ef admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:08.528749 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ff4ee4-920b-4ca5-b70c-f4deea10d4ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:08.529308 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ff4ee4-920b-4ca5-b70c-f4deea10d4ef admin admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:08.530361 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ff4ee4-920b-4ca5-b70c-f4deea10d4ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:08.531010 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8608a4e6-47e6-4ed0-9538-2200a895b986 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:08.532402 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ff4ee4-920b-4ca5-b70c-f4deea10d4ef admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:08.578060 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 923/1849] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:24:08 2022] POST /identity/v3/projects => generated 367 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:24:08.578236 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ff4ee4-920b-4ca5-b70c-f4deea10d4ef admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:08.612739 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 927/1850] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:24:08 2022] POST /identity/v3/projects => generated 375 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:24:08.613649 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8608a4e6-47e6-4ed0-9538-2200a895b986 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:08.664484 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:24:08.764265 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ff4ee4-920b-4ca5-b70c-f4deea10d4ef admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:08.810181 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8608a4e6-47e6-4ed0-9538-2200a895b986 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:08.826650 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4583e36e-4593-4d33-8379-5373c0239498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:08.827465 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4583e36e-4593-4d33-8379-5373c0239498 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:08.827752 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4583e36e-4593-4d33-8379-5373c0239498 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:08.828058 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4583e36e-4593-4d33-8379-5373c0239498 admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:08.828651 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4583e36e-4593-4d33-8379-5373c0239498 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:08.830622 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4583e36e-4593-4d33-8379-5373c0239498 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:08.875992 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 928/1851] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:24:08 2022] POST /identity/v3/users => generated 294 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:24:08.879806 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4583e36e-4593-4d33-8379-5373c0239498 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:08.892495 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4583e36e-4593-4d33-8379-5373c0239498 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:08.896264 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1990e667-5acf-49aa-bc85-f5fffc033666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:08.896902 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990e667-5acf-49aa-bc85-f5fffc033666 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:08.897185 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990e667-5acf-49aa-bc85-f5fffc033666 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:08.897464 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990e667-5acf-49aa-bc85-f5fffc033666 admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:08.897641 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366b93a3-4cba-4fed-8297-ccabbf6a5f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:08.898133 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1990e667-5acf-49aa-bc85-f5fffc033666 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:08.898409 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b93a3-4cba-4fed-8297-ccabbf6a5f54 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:08.898693 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b93a3-4cba-4fed-8297-ccabbf6a5f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:08.898965 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b93a3-4cba-4fed-8297-ccabbf6a5f54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:08.900081 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1990e667-5acf-49aa-bc85-f5fffc033666 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:08.900194 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366b93a3-4cba-4fed-8297-ccabbf6a5f54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:08.902698 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366b93a3-4cba-4fed-8297-ccabbf6a5f54 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:08.918494 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 929/1852] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:24:08 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 10:24:08.920577 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366b93a3-4cba-4fed-8297-ccabbf6a5f54 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:08.951651 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 924/1853] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:24:08 2022] POST /identity/v3/users => generated 284 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:24:08.955946 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366b93a3-4cba-4fed-8297-ccabbf6a5f54 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:08.960657 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1990e667-5acf-49aa-bc85-f5fffc033666 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:08.972204 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746413f2-ef7f-43ef-af33-82c4153ce64b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:08.973083 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746413f2-ef7f-43ef-af33-82c4153ce64b admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:08.973508 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746413f2-ef7f-43ef-af33-82c4153ce64b admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:08.974070 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746413f2-ef7f-43ef-af33-82c4153ce64b admin admin] PATH_INFO: `/v3/projects/7741caa0895f433bb0877028246341fe/users/fa8d2c174b0d44e68662adcd024cdcfb/roles/89ca30cbbb634be8a96e9921aa56626b` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:08.980684 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1990e667-5acf-49aa-bc85-f5fffc033666 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:08.992318 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746413f2-ef7f-43ef-af33-82c4153ce64b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7741caa0895f433bb0877028246341fe, user_id=fa8d2c174b0d44e68662adcd024cdcfb, role_id=89ca30cbbb634be8a96e9921aa56626b)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:08.995010 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746413f2-ef7f-43ef-af33-82c4153ce64b admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:08.995163 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052353df-f035-4102-a88e-9ce30b3e4b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:08.995791 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052353df-f035-4102-a88e-9ce30b3e4b76 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:08.996124 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052353df-f035-4102-a88e-9ce30b3e4b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:08.996462 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052353df-f035-4102-a88e-9ce30b3e4b76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:08.997045 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052353df-f035-4102-a88e-9ce30b3e4b76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:08.998897 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052353df-f035-4102-a88e-9ce30b3e4b76 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:09.014400 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 930/1854] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:24:08 2022] PUT /identity/v3/projects/7741caa0895f433bb0877028246341fe/users/fa8d2c174b0d44e68662adcd024cdcfb/roles/89ca30cbbb634be8a96e9921aa56626b => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:24:09.019386 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746413f2-ef7f-43ef-af33-82c4153ce64b admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:09.030731 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 925/1855] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:24:08 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:24:09.031916 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052353df-f035-4102-a88e-9ce30b3e4b76 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:09.051379 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052353df-f035-4102-a88e-9ce30b3e4b76 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:09.165259 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61548952-69eb-41a6-8a93-2be9e6548c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:09.165892 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61548952-69eb-41a6-8a93-2be9e6548c36 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:09.166177 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61548952-69eb-41a6-8a93-2be9e6548c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:09.166452 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61548952-69eb-41a6-8a93-2be9e6548c36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:09.167099 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61548952-69eb-41a6-8a93-2be9e6548c36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:09.169174 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61548952-69eb-41a6-8a93-2be9e6548c36 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:09.195022 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 926/1856] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:24:09 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 10:24:09.199077 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61548952-69eb-41a6-8a93-2be9e6548c36 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:09.201958 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746413f2-ef7f-43ef-af33-82c4153ce64b admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:09.220441 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61548952-69eb-41a6-8a93-2be9e6548c36 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:09.224231 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9589bea-9be0-444b-a716-6b3951ec61c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:09.225104 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9589bea-9be0-444b-a716-6b3951ec61c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:09.225439 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9589bea-9be0-444b-a716-6b3951ec61c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:09.225872 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9589bea-9be0-444b-a716-6b3951ec61c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:09.227267 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9589bea-9be0-444b-a716-6b3951ec61c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:09.238090 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9589bea-9be0-444b-a716-6b3951ec61c1 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:09.238776 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb8f5b2-8666-442e-9a71-09bcd4bf5979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:09.239757 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb8f5b2-8666-442e-9a71-09bcd4bf5979 admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:09.240066 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb8f5b2-8666-442e-9a71-09bcd4bf5979 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:09.240342 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb8f5b2-8666-442e-9a71-09bcd4bf5979 admin admin] PATH_INFO: `/v3/projects/58af838033ec4aa3b1fbcfd67451c4a9/users/77f6a98af6564250881e74ad8aefddc7/roles/a9895331e9694fa8b2b50908bb057bcb` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:09.272200 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 931/1857] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:24:09 2022] GET /identity/v3/roles => generated 1420 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:24:09.272442 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb8f5b2-8666-442e-9a71-09bcd4bf5979 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58af838033ec4aa3b1fbcfd67451c4a9, user_id=77f6a98af6564250881e74ad8aefddc7, role_id=a9895331e9694fa8b2b50908bb057bcb)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:09.275210 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb8f5b2-8666-442e-9a71-09bcd4bf5979 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:09.285294 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9589bea-9be0-444b-a716-6b3951ec61c1 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:09.301701 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 927/1858] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:24:09 2022] PUT /identity/v3/projects/58af838033ec4aa3b1fbcfd67451c4a9/users/77f6a98af6564250881e74ad8aefddc7/roles/a9895331e9694fa8b2b50908bb057bcb => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 10:24:09.317549 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9589bea-9be0-444b-a716-6b3951ec61c1 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:09.318665 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a241977-633c-464e-aee1-094564ff9639 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:09.319177 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a241977-633c-464e-aee1-094564ff9639 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:09.319651 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a241977-633c-464e-aee1-094564ff9639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:09.365601 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:24:09.392718 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-6a241977-633c-464e-aee1-094564ff9639 None None] MFA Rules not processed for user `77f6a98af6564250881e74ad8aefddc7`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:24:09.394362 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-6a241977-633c-464e-aee1-094564ff9639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:09.436915 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:24:09.452480 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cad6de1-63d2-4b4a-8278-371ca2c9b947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:09.453547 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad6de1-63d2-4b4a-8278-371ca2c9b947 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:09.454002 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad6de1-63d2-4b4a-8278-371ca2c9b947 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:09.454455 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad6de1-63d2-4b4a-8278-371ca2c9b947 admin admin] PATH_INFO: `/v3/projects/7741caa0895f433bb0877028246341fe/users/fa8d2c174b0d44e68662adcd024cdcfb/roles/89ca30cbbb634be8a96e9921aa56626b` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:09.460302 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cad6de1-63d2-4b4a-8278-371ca2c9b947 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7741caa0895f433bb0877028246341fe, user_id=fa8d2c174b0d44e68662adcd024cdcfb, role_id=89ca30cbbb634be8a96e9921aa56626b)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:09.463603 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cad6de1-63d2-4b4a-8278-371ca2c9b947 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:09.499435 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 932/1859] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:24:09 2022] PUT /identity/v3/projects/7741caa0895f433bb0877028246341fe/users/fa8d2c174b0d44e68662adcd024cdcfb/roles/89ca30cbbb634be8a96e9921aa56626b => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:24:09.510747 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74491a4-1c6a-458e-88cc-26bbcea03d39 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:09.511182 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74491a4-1c6a-458e-88cc-26bbcea03d39 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:09.511533 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74491a4-1c6a-458e-88cc-26bbcea03d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:09.574959 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 928/1860] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:24:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:24:09.576221 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a241977-633c-464e-aee1-094564ff9639 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:09.595643 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-c74491a4-1c6a-458e-88cc-26bbcea03d39 None None] MFA Rules not processed for user `fa8d2c174b0d44e68662adcd024cdcfb`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:24:09.596132 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a241977-633c-464e-aee1-094564ff9639 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:09.597914 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-c74491a4-1c6a-458e-88cc-26bbcea03d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:09.774586 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 933/1861] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:24:09 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 10:24:09.785518 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8743e5b-b24f-4efc-9583-080abd4c5367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:09.786754 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8743e5b-b24f-4efc-9583-080abd4c5367 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:09.787170 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8743e5b-b24f-4efc-9583-080abd4c5367 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:09.787697 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8743e5b-b24f-4efc-9583-080abd4c5367 admin admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:09.788407 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8743e5b-b24f-4efc-9583-080abd4c5367 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:09.788966 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74491a4-1c6a-458e-88cc-26bbcea03d39 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:09.790987 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-c74491a4-1c6a-458e-88cc-26bbcea03d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:09.792601 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8743e5b-b24f-4efc-9583-080abd4c5367 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:09.851729 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 929/1862] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:24:09 2022] POST /identity/v3/projects => generated 365 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 10:24:09.853552 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8743e5b-b24f-4efc-9583-080abd4c5367 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:09.863722 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-f8743e5b-b24f-4efc-9583-080abd4c5367 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:09.890492 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74491a4-1c6a-458e-88cc-26bbcea03d39 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:10.007012 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d6de56-8257-4114-ad5f-99303bcf0abf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6c687a38524de0bf23d87ae91d3b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:10.007733 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d6de56-8257-4114-ad5f-99303bcf0abf service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:10.008713 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d6de56-8257-4114-ad5f-99303bcf0abf service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:10.009156 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d6de56-8257-4114-ad5f-99303bcf0abf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:10.013302 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-c3d6de56-8257-4114-ad5f-99303bcf0abf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:10.014615 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8743e5b-b24f-4efc-9583-080abd4c5367 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:10.031239 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769cda3d-6780-4a3c-891e-e891cebb1a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:10.031904 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769cda3d-6780-4a3c-891e-e891cebb1a9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:10.032186 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769cda3d-6780-4a3c-891e-e891cebb1a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:10.032461 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769cda3d-6780-4a3c-891e-e891cebb1a9a admin admin] PATH_INFO: `/v3/projects/be03e4b468db4d4da7ef4eb9924b56fb` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:10.038783 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769cda3d-6780-4a3c-891e-e891cebb1a9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=be03e4b468db4d4da7ef4eb9924b56fb)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:10.039331 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:24:10.040750 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769cda3d-6780-4a3c-891e-e891cebb1a9a admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:10.159944 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:24:10.169105 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-769cda3d-6780-4a3c-891e-e891cebb1a9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be03e4b468db4d4da7ef4eb9924b56fb', 'request_id': 'req-769cda3d-6780-4a3c-891e-e891cebb1a9a'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:10.185205 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-769cda3d-6780-4a3c-891e-e891cebb1a9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be03e4b468db4d4da7ef4eb9924b56fb', 'request_id': 'req-769cda3d-6780-4a3c-891e-e891cebb1a9a'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:10.195328 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-769cda3d-6780-4a3c-891e-e891cebb1a9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be03e4b468db4d4da7ef4eb9924b56fb', 'request_id': 'req-769cda3d-6780-4a3c-891e-e891cebb1a9a'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:10.223329 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-769cda3d-6780-4a3c-891e-e891cebb1a9a admin admin] The token cache is being invalidate because project be03e4b468db4d4da7ef4eb9924b56fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80105) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:24:10.223663 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-769cda3d-6780-4a3c-891e-e891cebb1a9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:10.225486 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-769cda3d-6780-4a3c-891e-e891cebb1a9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:10.231109 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 930/1863] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:24:09 2022] DELETE /identity/v3/projects/be03e4b468db4d4da7ef4eb9924b56fb => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:24:10.236272 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769cda3d-6780-4a3c-891e-e891cebb1a9a admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:10.238575 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-769cda3d-6780-4a3c-891e-e891cebb1a9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:10.290970 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d6de56-8257-4114-ad5f-99303bcf0abf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:10.292539 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d6de56-8257-4114-ad5f-99303bcf0abf service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:10.331919 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 934/1864] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:24:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 10:24:10.333112 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af8c87-90b0-47a2-ae78-cb0444ee9140 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:10.333295 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af8c87-90b0-47a2-ae78-cb0444ee9140 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:10.333558 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af8c87-90b0-47a2-ae78-cb0444ee9140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:10.376632 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769cda3d-6780-4a3c-891e-e891cebb1a9a admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:10.378708 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-f5af8c87-90b0-47a2-ae78-cb0444ee9140 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:24:10.382502 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-f5af8c87-90b0-47a2-ae78-cb0444ee9140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:10.385017 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9543a0-bc75-4699-88c8-a9b680bb8bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:10.385651 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9543a0-bc75-4699-88c8-a9b680bb8bdd admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:10.385951 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9543a0-bc75-4699-88c8-a9b680bb8bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:10.386225 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9543a0-bc75-4699-88c8-a9b680bb8bdd admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:10.387386 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9543a0-bc75-4699-88c8-a9b680bb8bdd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:10.392525 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9543a0-bc75-4699-88c8-a9b680bb8bdd admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:10.408101 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 935/1865] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:24:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:24:10.418196 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd052d-4645-4905-ba64-71810162656d None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:10.418196 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd052d-4645-4905-ba64-71810162656d None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:10.418494 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd052d-4645-4905-ba64-71810162656d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:10.444148 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 931/1866] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:24:10 2022] POST /identity/v3/users => generated 289 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:24:10.453139 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9543a0-bc75-4699-88c8-a9b680bb8bdd admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:10.460844 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-79fd052d-4645-4905-ba64-71810162656d None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:24:10.462117 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-79fd052d-4645-4905-ba64-71810162656d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:10.468711 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9543a0-bc75-4699-88c8-a9b680bb8bdd admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:10.475686 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a11b371-bab8-4e3f-bab4-0f70a533f6ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:10.476803 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a11b371-bab8-4e3f-bab4-0f70a533f6ab admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:10.477082 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a11b371-bab8-4e3f-bab4-0f70a533f6ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:10.477401 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a11b371-bab8-4e3f-bab4-0f70a533f6ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:10.478206 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a11b371-bab8-4e3f-bab4-0f70a533f6ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:10.480773 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a11b371-bab8-4e3f-bab4-0f70a533f6ab admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:10.484887 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 936/1867] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:24:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:24:10.488628 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fd052d-4645-4905-ba64-71810162656d None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:10.503848 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 932/1868] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:24:10 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:24:10.504240 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fd052d-4645-4905-ba64-71810162656d None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:10.504736 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a11b371-bab8-4e3f-bab4-0f70a533f6ab admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:10.515889 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859fc0e6-dc70-4ecc-b43a-523fdc1fd2dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:10.516520 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859fc0e6-dc70-4ecc-b43a-523fdc1fd2dc admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:10.516801 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859fc0e6-dc70-4ecc-b43a-523fdc1fd2dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:10.517073 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859fc0e6-dc70-4ecc-b43a-523fdc1fd2dc admin admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:10.517736 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859fc0e6-dc70-4ecc-b43a-523fdc1fd2dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:24:10.518070 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859fc0e6-dc70-4ecc-b43a-523fdc1fd2dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:10.518260 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a11b371-bab8-4e3f-bab4-0f70a533f6ab admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:10.519843 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859fc0e6-dc70-4ecc-b43a-523fdc1fd2dc admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:10.524766 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5540a0d-a81f-408e-b6d1-72d8f08d4a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:10.525435 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5540a0d-a81f-408e-b6d1-72d8f08d4a6a admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:10.525710 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5540a0d-a81f-408e-b6d1-72d8f08d4a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:10.526048 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5540a0d-a81f-408e-b6d1-72d8f08d4a6a admin admin] PATH_INFO: `/v3/projects/466da87b649e4e05ba9f645b3e0609d3/users/d955aa6625e04e97a5a246f3add94c18/roles/89ca30cbbb634be8a96e9921aa56626b` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:10.538688 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 937/1869] 10.222.0.36 () {58 vars in 1153 bytes} [Tue Aug 9 10:24:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:24:10.542060 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859fc0e6-dc70-4ecc-b43a-523fdc1fd2dc admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:10.556348 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859fc0e6-dc70-4ecc-b43a-523fdc1fd2dc admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:10.565557 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fcbaea-ceee-40e9-aedb-e48fdd71e97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:10.565774 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fcbaea-ceee-40e9-aedb-e48fdd71e97e admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:10.566305 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fcbaea-ceee-40e9-aedb-e48fdd71e97e admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:10.566649 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fcbaea-ceee-40e9-aedb-e48fdd71e97e admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:10.569017 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fcbaea-ceee-40e9-aedb-e48fdd71e97e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:10.573676 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fcbaea-ceee-40e9-aedb-e48fdd71e97e admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:10.593662 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5540a0d-a81f-408e-b6d1-72d8f08d4a6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=466da87b649e4e05ba9f645b3e0609d3, user_id=d955aa6625e04e97a5a246f3add94c18, role_id=89ca30cbbb634be8a96e9921aa56626b)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:10.603834 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5540a0d-a81f-408e-b6d1-72d8f08d4a6a admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:10.640012 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 933/1870] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:24:10 2022] PUT /identity/v3/projects/466da87b649e4e05ba9f645b3e0609d3/users/d955aa6625e04e97a5a246f3add94c18/roles/89ca30cbbb634be8a96e9921aa56626b => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:24:10.644817 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5540a0d-a81f-408e-b6d1-72d8f08d4a6a admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:10.661892 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 938/1871] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:24:10 2022] POST /identity/v3/projects => generated 371 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:24:10.664165 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fcbaea-ceee-40e9-aedb-e48fdd71e97e admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:10.756682 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5540a0d-a81f-408e-b6d1-72d8f08d4a6a admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:10.803578 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:DELETE=4,keystone:SELECT=91,keystone:INSERT=5 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:24:10.836870 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fcbaea-ceee-40e9-aedb-e48fdd71e97e admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:10.837841 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2094fbc0-d372-47b9-8884-a9fa20033bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:10.838574 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2094fbc0-d372-47b9-8884-a9fa20033bd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:10.838854 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2094fbc0-d372-47b9-8884-a9fa20033bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:10.839124 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2094fbc0-d372-47b9-8884-a9fa20033bd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:10.840032 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2094fbc0-d372-47b9-8884-a9fa20033bd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:10.841636 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2094fbc0-d372-47b9-8884-a9fa20033bd6 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:10.849621 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35699ecd-d1b8-4e15-8d7e-09ffd58cec64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:10.850280 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35699ecd-d1b8-4e15-8d7e-09ffd58cec64 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:10.850561 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35699ecd-d1b8-4e15-8d7e-09ffd58cec64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:10.850935 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35699ecd-d1b8-4e15-8d7e-09ffd58cec64 admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:10.851448 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35699ecd-d1b8-4e15-8d7e-09ffd58cec64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:10.853354 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35699ecd-d1b8-4e15-8d7e-09ffd58cec64 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:10.856302 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 934/1872] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:24:10 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 10:24:10.862437 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2094fbc0-d372-47b9-8884-a9fa20033bd6 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:10.884925 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2094fbc0-d372-47b9-8884-a9fa20033bd6 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:10.892180 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a51fc03-d314-4a30-b43f-a3d12a500672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:10.893006 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a51fc03-d314-4a30-b43f-a3d12a500672 admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:10.894069 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a51fc03-d314-4a30-b43f-a3d12a500672 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:10.894451 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a51fc03-d314-4a30-b43f-a3d12a500672 admin admin] PATH_INFO: `/v3/projects/466da87b649e4e05ba9f645b3e0609d3/users/d955aa6625e04e97a5a246f3add94c18/roles/89ca30cbbb634be8a96e9921aa56626b` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:10.897248 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a51fc03-d314-4a30-b43f-a3d12a500672 admin admin] RBAC: Authorizing `identity:create_grant(project_id=466da87b649e4e05ba9f645b3e0609d3, user_id=d955aa6625e04e97a5a246f3add94c18, role_id=89ca30cbbb634be8a96e9921aa56626b)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:10.900607 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a51fc03-d314-4a30-b43f-a3d12a500672 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:10.901740 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 939/1873] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:24:10 2022] POST /identity/v3/users => generated 286 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 10:24:10.907634 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35699ecd-d1b8-4e15-8d7e-09ffd58cec64 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:10.939889 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35699ecd-d1b8-4e15-8d7e-09ffd58cec64 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:10.943725 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 935/1874] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:24:10 2022] PUT /identity/v3/projects/466da87b649e4e05ba9f645b3e0609d3/users/d955aa6625e04e97a5a246f3add94c18/roles/89ca30cbbb634be8a96e9921aa56626b => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:24:10.958586 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ec07a-912f-4912-b38f-292f67863a04 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:10.958910 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ec07a-912f-4912-b38f-292f67863a04 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:10.959151 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ec07a-912f-4912-b38f-292f67863a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:11.064875 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-2f7ec07a-912f-4912-b38f-292f67863a04 None None] MFA Rules not processed for user `d955aa6625e04e97a5a246f3add94c18`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:24:11.066961 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-2f7ec07a-912f-4912-b38f-292f67863a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:11.117651 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:24:11.145564 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ffe176-9001-4903-899b-2d06955a0683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:11.146399 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ffe176-9001-4903-899b-2d06955a0683 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:11.146777 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ffe176-9001-4903-899b-2d06955a0683 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:11.147150 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ffe176-9001-4903-899b-2d06955a0683 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:11.148156 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ffe176-9001-4903-899b-2d06955a0683 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:11.150643 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ffe176-9001-4903-899b-2d06955a0683 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:11.171181 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 940/1875] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:24:10 2022] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:24:11.175108 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ffe176-9001-4903-899b-2d06955a0683 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:11.188931 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ffe176-9001-4903-899b-2d06955a0683 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:11.194751 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3594247c-2c22-4f97-bf90-138f3993d001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:11.197035 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 936/1876] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:24:10 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:24:11.204188 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3594247c-2c22-4f97-bf90-138f3993d001 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:11.204618 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3594247c-2c22-4f97-bf90-138f3993d001 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:11.204897 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3594247c-2c22-4f97-bf90-138f3993d001 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:11.205563 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3594247c-2c22-4f97-bf90-138f3993d001 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:11.208785 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7ec07a-912f-4912-b38f-292f67863a04 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:11.210339 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3594247c-2c22-4f97-bf90-138f3993d001 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:11.213013 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-2f7ec07a-912f-4912-b38f-292f67863a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:11.230795 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 941/1877] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:24:11 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 10:24:11.236718 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3594247c-2c22-4f97-bf90-138f3993d001 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:11.263253 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3594247c-2c22-4f97-bf90-138f3993d001 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:11.278407 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a39b70f-73a4-4205-ad0d-c349bd294ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:11.280947 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a39b70f-73a4-4205-ad0d-c349bd294ef5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:11.281524 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a39b70f-73a4-4205-ad0d-c349bd294ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:11.281921 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a39b70f-73a4-4205-ad0d-c349bd294ef5 admin admin] PATH_INFO: `/v3/projects/05a5a4904fb0410389c4369d9db98e20/users/8105de43df804312a4a8f00b95b0632b/roles/a9895331e9694fa8b2b50908bb057bcb` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:11.306251 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a39b70f-73a4-4205-ad0d-c349bd294ef5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05a5a4904fb0410389c4369d9db98e20, user_id=8105de43df804312a4a8f00b95b0632b, role_id=a9895331e9694fa8b2b50908bb057bcb)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:11.329186 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a39b70f-73a4-4205-ad0d-c349bd294ef5 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:11.368464 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7ec07a-912f-4912-b38f-292f67863a04 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:11.371876 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 942/1878] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:24:11 2022] PUT /identity/v3/projects/05a5a4904fb0410389c4369d9db98e20/users/8105de43df804312a4a8f00b95b0632b/roles/a9895331e9694fa8b2b50908bb057bcb => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:24:11.377581 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d15e0a-c07e-46df-a8e1-53ee6c6b2287 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:11.377915 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d15e0a-c07e-46df-a8e1-53ee6c6b2287 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:11.378242 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d15e0a-c07e-46df-a8e1-53ee6c6b2287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:11.419463 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-f8d15e0a-c07e-46df-a8e1-53ee6c6b2287 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:24:11.420705 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-f8d15e0a-c07e-46df-a8e1-53ee6c6b2287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:11.514047 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3318f554-781f-4dbf-9691-84a0285caef2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6c687a38524de0bf23d87ae91d3b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:11.514827 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3318f554-781f-4dbf-9691-84a0285caef2 service cinder] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:11.515197 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3318f554-781f-4dbf-9691-84a0285caef2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:11.515600 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3318f554-781f-4dbf-9691-84a0285caef2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:11.532114 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:24:11.563151 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 943/1879] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:24:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 10:24:11.573641 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d15e0a-c07e-46df-a8e1-53ee6c6b2287 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:11.576671 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-f8d15e0a-c07e-46df-a8e1-53ee6c6b2287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:11.600591 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3318f554-781f-4dbf-9691-84a0285caef2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:11.603340 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3318f554-781f-4dbf-9691-84a0285caef2 service cinder] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:11.622114 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 937/1880] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:24:11 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 10:24:11.665433 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d15e0a-c07e-46df-a8e1-53ee6c6b2287 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:11.675463 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f857df4f-cf3b-4191-8701-571759e67169 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:11.676525 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f857df4f-cf3b-4191-8701-571759e67169 service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:11.676984 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f857df4f-cf3b-4191-8701-571759e67169 service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:11.677398 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f857df4f-cf3b-4191-8701-571759e67169 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:11.697773 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f857df4f-cf3b-4191-8701-571759e67169 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:11.698544 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7098b614-24fa-4208-b66f-274e8ccb645f None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:11.698836 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7098b614-24fa-4208-b66f-274e8ccb645f None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:11.699233 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7098b614-24fa-4208-b66f-274e8ccb645f None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:11.700755 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f857df4f-cf3b-4191-8701-571759e67169 service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:11.701202 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 938/1881] 10.222.0.36 () {54 vars in 921 bytes} [Tue Aug 9 10:24:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:24:11.714635 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 944/1882] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:24:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 10:24:11.715479 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea191f2-f22d-4da1-a757-52377d06a787 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:11.715620 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea191f2-f22d-4da1-a757-52377d06a787 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:11.715855 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea191f2-f22d-4da1-a757-52377d06a787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:11.743989 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f857df4f-cf3b-4191-8701-571759e67169 service neutron] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:11.758496 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f857df4f-cf3b-4191-8701-571759e67169 service neutron] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:11.759388 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-aea191f2-f22d-4da1-a757-52377d06a787 None None] MFA Rules not processed for user `eb863beaaa9f495c8b64655996c061f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:24:11.760933 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-aea191f2-f22d-4da1-a757-52377d06a787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:11.767671 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ffa9e7-e277-41f5-a198-fdacb87e66f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6c687a38524de0bf23d87ae91d3b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:11.768760 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ffa9e7-e277-41f5-a198-fdacb87e66f1 service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:11.768760 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ffa9e7-e277-41f5-a198-fdacb87e66f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:11.768962 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ffa9e7-e277-41f5-a198-fdacb87e66f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:11.773200 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-71ffa9e7-e277-41f5-a198-fdacb87e66f1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:11.872332 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 939/1883] 10.222.0.36 () {58 vars in 1018 bytes} [Tue Aug 9 10:24:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 10:24:11.896246 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea191f2-f22d-4da1-a757-52377d06a787 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:11.898130 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-aea191f2-f22d-4da1-a757-52377d06a787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:11.920845 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea191f2-f22d-4da1-a757-52377d06a787 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:11.938073 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:24:11.938983 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56531c75-20de-4011-9a3b-cb13eed9b89b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb863beaaa9f495c8b64655996c061f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:11.939613 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56531c75-20de-4011-9a3b-cb13eed9b89b service nova] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:11.939894 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56531c75-20de-4011-9a3b-cb13eed9b89b service nova] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:11.941119 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56531c75-20de-4011-9a3b-cb13eed9b89b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:11.958811 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ffa9e7-e277-41f5-a198-fdacb87e66f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:11.960695 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ffa9e7-e277-41f5-a198-fdacb87e66f1 service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:11.963459 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56531c75-20de-4011-9a3b-cb13eed9b89b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:11.968374 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56531c75-20de-4011-9a3b-cb13eed9b89b service nova] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:11.974224 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 945/1884] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:24:11 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 10:24:11.995110 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 940/1885] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:24:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:24:13.498468 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ffa9e7-e277-41f5-a198-fdacb87e66f1 service cinder] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:13.513046 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6786757c-54c1-4b91-8524-f72f4b081ceb None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:13.513593 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6786757c-54c1-4b91-8524-f72f4b081ceb None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:13.513593 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6786757c-54c1-4b91-8524-f72f4b081ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:13.514492 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ffa9e7-e277-41f5-a198-fdacb87e66f1 service cinder] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:13.527903 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3463fe95-d018-47ec-8628-9a532fa21945 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6c687a38524de0bf23d87ae91d3b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:13.528891 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3463fe95-d018-47ec-8628-9a532fa21945 service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:13.529323 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3463fe95-d018-47ec-8628-9a532fa21945 service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:13.529748 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3463fe95-d018-47ec-8628-9a532fa21945 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:13.536727 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-3463fe95-d018-47ec-8628-9a532fa21945 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:13.583881 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-6786757c-54c1-4b91-8524-f72f4b081ceb None None] MFA Rules not processed for user `8105de43df804312a4a8f00b95b0632b`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:24:13.585249 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-6786757c-54c1-4b91-8524-f72f4b081ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:13.650990 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3463fe95-d018-47ec-8628-9a532fa21945 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:13.653467 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3463fe95-d018-47ec-8628-9a532fa21945 service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:13.673089 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 946/1886] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:24:13 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 10:24:13.707739 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 941/1887] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:24:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 10:24:13.712187 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3463fe95-d018-47ec-8628-9a532fa21945 service cinder] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:13.727259 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3463fe95-d018-47ec-8628-9a532fa21945 service cinder] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:13.737310 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e9a0a3-dcc4-46f7-ae95-fb49f18d3bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:13.737915 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9a0a3-dcc4-46f7-ae95-fb49f18d3bdd admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:13.738244 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9a0a3-dcc4-46f7-ae95-fb49f18d3bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:13.738790 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9a0a3-dcc4-46f7-ae95-fb49f18d3bdd admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:13.739471 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e9a0a3-dcc4-46f7-ae95-fb49f18d3bdd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:13.743952 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e9a0a3-dcc4-46f7-ae95-fb49f18d3bdd admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:13.785044 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 947/1888] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:24:13 2022] POST /identity/v3/projects => generated 369 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:24:13.786536 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6786757c-54c1-4b91-8524-f72f4b081ceb None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:13.800802 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6786757c-54c1-4b91-8524-f72f4b081ceb None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:13.822778 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:24:13.889307 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c09056e-622a-4625-9844-f0d72e8190e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:13.890232 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c09056e-622a-4625-9844-f0d72e8190e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:13.890517 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c09056e-622a-4625-9844-f0d72e8190e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:13.890797 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c09056e-622a-4625-9844-f0d72e8190e4 admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:13.891840 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c09056e-622a-4625-9844-f0d72e8190e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:13.894035 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c09056e-622a-4625-9844-f0d72e8190e4 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:13.948378 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 942/1889] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:24:13 2022] POST /identity/v3/users => generated 291 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:24:13.949779 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e9a0a3-dcc4-46f7-ae95-fb49f18d3bdd admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:13.969125 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e9a0a3-dcc4-46f7-ae95-fb49f18d3bdd admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:13.985516 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afaccd6-be7b-43a9-8fc9-e8d7dca728dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:13.986597 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afaccd6-be7b-43a9-8fc9-e8d7dca728dc admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:13.987064 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afaccd6-be7b-43a9-8fc9-e8d7dca728dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:13.987583 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afaccd6-be7b-43a9-8fc9-e8d7dca728dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:13.989000 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afaccd6-be7b-43a9-8fc9-e8d7dca728dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:13.990951 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afaccd6-be7b-43a9-8fc9-e8d7dca728dc admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:14.011307 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 948/1890] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:24:13 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:24:14.013955 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c09056e-622a-4625-9844-f0d72e8190e4 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:14.026284 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c09056e-622a-4625-9844-f0d72e8190e4 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:14.033596 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cf154e-b42a-4b07-932c-e831880863ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:14.034636 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cf154e-b42a-4b07-932c-e831880863ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:14.035492 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cf154e-b42a-4b07-932c-e831880863ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:14.035946 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cf154e-b42a-4b07-932c-e831880863ff admin admin] PATH_INFO: `/v3/projects/c84d178af27e4bf2aff1d34dcaa18852/users/5ab080716d014067b3bc1ae73c5eb22b/roles/89ca30cbbb634be8a96e9921aa56626b` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:14.064401 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cf154e-b42a-4b07-932c-e831880863ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=c84d178af27e4bf2aff1d34dcaa18852, user_id=5ab080716d014067b3bc1ae73c5eb22b, role_id=89ca30cbbb634be8a96e9921aa56626b)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:14.067876 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cf154e-b42a-4b07-932c-e831880863ff admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:14.101519 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 943/1891] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:24:14 2022] PUT /identity/v3/projects/c84d178af27e4bf2aff1d34dcaa18852/users/5ab080716d014067b3bc1ae73c5eb22b/roles/89ca30cbbb634be8a96e9921aa56626b => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:24:14.104062 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afaccd6-be7b-43a9-8fc9-e8d7dca728dc admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:14.126214 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afaccd6-be7b-43a9-8fc9-e8d7dca728dc admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:14.251758 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394854f6-40b0-468c-ac04-5dd15d82ac71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:14.252503 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394854f6-40b0-468c-ac04-5dd15d82ac71 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:14.252786 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394854f6-40b0-468c-ac04-5dd15d82ac71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:14.253076 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394854f6-40b0-468c-ac04-5dd15d82ac71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:14.253800 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394854f6-40b0-468c-ac04-5dd15d82ac71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:14.257382 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394854f6-40b0-468c-ac04-5dd15d82ac71 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:14.284093 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 949/1892] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:24:14 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:24:14.285917 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cf154e-b42a-4b07-932c-e831880863ff admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:14.302771 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cf154e-b42a-4b07-932c-e831880863ff admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:14.306784 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f578d6-a8e6-4226-85cb-c6d5d63a0036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:14.307585 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f578d6-a8e6-4226-85cb-c6d5d63a0036 admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:14.307873 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f578d6-a8e6-4226-85cb-c6d5d63a0036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:14.308209 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f578d6-a8e6-4226-85cb-c6d5d63a0036 admin admin] PATH_INFO: `/v3/projects/c84d178af27e4bf2aff1d34dcaa18852/users/5ab080716d014067b3bc1ae73c5eb22b/roles/89ca30cbbb634be8a96e9921aa56626b` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:14.310467 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f578d6-a8e6-4226-85cb-c6d5d63a0036 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c84d178af27e4bf2aff1d34dcaa18852, user_id=5ab080716d014067b3bc1ae73c5eb22b, role_id=89ca30cbbb634be8a96e9921aa56626b)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:14.313136 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f578d6-a8e6-4226-85cb-c6d5d63a0036 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:14.324960 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 944/1893] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:24:14 2022] PUT /identity/v3/projects/c84d178af27e4bf2aff1d34dcaa18852/users/5ab080716d014067b3bc1ae73c5eb22b/roles/89ca30cbbb634be8a96e9921aa56626b => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:24:15.204681 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c998d7-9c2b-4bc0-8b09-f19ac924f218 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:15.205237 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c998d7-9c2b-4bc0-8b09-f19ac924f218 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:15.205436 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c998d7-9c2b-4bc0-8b09-f19ac924f218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:15.253699 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-d0c998d7-9c2b-4bc0-8b09-f19ac924f218 None None] MFA Rules not processed for user `5ab080716d014067b3bc1ae73c5eb22b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:24:15.256147 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-d0c998d7-9c2b-4bc0-8b09-f19ac924f218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:15.363380 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:24:15.421908 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 950/1894] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:24:15 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:24:15.429524 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63570637-f180-4972-9716-df27b0a8b3b6 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:15.430010 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63570637-f180-4972-9716-df27b0a8b3b6 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:15.430481 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63570637-f180-4972-9716-df27b0a8b3b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:15.478188 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-63570637-f180-4972-9716-df27b0a8b3b6 None None] MFA Rules not processed for user `8105de43df804312a4a8f00b95b0632b`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:24:15.481365 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-63570637-f180-4972-9716-df27b0a8b3b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:15.641219 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 945/1895] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:24:15 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:24:15.969936 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c998d7-9c2b-4bc0-8b09-f19ac924f218 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:16.066516 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c998d7-9c2b-4bc0-8b09-f19ac924f218 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:16.074389 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ed1edd-ac86-4934-a4fd-9f0da8af1f6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb863beaaa9f495c8b64655996c061f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:16.076594 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed1edd-ac86-4934-a4fd-9f0da8af1f6a service nova] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:16.077032 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed1edd-ac86-4934-a4fd-9f0da8af1f6a service nova] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:16.077463 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed1edd-ac86-4934-a4fd-9f0da8af1f6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:16.088601 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ed1edd-ac86-4934-a4fd-9f0da8af1f6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:16.091136 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ed1edd-ac86-4934-a4fd-9f0da8af1f6a service nova] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:16.101507 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 951/1896] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:24:15 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:24:17.712152 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63570637-f180-4972-9716-df27b0a8b3b6 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:17.776445 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63570637-f180-4972-9716-df27b0a8b3b6 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:17.782352 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199b98f4-ed6c-4717-8ce5-e4ac68ea661b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:17.782983 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b98f4-ed6c-4717-8ce5-e4ac68ea661b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:17.783258 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b98f4-ed6c-4717-8ce5-e4ac68ea661b admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:17.783525 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b98f4-ed6c-4717-8ce5-e4ac68ea661b admin admin] PATH_INFO: `/v3/users/77f6a98af6564250881e74ad8aefddc7` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:17.784642 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199b98f4-ed6c-4717-8ce5-e4ac68ea661b admin admin] RBAC: Authorizing `identity:delete_user(user_id=77f6a98af6564250881e74ad8aefddc7)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:17.786558 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199b98f4-ed6c-4717-8ce5-e4ac68ea661b admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:17.809194 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:24:17.864802 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-199b98f4-ed6c-4717-8ce5-e4ac68ea661b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77f6a98af6564250881e74ad8aefddc7'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:17.889283 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-199b98f4-ed6c-4717-8ce5-e4ac68ea661b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77f6a98af6564250881e74ad8aefddc7'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:17.921367 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-199b98f4-ed6c-4717-8ce5-e4ac68ea661b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77f6a98af6564250881e74ad8aefddc7'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:17.922936 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-199b98f4-ed6c-4717-8ce5-e4ac68ea661b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77f6a98af6564250881e74ad8aefddc7'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:17.946057 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-199b98f4-ed6c-4717-8ce5-e4ac68ea661b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77f6a98af6564250881e74ad8aefddc7'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:17.963420 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 946/1897] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:24:17 2022] DELETE /identity/v3/users/77f6a98af6564250881e74ad8aefddc7 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:24:17.968343 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9cf81c-7269-47ce-b1a6-a73379e5ef31 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:17.968827 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9cf81c-7269-47ce-b1a6-a73379e5ef31 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:17.969033 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9cf81c-7269-47ce-b1a6-a73379e5ef31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:18.006239 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-dd9cf81c-7269-47ce-b1a6-a73379e5ef31 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:24:18.007661 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-dd9cf81c-7269-47ce-b1a6-a73379e5ef31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:18.100948 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 952/1898] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:24:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:24:18.110569 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199b98f4-ed6c-4717-8ce5-e4ac68ea661b admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:18.112530 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-199b98f4-ed6c-4717-8ce5-e4ac68ea661b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:18.207184 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199b98f4-ed6c-4717-8ce5-e4ac68ea661b admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:18.219884 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f851ab-dca4-41fd-906b-ef6ff9f5144e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:18.220018 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f851ab-dca4-41fd-906b-ef6ff9f5144e service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:18.220433 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f851ab-dca4-41fd-906b-ef6ff9f5144e service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:18.220705 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f851ab-dca4-41fd-906b-ef6ff9f5144e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:18.236531 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f851ab-dca4-41fd-906b-ef6ff9f5144e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:18.238150 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f851ab-dca4-41fd-906b-ef6ff9f5144e service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:18.252133 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 947/1899] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:24:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:24:18.629890 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9cf81c-7269-47ce-b1a6-a73379e5ef31 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:18.631461 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-dd9cf81c-7269-47ce-b1a6-a73379e5ef31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:18.665805 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9cf81c-7269-47ce-b1a6-a73379e5ef31 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:18.680482 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5700af-4ac3-4421-b6a6-1b9961b6523f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:18.682890 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5700af-4ac3-4421-b6a6-1b9961b6523f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:18.685285 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5700af-4ac3-4421-b6a6-1b9961b6523f admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:18.685682 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5700af-4ac3-4421-b6a6-1b9961b6523f admin admin] PATH_INFO: `/v3/projects/58af838033ec4aa3b1fbcfd67451c4a9` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:18.687426 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5700af-4ac3-4421-b6a6-1b9961b6523f admin admin] RBAC: Authorizing `identity:delete_project(project_id=58af838033ec4aa3b1fbcfd67451c4a9)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:18.691118 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5700af-4ac3-4421-b6a6-1b9961b6523f admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:18.790188 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-ba5700af-4ac3-4421-b6a6-1b9961b6523f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58af838033ec4aa3b1fbcfd67451c4a9', 'request_id': 'req-ba5700af-4ac3-4421-b6a6-1b9961b6523f'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:18.804907 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:24:18.812681 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-ba5700af-4ac3-4421-b6a6-1b9961b6523f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58af838033ec4aa3b1fbcfd67451c4a9', 'request_id': 'req-ba5700af-4ac3-4421-b6a6-1b9961b6523f'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:18.823742 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-ba5700af-4ac3-4421-b6a6-1b9961b6523f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58af838033ec4aa3b1fbcfd67451c4a9', 'request_id': 'req-ba5700af-4ac3-4421-b6a6-1b9961b6523f'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:18.844760 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-ba5700af-4ac3-4421-b6a6-1b9961b6523f admin admin] The token cache is being invalidate because project 58af838033ec4aa3b1fbcfd67451c4a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:24:18.845129 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-ba5700af-4ac3-4421-b6a6-1b9961b6523f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:18.846307 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-ba5700af-4ac3-4421-b6a6-1b9961b6523f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:18.848228 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 953/1900] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:24:18 2022] DELETE /identity/v3/projects/58af838033ec4aa3b1fbcfd67451c4a9 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:24:18.852093 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f851ab-dca4-41fd-906b-ef6ff9f5144e service neutron] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:18.862192 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f851ab-dca4-41fd-906b-ef6ff9f5144e service neutron] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:18.976827 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d84a58-b3ba-4fc5-9747-ab7ba7b3c6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:18.977494 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d84a58-b3ba-4fc5-9747-ab7ba7b3c6e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:18.977924 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d84a58-b3ba-4fc5-9747-ab7ba7b3c6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:18.978311 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d84a58-b3ba-4fc5-9747-ab7ba7b3c6e8 admin admin] PATH_INFO: `/v3/users/d955aa6625e04e97a5a246f3add94c18` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:18.980082 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d84a58-b3ba-4fc5-9747-ab7ba7b3c6e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d955aa6625e04e97a5a246f3add94c18)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:18.981720 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d84a58-b3ba-4fc5-9747-ab7ba7b3c6e8 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:19.044045 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:24:19.056824 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-01d84a58-b3ba-4fc5-9747-ab7ba7b3c6e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd955aa6625e04e97a5a246f3add94c18'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:19.070442 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-01d84a58-b3ba-4fc5-9747-ab7ba7b3c6e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd955aa6625e04e97a5a246f3add94c18'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:19.077638 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-01d84a58-b3ba-4fc5-9747-ab7ba7b3c6e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd955aa6625e04e97a5a246f3add94c18'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:19.078394 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-01d84a58-b3ba-4fc5-9747-ab7ba7b3c6e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd955aa6625e04e97a5a246f3add94c18'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:19.085820 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-01d84a58-b3ba-4fc5-9747-ab7ba7b3c6e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd955aa6625e04e97a5a246f3add94c18'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:19.096386 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 948/1901] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:24:18 2022] DELETE /identity/v3/users/d955aa6625e04e97a5a246f3add94c18 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:24:19.621098 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5700af-4ac3-4421-b6a6-1b9961b6523f admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:19.623805 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-ba5700af-4ac3-4421-b6a6-1b9961b6523f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:19.647916 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5700af-4ac3-4421-b6a6-1b9961b6523f admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:19.792794 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99499129-9c3c-455b-8dad-945df52d05fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:19.793880 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99499129-9c3c-455b-8dad-945df52d05fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:19.795072 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99499129-9c3c-455b-8dad-945df52d05fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:19.797814 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99499129-9c3c-455b-8dad-945df52d05fc admin admin] PATH_INFO: `/v3/projects/466da87b649e4e05ba9f645b3e0609d3` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:19.799212 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99499129-9c3c-455b-8dad-945df52d05fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=466da87b649e4e05ba9f645b3e0609d3)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:19.801144 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99499129-9c3c-455b-8dad-945df52d05fc admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:19.874487 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-99499129-9c3c-455b-8dad-945df52d05fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '466da87b649e4e05ba9f645b3e0609d3', 'request_id': 'req-99499129-9c3c-455b-8dad-945df52d05fc'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:19.881193 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-99499129-9c3c-455b-8dad-945df52d05fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '466da87b649e4e05ba9f645b3e0609d3', 'request_id': 'req-99499129-9c3c-455b-8dad-945df52d05fc'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:19.889947 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-99499129-9c3c-455b-8dad-945df52d05fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '466da87b649e4e05ba9f645b3e0609d3', 'request_id': 'req-99499129-9c3c-455b-8dad-945df52d05fc'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:19.905713 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-99499129-9c3c-455b-8dad-945df52d05fc admin admin] The token cache is being invalidate because project 466da87b649e4e05ba9f645b3e0609d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:24:19.906057 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-99499129-9c3c-455b-8dad-945df52d05fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:19.906760 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-99499129-9c3c-455b-8dad-945df52d05fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:19.908798 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 954/1902] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:24:19 2022] DELETE /identity/v3/projects/466da87b649e4e05ba9f645b3e0609d3 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:24:19.913755 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd665d-3112-44d4-a8c7-516c5e78509e None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:19.914273 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd665d-3112-44d4-a8c7-516c5e78509e None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:19.914398 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd665d-3112-44d4-a8c7-516c5e78509e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:19.936141 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-5fcd665d-3112-44d4-a8c7-516c5e78509e None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:24:19.938003 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-5fcd665d-3112-44d4-a8c7-516c5e78509e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:20.015214 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 949/1903] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:24:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:24:20.024879 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb64f86-72bc-43f5-8256-7ce497fc5351 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:20.025190 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb64f86-72bc-43f5-8256-7ce497fc5351 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:20.025434 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb64f86-72bc-43f5-8256-7ce497fc5351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:20.100432 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-aeb64f86-72bc-43f5-8256-7ce497fc5351 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:24:20.101758 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-aeb64f86-72bc-43f5-8256-7ce497fc5351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:20.112077 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 955/1904] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:24:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:24:20.116479 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcd665d-3112-44d4-a8c7-516c5e78509e None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:20.130688 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcd665d-3112-44d4-a8c7-516c5e78509e None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:20.135981 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2046ef54-df91-4ca4-81a1-b263fd5641b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:20.137131 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046ef54-df91-4ca4-81a1-b263fd5641b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:20.138062 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046ef54-df91-4ca4-81a1-b263fd5641b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:20.138062 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046ef54-df91-4ca4-81a1-b263fd5641b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:20.138382 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2046ef54-df91-4ca4-81a1-b263fd5641b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:24:20.138691 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2046ef54-df91-4ca4-81a1-b263fd5641b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:20.140586 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2046ef54-df91-4ca4-81a1-b263fd5641b0 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:20.161133 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 950/1905] 10.222.0.36 () {58 vars in 1153 bytes} [Tue Aug 9 10:24:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:24:20.164056 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb64f86-72bc-43f5-8256-7ce497fc5351 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:20.174917 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb64f86-72bc-43f5-8256-7ce497fc5351 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:20.179630 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b2f228-2a45-4caa-8376-0c25859b3c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:20.180242 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b2f228-2a45-4caa-8376-0c25859b3c2e admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:20.180521 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b2f228-2a45-4caa-8376-0c25859b3c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:20.180807 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b2f228-2a45-4caa-8376-0c25859b3c2e admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:20.181420 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b2f228-2a45-4caa-8376-0c25859b3c2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:20.184045 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b2f228-2a45-4caa-8376-0c25859b3c2e admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:20.234033 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 956/1906] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:24:20 2022] POST /identity/v3/projects => generated 383 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:24:20.235909 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2046ef54-df91-4ca4-81a1-b263fd5641b0 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:20.246856 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2046ef54-df91-4ca4-81a1-b263fd5641b0 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:20.322271 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadd85a7-6f4d-4737-a5f1-a6e6910dbdbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:20.323378 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd85a7-6f4d-4737-a5f1-a6e6910dbdbb admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:20.324189 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd85a7-6f4d-4737-a5f1-a6e6910dbdbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:20.324468 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd85a7-6f4d-4737-a5f1-a6e6910dbdbb admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:20.325091 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadd85a7-6f4d-4737-a5f1-a6e6910dbdbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:20.327091 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadd85a7-6f4d-4737-a5f1-a6e6910dbdbb admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:20.351682 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 951/1907] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:24:20 2022] POST /identity/v3/users => generated 292 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:24:20.356158 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b2f228-2a45-4caa-8376-0c25859b3c2e admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:20.371720 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b2f228-2a45-4caa-8376-0c25859b3c2e admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:20.378004 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be75e7f2-cca2-4668-b22d-37856caeb0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:20.378973 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be75e7f2-cca2-4668-b22d-37856caeb0b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:20.378973 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be75e7f2-cca2-4668-b22d-37856caeb0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:20.379253 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be75e7f2-cca2-4668-b22d-37856caeb0b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:20.379936 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be75e7f2-cca2-4668-b22d-37856caeb0b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:20.381663 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be75e7f2-cca2-4668-b22d-37856caeb0b0 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:20.392677 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 957/1908] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:24:20 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:24:20.396752 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadd85a7-6f4d-4737-a5f1-a6e6910dbdbb admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:20.407740 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadd85a7-6f4d-4737-a5f1-a6e6910dbdbb admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:20.412421 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f16167-da0f-499e-aa65-74947613549c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:20.413018 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f16167-da0f-499e-aa65-74947613549c admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:20.413299 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f16167-da0f-499e-aa65-74947613549c admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:20.413571 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f16167-da0f-499e-aa65-74947613549c admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:20.414244 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f16167-da0f-499e-aa65-74947613549c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:20.415833 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f16167-da0f-499e-aa65-74947613549c admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:20.428524 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 952/1909] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:24:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 10:24:20.432855 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be75e7f2-cca2-4668-b22d-37856caeb0b0 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:20.451764 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be75e7f2-cca2-4668-b22d-37856caeb0b0 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:20.458131 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5047a957-d504-4f16-8821-293f4ae3aae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:20.458991 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5047a957-d504-4f16-8821-293f4ae3aae3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:20.459355 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5047a957-d504-4f16-8821-293f4ae3aae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:20.459701 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5047a957-d504-4f16-8821-293f4ae3aae3 admin admin] PATH_INFO: `/v3/projects/f59299bf92254932b74b9653c0db89e6/users/bc3cd2099deb49eeaece76a84690b9af/roles/a9895331e9694fa8b2b50908bb057bcb` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:20.476801 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5047a957-d504-4f16-8821-293f4ae3aae3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f59299bf92254932b74b9653c0db89e6, user_id=bc3cd2099deb49eeaece76a84690b9af, role_id=a9895331e9694fa8b2b50908bb057bcb)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:20.479755 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5047a957-d504-4f16-8821-293f4ae3aae3 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:20.496507 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 958/1910] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:24:20 2022] PUT /identity/v3/projects/f59299bf92254932b74b9653c0db89e6/users/bc3cd2099deb49eeaece76a84690b9af/roles/a9895331e9694fa8b2b50908bb057bcb => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 10:24:20.506964 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bad7fe-1ad2-4375-a15f-5e32171a194b None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:20.507256 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bad7fe-1ad2-4375-a15f-5e32171a194b None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:20.507534 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bad7fe-1ad2-4375-a15f-5e32171a194b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:20.542300 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-19bad7fe-1ad2-4375-a15f-5e32171a194b None None] MFA Rules not processed for user `bc3cd2099deb49eeaece76a84690b9af`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:24:20.544475 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-19bad7fe-1ad2-4375-a15f-5e32171a194b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:20.555965 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:24:20.643412 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 953/1911] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:24:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 10:24:20.647964 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5047a957-d504-4f16-8821-293f4ae3aae3 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:20.670477 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:24:20.725689 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5047a957-d504-4f16-8821-293f4ae3aae3 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:20.731165 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c380e42-5e3d-4e93-97d2-8aec6b613291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:20.731826 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c380e42-5e3d-4e93-97d2-8aec6b613291 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:20.732144 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c380e42-5e3d-4e93-97d2-8aec6b613291 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:20.732802 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c380e42-5e3d-4e93-97d2-8aec6b613291 admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:20.733050 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c380e42-5e3d-4e93-97d2-8aec6b613291 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:20.735034 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c380e42-5e3d-4e93-97d2-8aec6b613291 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:20.767933 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 959/1912] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:24:20 2022] POST /identity/v3/projects => generated 383 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:24:20.771859 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bad7fe-1ad2-4375-a15f-5e32171a194b None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:20.784825 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bad7fe-1ad2-4375-a15f-5e32171a194b None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:20.879833 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e202bdae-5553-4e7b-80fe-2bec795b611c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:20.880460 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e202bdae-5553-4e7b-80fe-2bec795b611c admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:20.880743 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e202bdae-5553-4e7b-80fe-2bec795b611c admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:20.881021 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e202bdae-5553-4e7b-80fe-2bec795b611c admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:20.881720 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e202bdae-5553-4e7b-80fe-2bec795b611c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:20.884059 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e202bdae-5553-4e7b-80fe-2bec795b611c admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:20.908194 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 954/1913] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:24:20 2022] POST /identity/v3/users => generated 298 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:24:20.912132 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c380e42-5e3d-4e93-97d2-8aec6b613291 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:20.923737 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c380e42-5e3d-4e93-97d2-8aec6b613291 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:20.930221 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61332d0-83ea-4cff-9170-b89c635af240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:20.930926 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61332d0-83ea-4cff-9170-b89c635af240 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:20.931933 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61332d0-83ea-4cff-9170-b89c635af240 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:20.931933 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61332d0-83ea-4cff-9170-b89c635af240 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:20.932281 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61332d0-83ea-4cff-9170-b89c635af240 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:20.935062 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61332d0-83ea-4cff-9170-b89c635af240 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:20.957309 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 960/1914] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:24:20 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:24:20.957788 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e202bdae-5553-4e7b-80fe-2bec795b611c admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:20.975101 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e202bdae-5553-4e7b-80fe-2bec795b611c admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:20.980140 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaeaf5d-e50f-4c49-9e61-c86e0d4b126f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:20.980832 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaeaf5d-e50f-4c49-9e61-c86e0d4b126f admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:20.981036 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaeaf5d-e50f-4c49-9e61-c86e0d4b126f admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:20.981311 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaeaf5d-e50f-4c49-9e61-c86e0d4b126f admin admin] PATH_INFO: `/v3/projects/b3af262794ed471691b9ef3a9cac818d/users/d9fd8038ead347c0a493ab42ccc8d4a9/roles/89ca30cbbb634be8a96e9921aa56626b` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:20.997386 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaeaf5d-e50f-4c49-9e61-c86e0d4b126f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3af262794ed471691b9ef3a9cac818d, user_id=d9fd8038ead347c0a493ab42ccc8d4a9, role_id=89ca30cbbb634be8a96e9921aa56626b)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:21.000120 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaeaf5d-e50f-4c49-9e61-c86e0d4b126f admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:21.013976 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 955/1915] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:24:20 2022] PUT /identity/v3/projects/b3af262794ed471691b9ef3a9cac818d/users/d9fd8038ead347c0a493ab42ccc8d4a9/roles/89ca30cbbb634be8a96e9921aa56626b => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:24:21.018049 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61332d0-83ea-4cff-9170-b89c635af240 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:21.029094 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61332d0-83ea-4cff-9170-b89c635af240 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:21.092427 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449008a5-110f-4f21-b287-f453899bf4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:21.093277 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449008a5-110f-4f21-b287-f453899bf4b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:21.094026 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449008a5-110f-4f21-b287-f453899bf4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:21.095200 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449008a5-110f-4f21-b287-f453899bf4b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:21.095911 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449008a5-110f-4f21-b287-f453899bf4b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:21.098206 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449008a5-110f-4f21-b287-f453899bf4b1 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:21.111378 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 961/1916] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:24:21 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:24:21.115285 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaeaf5d-e50f-4c49-9e61-c86e0d4b126f admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:21.130971 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaeaf5d-e50f-4c49-9e61-c86e0d4b126f admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:21.147896 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac2472c-f310-4dc9-b1d3-93d125671ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:21.149144 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac2472c-f310-4dc9-b1d3-93d125671ca8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:21.149545 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac2472c-f310-4dc9-b1d3-93d125671ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:21.150246 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac2472c-f310-4dc9-b1d3-93d125671ca8 admin admin] PATH_INFO: `/v3/projects/b3af262794ed471691b9ef3a9cac818d/users/d9fd8038ead347c0a493ab42ccc8d4a9/roles/89ca30cbbb634be8a96e9921aa56626b` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:21.155632 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac2472c-f310-4dc9-b1d3-93d125671ca8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3af262794ed471691b9ef3a9cac818d, user_id=d9fd8038ead347c0a493ab42ccc8d4a9, role_id=89ca30cbbb634be8a96e9921aa56626b)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:21.160867 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac2472c-f310-4dc9-b1d3-93d125671ca8 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:21.184136 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 956/1917] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:24:21 2022] PUT /identity/v3/projects/b3af262794ed471691b9ef3a9cac818d/users/d9fd8038ead347c0a493ab42ccc8d4a9/roles/89ca30cbbb634be8a96e9921aa56626b => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 10:24:21.195192 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff7ce7-e748-4d57-bc3d-fb0d112b7e49 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:21.195520 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff7ce7-e748-4d57-bc3d-fb0d112b7e49 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:21.195798 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff7ce7-e748-4d57-bc3d-fb0d112b7e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:21.251680 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-9dff7ce7-e748-4d57-bc3d-fb0d112b7e49 None None] MFA Rules not processed for user `d9fd8038ead347c0a493ab42ccc8d4a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:24:21.253114 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-9dff7ce7-e748-4d57-bc3d-fb0d112b7e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:21.366325 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 962/1918] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:24:21 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:24:21.378570 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac2472c-f310-4dc9-b1d3-93d125671ca8 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:21.380286 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-3ac2472c-f310-4dc9-b1d3-93d125671ca8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:21.458617 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac2472c-f310-4dc9-b1d3-93d125671ca8 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:21.462603 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b63da5-52d8-4254-9e2e-90888a487b29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6c687a38524de0bf23d87ae91d3b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:21.463225 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b63da5-52d8-4254-9e2e-90888a487b29 service cinder] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:21.463515 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b63da5-52d8-4254-9e2e-90888a487b29 service cinder] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:21.464158 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b63da5-52d8-4254-9e2e-90888a487b29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:21.476425 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b63da5-52d8-4254-9e2e-90888a487b29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:21.477917 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b63da5-52d8-4254-9e2e-90888a487b29 service cinder] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:21.488853 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 957/1919] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:24:21 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:24:21.582308 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dff7ce7-e748-4d57-bc3d-fb0d112b7e49 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:21.596240 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dff7ce7-e748-4d57-bc3d-fb0d112b7e49 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:21.606447 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73867962-ee8b-455a-8109-f7177a720558 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6c687a38524de0bf23d87ae91d3b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:21.607070 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73867962-ee8b-455a-8109-f7177a720558 service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:21.607552 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73867962-ee8b-455a-8109-f7177a720558 service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:21.607832 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73867962-ee8b-455a-8109-f7177a720558 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:21.614164 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:24:21.719481 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73867962-ee8b-455a-8109-f7177a720558 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:21.721124 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73867962-ee8b-455a-8109-f7177a720558 service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:21.734893 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 963/1920] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:24:21 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:24:22.166123 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b63da5-52d8-4254-9e2e-90888a487b29 service cinder] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:22.184067 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:24:22.266738 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b63da5-52d8-4254-9e2e-90888a487b29 service cinder] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:22.282923 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527d7497-634f-4656-9f06-eb9c20a799fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:22.283586 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527d7497-634f-4656-9f06-eb9c20a799fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:22.283857 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527d7497-634f-4656-9f06-eb9c20a799fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:22.284135 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527d7497-634f-4656-9f06-eb9c20a799fa admin admin] PATH_INFO: `/v3/users/bc3cd2099deb49eeaece76a84690b9af` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:22.287412 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527d7497-634f-4656-9f06-eb9c20a799fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc3cd2099deb49eeaece76a84690b9af)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:22.291241 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527d7497-634f-4656-9f06-eb9c20a799fa admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:22.388080 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-527d7497-634f-4656-9f06-eb9c20a799fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc3cd2099deb49eeaece76a84690b9af'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:22.404697 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-527d7497-634f-4656-9f06-eb9c20a799fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc3cd2099deb49eeaece76a84690b9af'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:22.430738 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-527d7497-634f-4656-9f06-eb9c20a799fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc3cd2099deb49eeaece76a84690b9af'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:22.431748 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-527d7497-634f-4656-9f06-eb9c20a799fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc3cd2099deb49eeaece76a84690b9af'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:22.446833 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-527d7497-634f-4656-9f06-eb9c20a799fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc3cd2099deb49eeaece76a84690b9af'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:22.458259 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 958/1921] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:24:22 2022] DELETE /identity/v3/users/bc3cd2099deb49eeaece76a84690b9af => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:24:22.462461 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd620964-82ae-48e9-84a0-3208ed33f19f None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:22.462840 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd620964-82ae-48e9-84a0-3208ed33f19f None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:22.463281 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd620964-82ae-48e9-84a0-3208ed33f19f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:22.501793 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-fd620964-82ae-48e9-84a0-3208ed33f19f None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:24:22.503111 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-fd620964-82ae-48e9-84a0-3208ed33f19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:22.593211 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 964/1922] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:24:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:24:22.603328 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527d7497-634f-4656-9f06-eb9c20a799fa admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:22.605332 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-527d7497-634f-4656-9f06-eb9c20a799fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:22.677481 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527d7497-634f-4656-9f06-eb9c20a799fa admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:22.682061 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52487057-9518-4400-9985-1da54b4c47ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:22.684335 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52487057-9518-4400-9985-1da54b4c47ca service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:22.684335 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52487057-9518-4400-9985-1da54b4c47ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:22.684335 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52487057-9518-4400-9985-1da54b4c47ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:22.695166 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52487057-9518-4400-9985-1da54b4c47ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:22.696946 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52487057-9518-4400-9985-1da54b4c47ca service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:22.710061 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 959/1923] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:24:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 10:24:23.318056 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd620964-82ae-48e9-84a0-3208ed33f19f None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:23.319660 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-fd620964-82ae-48e9-84a0-3208ed33f19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:23.337320 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd620964-82ae-48e9-84a0-3208ed33f19f None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:23.362101 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eacfcb0-25dd-4aec-8d0c-fdc853efd24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:23.363227 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eacfcb0-25dd-4aec-8d0c-fdc853efd24a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:23.363679 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eacfcb0-25dd-4aec-8d0c-fdc853efd24a admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:23.364232 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eacfcb0-25dd-4aec-8d0c-fdc853efd24a admin admin] PATH_INFO: `/v3/projects/f59299bf92254932b74b9653c0db89e6` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:23.368634 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eacfcb0-25dd-4aec-8d0c-fdc853efd24a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f59299bf92254932b74b9653c0db89e6)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:23.375936 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eacfcb0-25dd-4aec-8d0c-fdc853efd24a admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:23.470131 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-5eacfcb0-25dd-4aec-8d0c-fdc853efd24a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f59299bf92254932b74b9653c0db89e6', 'request_id': 'req-5eacfcb0-25dd-4aec-8d0c-fdc853efd24a'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:23.486717 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-5eacfcb0-25dd-4aec-8d0c-fdc853efd24a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f59299bf92254932b74b9653c0db89e6', 'request_id': 'req-5eacfcb0-25dd-4aec-8d0c-fdc853efd24a'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:23.501194 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-5eacfcb0-25dd-4aec-8d0c-fdc853efd24a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f59299bf92254932b74b9653c0db89e6', 'request_id': 'req-5eacfcb0-25dd-4aec-8d0c-fdc853efd24a'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:23.530513 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-5eacfcb0-25dd-4aec-8d0c-fdc853efd24a admin admin] The token cache is being invalidate because project f59299bf92254932b74b9653c0db89e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:24:23.530805 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-5eacfcb0-25dd-4aec-8d0c-fdc853efd24a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:23.534218 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-5eacfcb0-25dd-4aec-8d0c-fdc853efd24a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:23.545478 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 965/1924] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:24:23 2022] DELETE /identity/v3/projects/f59299bf92254932b74b9653c0db89e6 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:24:23.549787 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52487057-9518-4400-9985-1da54b4c47ca service neutron] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:23.565243 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52487057-9518-4400-9985-1da54b4c47ca service neutron] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:23.626662 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:24:23.688820 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a69795-7c5d-4e34-a47c-fb39900b99f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:23.690239 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a69795-7c5d-4e34-a47c-fb39900b99f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:23.690987 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a69795-7c5d-4e34-a47c-fb39900b99f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:23.691470 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a69795-7c5d-4e34-a47c-fb39900b99f8 admin admin] PATH_INFO: `/v3/users/d9fd8038ead347c0a493ab42ccc8d4a9` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:23.693109 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a69795-7c5d-4e34-a47c-fb39900b99f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9fd8038ead347c0a493ab42ccc8d4a9)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:23.696633 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a69795-7c5d-4e34-a47c-fb39900b99f8 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:23.827437 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-19a69795-7c5d-4e34-a47c-fb39900b99f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9fd8038ead347c0a493ab42ccc8d4a9'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:23.844062 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-19a69795-7c5d-4e34-a47c-fb39900b99f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9fd8038ead347c0a493ab42ccc8d4a9'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:23.851937 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-19a69795-7c5d-4e34-a47c-fb39900b99f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9fd8038ead347c0a493ab42ccc8d4a9'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:23.852996 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-19a69795-7c5d-4e34-a47c-fb39900b99f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9fd8038ead347c0a493ab42ccc8d4a9'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:23.864271 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-19a69795-7c5d-4e34-a47c-fb39900b99f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9fd8038ead347c0a493ab42ccc8d4a9'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:23.873091 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 960/1925] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:24:23 2022] DELETE /identity/v3/users/d9fd8038ead347c0a493ab42ccc8d4a9 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:24:25.512398 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eacfcb0-25dd-4aec-8d0c-fdc853efd24a admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:25.514186 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-5eacfcb0-25dd-4aec-8d0c-fdc853efd24a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:25.535121 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eacfcb0-25dd-4aec-8d0c-fdc853efd24a admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:25.580107 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:24:25.629118 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ae483d-cf68-4daf-97ec-af8242d6fa93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:25.630068 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae483d-cf68-4daf-97ec-af8242d6fa93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:25.630578 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae483d-cf68-4daf-97ec-af8242d6fa93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:25.631080 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae483d-cf68-4daf-97ec-af8242d6fa93 admin admin] PATH_INFO: `/v3/projects/b3af262794ed471691b9ef3a9cac818d` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:25.633486 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ae483d-cf68-4daf-97ec-af8242d6fa93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3af262794ed471691b9ef3a9cac818d)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:25.635897 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ae483d-cf68-4daf-97ec-af8242d6fa93 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:25.698779 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-20ae483d-cf68-4daf-97ec-af8242d6fa93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3af262794ed471691b9ef3a9cac818d', 'request_id': 'req-20ae483d-cf68-4daf-97ec-af8242d6fa93'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:25.714585 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-20ae483d-cf68-4daf-97ec-af8242d6fa93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3af262794ed471691b9ef3a9cac818d', 'request_id': 'req-20ae483d-cf68-4daf-97ec-af8242d6fa93'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:25.722304 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-20ae483d-cf68-4daf-97ec-af8242d6fa93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3af262794ed471691b9ef3a9cac818d', 'request_id': 'req-20ae483d-cf68-4daf-97ec-af8242d6fa93'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:25.744369 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-20ae483d-cf68-4daf-97ec-af8242d6fa93 admin admin] The token cache is being invalidate because project b3af262794ed471691b9ef3a9cac818d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:24:25.744665 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-20ae483d-cf68-4daf-97ec-af8242d6fa93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:25.746588 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-20ae483d-cf68-4daf-97ec-af8242d6fa93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:25.751413 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 966/1926] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:24:25 2022] DELETE /identity/v3/projects/b3af262794ed471691b9ef3a9cac818d => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:24:25.752611 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9de9a9-ca1a-48d4-820a-60beee210b43 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:25.753050 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9de9a9-ca1a-48d4-820a-60beee210b43 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:25.753133 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9de9a9-ca1a-48d4-820a-60beee210b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:25.794504 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-8f9de9a9-ca1a-48d4-820a-60beee210b43 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:24:25.796022 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-8f9de9a9-ca1a-48d4-820a-60beee210b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:25.897373 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 961/1927] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:24:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:24:25.907659 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315f36f7-b5cf-4f20-b679-3190be7025ab None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:25.907937 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315f36f7-b5cf-4f20-b679-3190be7025ab None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:25.908225 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315f36f7-b5cf-4f20-b679-3190be7025ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:25.930393 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-315f36f7-b5cf-4f20-b679-3190be7025ab None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:24:25.931670 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-315f36f7-b5cf-4f20-b679-3190be7025ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:25.946394 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9de9a9-ca1a-48d4-820a-60beee210b43 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:25.958481 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 967/1928] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:24:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:24:25.958812 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9de9a9-ca1a-48d4-820a-60beee210b43 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:25.964839 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc50fb-07d9-4d5d-9e8d-465b9a7f54de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:25.964839 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc50fb-07d9-4d5d-9e8d-465b9a7f54de admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:25.964839 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc50fb-07d9-4d5d-9e8d-465b9a7f54de admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:25.965369 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc50fb-07d9-4d5d-9e8d-465b9a7f54de admin admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:25.966040 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afc50fb-07d9-4d5d-9e8d-465b9a7f54de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:24:25.966324 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afc50fb-07d9-4d5d-9e8d-465b9a7f54de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:25.968409 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afc50fb-07d9-4d5d-9e8d-465b9a7f54de admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:25.986023 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 962/1929] 10.222.0.36 () {58 vars in 1153 bytes} [Tue Aug 9 10:24:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:24:25.988026 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315f36f7-b5cf-4f20-b679-3190be7025ab None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:25.998504 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315f36f7-b5cf-4f20-b679-3190be7025ab None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:26.003898 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fd8cf0-4882-40c9-8f1d-6498a037d97c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:26.004626 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fd8cf0-4882-40c9-8f1d-6498a037d97c admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:26.004784 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fd8cf0-4882-40c9-8f1d-6498a037d97c admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:26.005045 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fd8cf0-4882-40c9-8f1d-6498a037d97c admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:26.005811 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fd8cf0-4882-40c9-8f1d-6498a037d97c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:26.007748 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fd8cf0-4882-40c9-8f1d-6498a037d97c admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:26.044839 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 968/1930] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:24:25 2022] POST /identity/v3/projects => generated 359 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:24:26.045995 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc50fb-07d9-4d5d-9e8d-465b9a7f54de admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:26.060617 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc50fb-07d9-4d5d-9e8d-465b9a7f54de admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:26.101833 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:24:26.132142 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c57112e-0df3-430e-a589-ef4b3689dfb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:26.133155 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c57112e-0df3-430e-a589-ef4b3689dfb6 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:26.133455 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c57112e-0df3-430e-a589-ef4b3689dfb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:26.133708 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c57112e-0df3-430e-a589-ef4b3689dfb6 admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:26.134366 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c57112e-0df3-430e-a589-ef4b3689dfb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:26.136898 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c57112e-0df3-430e-a589-ef4b3689dfb6 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:26.159499 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 963/1931] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:24:26 2022] POST /identity/v3/users => generated 280 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:24:26.163373 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fd8cf0-4882-40c9-8f1d-6498a037d97c admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:26.175028 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fd8cf0-4882-40c9-8f1d-6498a037d97c admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:26.180061 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0b6ea3-eaf9-417f-804f-990a3b50ce33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:26.180676 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b6ea3-eaf9-417f-804f-990a3b50ce33 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:26.180953 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b6ea3-eaf9-417f-804f-990a3b50ce33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:26.181228 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b6ea3-eaf9-417f-804f-990a3b50ce33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:26.182085 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0b6ea3-eaf9-417f-804f-990a3b50ce33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:26.184163 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0b6ea3-eaf9-417f-804f-990a3b50ce33 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:26.195278 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 969/1932] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 10:24:26.200305 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c57112e-0df3-430e-a589-ef4b3689dfb6 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:26.216793 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c57112e-0df3-430e-a589-ef4b3689dfb6 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:26.223545 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d8e36c-d1be-41ef-a80c-ab7da2209f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:26.224257 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8e36c-d1be-41ef-a80c-ab7da2209f13 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:26.224600 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8e36c-d1be-41ef-a80c-ab7da2209f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:26.224938 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8e36c-d1be-41ef-a80c-ab7da2209f13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:26.225610 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d8e36c-d1be-41ef-a80c-ab7da2209f13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:26.227232 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d8e36c-d1be-41ef-a80c-ab7da2209f13 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:26.241925 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 964/1933] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:24:26 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:24:26.243166 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0b6ea3-eaf9-417f-804f-990a3b50ce33 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:26.253307 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0b6ea3-eaf9-417f-804f-990a3b50ce33 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:26.258513 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730e9554-68d0-4b02-86ed-bf41e639fb7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:26.259191 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730e9554-68d0-4b02-86ed-bf41e639fb7c admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:26.259524 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730e9554-68d0-4b02-86ed-bf41e639fb7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:26.259989 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730e9554-68d0-4b02-86ed-bf41e639fb7c admin admin] PATH_INFO: `/v3/projects/d303ff420c2d42bfb3cdbc5653b22a97/users/12e1abc62343485a900bf20cbbb8bf50/roles/a9895331e9694fa8b2b50908bb057bcb` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:26.281383 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730e9554-68d0-4b02-86ed-bf41e639fb7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d303ff420c2d42bfb3cdbc5653b22a97, user_id=12e1abc62343485a900bf20cbbb8bf50, role_id=a9895331e9694fa8b2b50908bb057bcb)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:26.284568 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730e9554-68d0-4b02-86ed-bf41e639fb7c admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:26.338875 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 970/1934] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:24:26 2022] PUT /identity/v3/projects/d303ff420c2d42bfb3cdbc5653b22a97/users/12e1abc62343485a900bf20cbbb8bf50/roles/a9895331e9694fa8b2b50908bb057bcb => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 10:24:26.349483 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0403c94d-a1ed-458d-ae4b-b038d1244bda None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:26.350923 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0403c94d-a1ed-458d-ae4b-b038d1244bda None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:26.351361 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0403c94d-a1ed-458d-ae4b-b038d1244bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:26.415146 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-0403c94d-a1ed-458d-ae4b-b038d1244bda None None] MFA Rules not processed for user `12e1abc62343485a900bf20cbbb8bf50`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:24:26.422572 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-0403c94d-a1ed-458d-ae4b-b038d1244bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:26.517605 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 965/1935] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:24:26 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:24:26.748343 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730e9554-68d0-4b02-86ed-bf41e639fb7c admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:26.750149 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-730e9554-68d0-4b02-86ed-bf41e639fb7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:26.837107 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730e9554-68d0-4b02-86ed-bf41e639fb7c admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:26.841824 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c77183-3079-4025-bbeb-5b30aaa7d1d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6c687a38524de0bf23d87ae91d3b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:26.842794 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c77183-3079-4025-bbeb-5b30aaa7d1d6 service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:26.843084 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c77183-3079-4025-bbeb-5b30aaa7d1d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:26.843412 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c77183-3079-4025-bbeb-5b30aaa7d1d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:26.853710 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c77183-3079-4025-bbeb-5b30aaa7d1d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:26.856390 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c77183-3079-4025-bbeb-5b30aaa7d1d6 service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:26.860213 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:24:26.868267 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 971/1936] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:24:26 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:24:26.887091 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0403c94d-a1ed-458d-ae4b-b038d1244bda None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:26.957662 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0403c94d-a1ed-458d-ae4b-b038d1244bda None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:26.963309 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d99c976-3956-4ac0-96a6-6927c740c582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:26.963998 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d99c976-3956-4ac0-96a6-6927c740c582 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:26.964931 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d99c976-3956-4ac0-96a6-6927c740c582 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:26.965213 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d99c976-3956-4ac0-96a6-6927c740c582 admin admin] PATH_INFO: `/v3/users/12e1abc62343485a900bf20cbbb8bf50` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:26.966384 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d99c976-3956-4ac0-96a6-6927c740c582 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12e1abc62343485a900bf20cbbb8bf50)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:26.968331 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d99c976-3956-4ac0-96a6-6927c740c582 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:27.020292 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:24:27.022067 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-7d99c976-3956-4ac0-96a6-6927c740c582 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12e1abc62343485a900bf20cbbb8bf50'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:27.036300 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-7d99c976-3956-4ac0-96a6-6927c740c582 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12e1abc62343485a900bf20cbbb8bf50'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:27.043977 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-7d99c976-3956-4ac0-96a6-6927c740c582 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12e1abc62343485a900bf20cbbb8bf50'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:27.044702 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-7d99c976-3956-4ac0-96a6-6927c740c582 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12e1abc62343485a900bf20cbbb8bf50'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:27.053110 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-7d99c976-3956-4ac0-96a6-6927c740c582 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12e1abc62343485a900bf20cbbb8bf50'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:27.059590 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 966/1937] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:24:26 2022] DELETE /identity/v3/users/12e1abc62343485a900bf20cbbb8bf50 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:24:27.063901 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dde39e-a7bc-4127-9b46-84f94e849d66 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:27.064318 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dde39e-a7bc-4127-9b46-84f94e849d66 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:27.064598 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dde39e-a7bc-4127-9b46-84f94e849d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:27.098558 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-b7dde39e-a7bc-4127-9b46-84f94e849d66 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:24:27.100003 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-b7dde39e-a7bc-4127-9b46-84f94e849d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:27.169100 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 972/1938] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:24:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:24:27.178731 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d99c976-3956-4ac0-96a6-6927c740c582 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:27.180135 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-7d99c976-3956-4ac0-96a6-6927c740c582 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:27.238171 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d99c976-3956-4ac0-96a6-6927c740c582 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:27.241997 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e50e99d-0f85-4419-adaa-8ec4594f0b1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:27.242609 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e50e99d-0f85-4419-adaa-8ec4594f0b1b service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:27.242972 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e50e99d-0f85-4419-adaa-8ec4594f0b1b service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:27.243154 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e50e99d-0f85-4419-adaa-8ec4594f0b1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:27.253007 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e50e99d-0f85-4419-adaa-8ec4594f0b1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:27.254521 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e50e99d-0f85-4419-adaa-8ec4594f0b1b service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:27.265025 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 967/1939] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:24:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:24:27.586780 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dde39e-a7bc-4127-9b46-84f94e849d66 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:27.588285 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-b7dde39e-a7bc-4127-9b46-84f94e849d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:27.602061 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dde39e-a7bc-4127-9b46-84f94e849d66 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:27.607062 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eeaa4a-6159-47bf-ab43-6e39577db4b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:27.607901 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eeaa4a-6159-47bf-ab43-6e39577db4b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:27.608249 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eeaa4a-6159-47bf-ab43-6e39577db4b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:27.608535 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eeaa4a-6159-47bf-ab43-6e39577db4b9 admin admin] PATH_INFO: `/v3/projects/d303ff420c2d42bfb3cdbc5653b22a97` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:27.609635 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eeaa4a-6159-47bf-ab43-6e39577db4b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d303ff420c2d42bfb3cdbc5653b22a97)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:27.611578 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eeaa4a-6159-47bf-ab43-6e39577db4b9 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:27.659114 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-77eeaa4a-6159-47bf-ab43-6e39577db4b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd303ff420c2d42bfb3cdbc5653b22a97', 'request_id': 'req-77eeaa4a-6159-47bf-ab43-6e39577db4b9'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:27.664868 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-77eeaa4a-6159-47bf-ab43-6e39577db4b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd303ff420c2d42bfb3cdbc5653b22a97', 'request_id': 'req-77eeaa4a-6159-47bf-ab43-6e39577db4b9'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:27.671832 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-77eeaa4a-6159-47bf-ab43-6e39577db4b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd303ff420c2d42bfb3cdbc5653b22a97', 'request_id': 'req-77eeaa4a-6159-47bf-ab43-6e39577db4b9'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:27.684530 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-77eeaa4a-6159-47bf-ab43-6e39577db4b9 admin admin] The token cache is being invalidate because project d303ff420c2d42bfb3cdbc5653b22a97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:24:27.684816 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-77eeaa4a-6159-47bf-ab43-6e39577db4b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:27.685425 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-77eeaa4a-6159-47bf-ab43-6e39577db4b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:27.686977 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 973/1940] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:24:27 2022] DELETE /identity/v3/projects/d303ff420c2d42bfb3cdbc5653b22a97 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:24:27.691955 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a550589c-793b-416f-a253-e2e64b510385 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:27.692247 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a550589c-793b-416f-a253-e2e64b510385 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:27.692522 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a550589c-793b-416f-a253-e2e64b510385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:27.712053 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-a550589c-793b-416f-a253-e2e64b510385 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:24:27.713318 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-a550589c-793b-416f-a253-e2e64b510385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:27.772796 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 968/1941] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:24:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:24:27.780576 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eeaa4a-6159-47bf-ab43-6e39577db4b9 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:27.781026 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4c6846-77b6-4ca3-a1b2-3f72d63453f6 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:27.781397 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4c6846-77b6-4ca3-a1b2-3f72d63453f6 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:27.781668 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4c6846-77b6-4ca3-a1b2-3f72d63453f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:27.782022 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-77eeaa4a-6159-47bf-ab43-6e39577db4b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:27.795689 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eeaa4a-6159-47bf-ab43-6e39577db4b9 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:27.800483 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b75bb50-29fa-4814-885c-7d7de054a6d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:27.801100 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b75bb50-29fa-4814-885c-7d7de054a6d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:27.801375 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b75bb50-29fa-4814-885c-7d7de054a6d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:27.801629 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-ec4c6846-77b6-4ca3-a1b2-3f72d63453f6 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:24:27.801751 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b75bb50-29fa-4814-885c-7d7de054a6d6 admin admin] PATH_INFO: `/v3/users/8193c8a5563049c6b88678a11e6d3d17` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:27.802786 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b75bb50-29fa-4814-885c-7d7de054a6d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8193c8a5563049c6b88678a11e6d3d17)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:27.802903 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-ec4c6846-77b6-4ca3-a1b2-3f72d63453f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:27.806588 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b75bb50-29fa-4814-885c-7d7de054a6d6 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:27.813024 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 969/1942] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:24:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:24:27.816977 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4c6846-77b6-4ca3-a1b2-3f72d63453f6 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:27.826498 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4c6846-77b6-4ca3-a1b2-3f72d63453f6 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:27.832822 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2cf7ea-0f66-42e9-8b65-aafc6bf19a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:27.833782 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2cf7ea-0f66-42e9-8b65-aafc6bf19a44 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:27.834186 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2cf7ea-0f66-42e9-8b65-aafc6bf19a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:27.834528 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2cf7ea-0f66-42e9-8b65-aafc6bf19a44 admin admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:27.835302 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2cf7ea-0f66-42e9-8b65-aafc6bf19a44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:24:27.835676 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2cf7ea-0f66-42e9-8b65-aafc6bf19a44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:27.837496 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2cf7ea-0f66-42e9-8b65-aafc6bf19a44 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:27.854132 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 970/1943] 10.222.0.36 () {58 vars in 1153 bytes} [Tue Aug 9 10:24:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:24:27.855755 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2cf7ea-0f66-42e9-8b65-aafc6bf19a44 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:27.862631 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-6b75bb50-29fa-4814-885c-7d7de054a6d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8193c8a5563049c6b88678a11e6d3d17'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:27.871306 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2cf7ea-0f66-42e9-8b65-aafc6bf19a44 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:27.877194 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebba4b9-f836-46f6-94d1-303341f9489f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:27.877810 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-6b75bb50-29fa-4814-885c-7d7de054a6d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8193c8a5563049c6b88678a11e6d3d17'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:27.878013 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebba4b9-f836-46f6-94d1-303341f9489f admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:27.878336 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebba4b9-f836-46f6-94d1-303341f9489f admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:27.878670 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebba4b9-f836-46f6-94d1-303341f9489f admin admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:27.879292 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebba4b9-f836-46f6-94d1-303341f9489f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:27.881296 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebba4b9-f836-46f6-94d1-303341f9489f admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:27.885450 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-6b75bb50-29fa-4814-885c-7d7de054a6d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8193c8a5563049c6b88678a11e6d3d17'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:27.886861 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-6b75bb50-29fa-4814-885c-7d7de054a6d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8193c8a5563049c6b88678a11e6d3d17'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:27.890061 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:24:27.897809 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-6b75bb50-29fa-4814-885c-7d7de054a6d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8193c8a5563049c6b88678a11e6d3d17'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:27.906975 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 974/1944] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:24:27 2022] DELETE /identity/v3/users/8193c8a5563049c6b88678a11e6d3d17 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:24:27.911660 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7725fb6a-7482-4c64-bfe6-c06a39ccdf84 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:27.912204 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7725fb6a-7482-4c64-bfe6-c06a39ccdf84 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:27.912576 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7725fb6a-7482-4c64-bfe6-c06a39ccdf84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:27.915398 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 971/1945] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:24:27 2022] POST /identity/v3/projects => generated 385 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 10:24:27.921221 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebba4b9-f836-46f6-94d1-303341f9489f admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:27.923312 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-1ebba4b9-f836-46f6-94d1-303341f9489f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:27.935240 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-7725fb6a-7482-4c64-bfe6-c06a39ccdf84 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:24:27.936545 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-7725fb6a-7482-4c64-bfe6-c06a39ccdf84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:27.959552 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:24:28.004775 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebba4b9-f836-46f6-94d1-303341f9489f admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:28.009606 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca603b3-9c70-453c-98a7-e1d5ae986e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:28.010241 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca603b3-9c70-453c-98a7-e1d5ae986e85 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:28.010517 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca603b3-9c70-453c-98a7-e1d5ae986e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:28.010890 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca603b3-9c70-453c-98a7-e1d5ae986e85 admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:28.011757 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca603b3-9c70-453c-98a7-e1d5ae986e85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:28.013516 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca603b3-9c70-453c-98a7-e1d5ae986e85 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:28.025807 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 975/1946] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:24:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 10:24:28.037316 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7725fb6a-7482-4c64-bfe6-c06a39ccdf84 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:28.037480 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 972/1947] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:24:27 2022] POST /identity/v3/users => generated 293 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 10:24:28.038956 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-7725fb6a-7482-4c64-bfe6-c06a39ccdf84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:28.041140 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca603b3-9c70-453c-98a7-e1d5ae986e85 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:28.051101 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca603b3-9c70-453c-98a7-e1d5ae986e85 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:28.055642 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277577a1-fa14-4501-8a92-e8c17e6d1d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:28.056222 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277577a1-fa14-4501-8a92-e8c17e6d1d55 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:28.056498 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277577a1-fa14-4501-8a92-e8c17e6d1d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:28.056761 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277577a1-fa14-4501-8a92-e8c17e6d1d55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:28.057389 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277577a1-fa14-4501-8a92-e8c17e6d1d55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:28.059543 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277577a1-fa14-4501-8a92-e8c17e6d1d55 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:28.069506 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 973/1948] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:24:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:24:28.074069 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277577a1-fa14-4501-8a92-e8c17e6d1d55 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:28.083777 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277577a1-fa14-4501-8a92-e8c17e6d1d55 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:28.088498 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fd0e8c-38a0-434f-98d5-fbff719353a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:28.089699 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fd0e8c-38a0-434f-98d5-fbff719353a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:28.090024 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fd0e8c-38a0-434f-98d5-fbff719353a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:28.090398 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fd0e8c-38a0-434f-98d5-fbff719353a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:28.090950 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fd0e8c-38a0-434f-98d5-fbff719353a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:28.092514 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fd0e8c-38a0-434f-98d5-fbff719353a4 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:28.098400 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7725fb6a-7482-4c64-bfe6-c06a39ccdf84 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:28.102165 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4ac675-307e-4ee8-8ed9-3a2270f6a90a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:28.102758 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ac675-307e-4ee8-8ed9-3a2270f6a90a service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:28.103032 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ac675-307e-4ee8-8ed9-3a2270f6a90a service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:28.103297 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ac675-307e-4ee8-8ed9-3a2270f6a90a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:28.103780 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 974/1949] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:24:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 10:24:28.108154 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fd0e8c-38a0-434f-98d5-fbff719353a4 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:28.116037 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4ac675-307e-4ee8-8ed9-3a2270f6a90a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:28.117544 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4ac675-307e-4ee8-8ed9-3a2270f6a90a service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:28.118903 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fd0e8c-38a0-434f-98d5-fbff719353a4 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:28.125254 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22d722f-4f5e-4f2c-9e70-31061fbccc19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:28.125935 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22d722f-4f5e-4f2c-9e70-31061fbccc19 admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:28.126216 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22d722f-4f5e-4f2c-9e70-31061fbccc19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:28.126514 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22d722f-4f5e-4f2c-9e70-31061fbccc19 admin admin] PATH_INFO: `/v3/projects/fdc2243864784192b1b77a32c3bb6d95/users/092e0422b6c14244a3138338d6e1a378/roles/a9895331e9694fa8b2b50908bb057bcb` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:28.127864 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 976/1950] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:24:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 10:24:28.142760 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22d722f-4f5e-4f2c-9e70-31061fbccc19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdc2243864784192b1b77a32c3bb6d95, user_id=092e0422b6c14244a3138338d6e1a378, role_id=a9895331e9694fa8b2b50908bb057bcb)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:28.145542 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22d722f-4f5e-4f2c-9e70-31061fbccc19 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:28.159829 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 975/1951] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:24:28 2022] PUT /identity/v3/projects/fdc2243864784192b1b77a32c3bb6d95/users/092e0422b6c14244a3138338d6e1a378/roles/a9895331e9694fa8b2b50908bb057bcb => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 10:24:28.170246 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e93baad-2f06-4767-a938-7a94904a3e2d None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:28.174318 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e93baad-2f06-4767-a938-7a94904a3e2d None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:28.174607 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e93baad-2f06-4767-a938-7a94904a3e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:28.209266 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-0e93baad-2f06-4767-a938-7a94904a3e2d None None] MFA Rules not processed for user `092e0422b6c14244a3138338d6e1a378`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:24:28.210655 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-0e93baad-2f06-4767-a938-7a94904a3e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:28.281567 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 977/1952] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:24:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 10:24:28.293578 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22d722f-4f5e-4f2c-9e70-31061fbccc19 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:28.295490 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-b22d722f-4f5e-4f2c-9e70-31061fbccc19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:28.358221 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22d722f-4f5e-4f2c-9e70-31061fbccc19 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:28.361965 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bfde93-fb87-440f-a02a-7acb36087efb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6c687a38524de0bf23d87ae91d3b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:28.362580 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bfde93-fb87-440f-a02a-7acb36087efb service cinder] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:28.362860 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bfde93-fb87-440f-a02a-7acb36087efb service cinder] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:28.363131 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bfde93-fb87-440f-a02a-7acb36087efb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:28.372992 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bfde93-fb87-440f-a02a-7acb36087efb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:28.374924 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bfde93-fb87-440f-a02a-7acb36087efb service cinder] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:28.383710 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 976/1953] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:24:28 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:24:28.591066 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e93baad-2f06-4767-a938-7a94904a3e2d None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:28.593253 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-0e93baad-2f06-4767-a938-7a94904a3e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:28.666341 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:24:28.715331 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e93baad-2f06-4767-a938-7a94904a3e2d None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:28.721969 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515d797b-6b32-4dfc-a138-80dad129b6f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:28.722621 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515d797b-6b32-4dfc-a138-80dad129b6f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:28.722900 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515d797b-6b32-4dfc-a138-80dad129b6f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:28.723174 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515d797b-6b32-4dfc-a138-80dad129b6f3 admin admin] PATH_INFO: `/v3/projects/04c6cccdd2bd42189bc0b8e8c3ae95b9` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:28.724582 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515d797b-6b32-4dfc-a138-80dad129b6f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04c6cccdd2bd42189bc0b8e8c3ae95b9)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:28.728560 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515d797b-6b32-4dfc-a138-80dad129b6f3 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:28.815496 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-515d797b-6b32-4dfc-a138-80dad129b6f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04c6cccdd2bd42189bc0b8e8c3ae95b9', 'request_id': 'req-515d797b-6b32-4dfc-a138-80dad129b6f3'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:28.815496 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-515d797b-6b32-4dfc-a138-80dad129b6f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04c6cccdd2bd42189bc0b8e8c3ae95b9', 'request_id': 'req-515d797b-6b32-4dfc-a138-80dad129b6f3'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:28.821982 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-515d797b-6b32-4dfc-a138-80dad129b6f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04c6cccdd2bd42189bc0b8e8c3ae95b9', 'request_id': 'req-515d797b-6b32-4dfc-a138-80dad129b6f3'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:28.843399 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-515d797b-6b32-4dfc-a138-80dad129b6f3 admin admin] The token cache is being invalidate because project 04c6cccdd2bd42189bc0b8e8c3ae95b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:24:28.843732 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-515d797b-6b32-4dfc-a138-80dad129b6f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:28.844341 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-515d797b-6b32-4dfc-a138-80dad129b6f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:28.846842 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 978/1954] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:24:28 2022] DELETE /identity/v3/projects/04c6cccdd2bd42189bc0b8e8c3ae95b9 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:24:28.850969 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bfde93-fb87-440f-a02a-7acb36087efb service cinder] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:28.863236 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bfde93-fb87-440f-a02a-7acb36087efb service cinder] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:28.921030 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb637e5-db3c-45f1-9294-530067c93d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:28.921742 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb637e5-db3c-45f1-9294-530067c93d64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:28.921973 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb637e5-db3c-45f1-9294-530067c93d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:28.922243 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb637e5-db3c-45f1-9294-530067c93d64 admin admin] PATH_INFO: `/v3/users/fa8d2c174b0d44e68662adcd024cdcfb` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:28.923359 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb637e5-db3c-45f1-9294-530067c93d64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa8d2c174b0d44e68662adcd024cdcfb)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:28.925242 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb637e5-db3c-45f1-9294-530067c93d64 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:28.938786 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:24:28.972246 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-2bb637e5-db3c-45f1-9294-530067c93d64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa8d2c174b0d44e68662adcd024cdcfb'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:28.984303 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-2bb637e5-db3c-45f1-9294-530067c93d64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa8d2c174b0d44e68662adcd024cdcfb'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:28.991111 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-2bb637e5-db3c-45f1-9294-530067c93d64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa8d2c174b0d44e68662adcd024cdcfb'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:28.991782 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-2bb637e5-db3c-45f1-9294-530067c93d64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa8d2c174b0d44e68662adcd024cdcfb'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:29.000119 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-2bb637e5-db3c-45f1-9294-530067c93d64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa8d2c174b0d44e68662adcd024cdcfb'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:29.006133 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 977/1955] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:24:28 2022] DELETE /identity/v3/users/fa8d2c174b0d44e68662adcd024cdcfb => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:24:29.285958 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515d797b-6b32-4dfc-a138-80dad129b6f3 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:29.287570 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-515d797b-6b32-4dfc-a138-80dad129b6f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:29.301258 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515d797b-6b32-4dfc-a138-80dad129b6f3 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:29.358385 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4c22f9-48da-4b96-b510-bf908f21ad27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:29.358948 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c22f9-48da-4b96-b510-bf908f21ad27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:29.359224 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c22f9-48da-4b96-b510-bf908f21ad27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:29.359490 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c22f9-48da-4b96-b510-bf908f21ad27 admin admin] PATH_INFO: `/v3/projects/7741caa0895f433bb0877028246341fe` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:29.360601 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4c22f9-48da-4b96-b510-bf908f21ad27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7741caa0895f433bb0877028246341fe)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:29.362640 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4c22f9-48da-4b96-b510-bf908f21ad27 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:29.410520 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-ce4c22f9-48da-4b96-b510-bf908f21ad27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7741caa0895f433bb0877028246341fe', 'request_id': 'req-ce4c22f9-48da-4b96-b510-bf908f21ad27'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:29.416508 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-ce4c22f9-48da-4b96-b510-bf908f21ad27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7741caa0895f433bb0877028246341fe', 'request_id': 'req-ce4c22f9-48da-4b96-b510-bf908f21ad27'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:29.417837 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:24:29.425169 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-ce4c22f9-48da-4b96-b510-bf908f21ad27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7741caa0895f433bb0877028246341fe', 'request_id': 'req-ce4c22f9-48da-4b96-b510-bf908f21ad27'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:29.439989 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-ce4c22f9-48da-4b96-b510-bf908f21ad27 admin admin] The token cache is being invalidate because project 7741caa0895f433bb0877028246341fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:24:29.440367 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-ce4c22f9-48da-4b96-b510-bf908f21ad27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:29.441117 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-ce4c22f9-48da-4b96-b510-bf908f21ad27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:29.442738 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 979/1956] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:24:29 2022] DELETE /identity/v3/projects/7741caa0895f433bb0877028246341fe => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:24:29.447780 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ac2540-950f-48bb-8bf9-2e5c4bc29a60 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:29.448209 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ac2540-950f-48bb-8bf9-2e5c4bc29a60 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:29.449168 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ac2540-950f-48bb-8bf9-2e5c4bc29a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:29.480502 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-c2ac2540-950f-48bb-8bf9-2e5c4bc29a60 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:24:29.481911 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-c2ac2540-950f-48bb-8bf9-2e5c4bc29a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:29.550648 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 978/1957] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:24:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 10:24:29.553100 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba8cf29-93b3-446b-a052-4795ff46cb91 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:29.553450 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba8cf29-93b3-446b-a052-4795ff46cb91 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:29.553825 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba8cf29-93b3-446b-a052-4795ff46cb91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:29.575399 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-0ba8cf29-93b3-446b-a052-4795ff46cb91 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:24:29.576743 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-0ba8cf29-93b3-446b-a052-4795ff46cb91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:29.585119 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 980/1958] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:24:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:24:29.589459 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ac2540-950f-48bb-8bf9-2e5c4bc29a60 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:29.599837 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ac2540-950f-48bb-8bf9-2e5c4bc29a60 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:29.604614 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed23cf16-442e-4ac6-aaf7-3ea923b8ed52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:29.605211 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed23cf16-442e-4ac6-aaf7-3ea923b8ed52 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:29.605486 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed23cf16-442e-4ac6-aaf7-3ea923b8ed52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:29.605783 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed23cf16-442e-4ac6-aaf7-3ea923b8ed52 admin admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:29.606462 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed23cf16-442e-4ac6-aaf7-3ea923b8ed52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:24:29.606763 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed23cf16-442e-4ac6-aaf7-3ea923b8ed52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:29.608365 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed23cf16-442e-4ac6-aaf7-3ea923b8ed52 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:29.620757 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 979/1959] 10.222.0.36 () {58 vars in 1153 bytes} [Tue Aug 9 10:24:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:24:29.625321 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba8cf29-93b3-446b-a052-4795ff46cb91 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:29.634492 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba8cf29-93b3-446b-a052-4795ff46cb91 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:29.639245 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18820da9-f44b-428c-8aaa-56bd98a68f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:29.639839 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18820da9-f44b-428c-8aaa-56bd98a68f64 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:29.640121 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18820da9-f44b-428c-8aaa-56bd98a68f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:29.640446 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18820da9-f44b-428c-8aaa-56bd98a68f64 admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:29.641063 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18820da9-f44b-428c-8aaa-56bd98a68f64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:29.643044 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18820da9-f44b-428c-8aaa-56bd98a68f64 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:29.672596 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 981/1960] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:24:29 2022] POST /identity/v3/projects => generated 367 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 10:24:29.676847 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed23cf16-442e-4ac6-aaf7-3ea923b8ed52 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:29.687613 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed23cf16-442e-4ac6-aaf7-3ea923b8ed52 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:29.752475 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad108cf-f7bc-412f-88b5-742e287afa32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:29.753146 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad108cf-f7bc-412f-88b5-742e287afa32 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:29.753453 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad108cf-f7bc-412f-88b5-742e287afa32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:29.753725 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad108cf-f7bc-412f-88b5-742e287afa32 admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:29.754396 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad108cf-f7bc-412f-88b5-742e287afa32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:29.756327 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad108cf-f7bc-412f-88b5-742e287afa32 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:29.779150 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 980/1961] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:24:29 2022] POST /identity/v3/users => generated 284 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:24:29.783583 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18820da9-f44b-428c-8aaa-56bd98a68f64 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:29.796473 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18820da9-f44b-428c-8aaa-56bd98a68f64 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:29.801049 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d7d36a-506c-4a2f-87de-7f4cbba3094e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:29.801643 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7d36a-506c-4a2f-87de-7f4cbba3094e admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:29.801948 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7d36a-506c-4a2f-87de-7f4cbba3094e admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:29.802218 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7d36a-506c-4a2f-87de-7f4cbba3094e admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:29.803009 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d7d36a-506c-4a2f-87de-7f4cbba3094e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:29.804653 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d7d36a-506c-4a2f-87de-7f4cbba3094e admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:29.814891 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 982/1962] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:24:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:24:29.818970 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad108cf-f7bc-412f-88b5-742e287afa32 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:29.833336 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad108cf-f7bc-412f-88b5-742e287afa32 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:29.839519 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde82b3a-3da3-4ca4-8ba9-f1ea99d0a0c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:29.840363 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde82b3a-3da3-4ca4-8ba9-f1ea99d0a0c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:29.840742 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde82b3a-3da3-4ca4-8ba9-f1ea99d0a0c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:29.841129 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde82b3a-3da3-4ca4-8ba9-f1ea99d0a0c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:29.842033 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde82b3a-3da3-4ca4-8ba9-f1ea99d0a0c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:29.843960 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde82b3a-3da3-4ca4-8ba9-f1ea99d0a0c7 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:29.845978 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:24:29.858177 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 981/1963] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:24:29 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:24:29.863000 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d7d36a-506c-4a2f-87de-7f4cbba3094e admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:29.876686 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d7d36a-506c-4a2f-87de-7f4cbba3094e admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:29.881386 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0f2a94-b703-4de7-89ee-0f1edb6c5afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:29.882094 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f2a94-b703-4de7-89ee-0f1edb6c5afd admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:29.882371 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f2a94-b703-4de7-89ee-0f1edb6c5afd admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:29.882642 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f2a94-b703-4de7-89ee-0f1edb6c5afd admin admin] PATH_INFO: `/v3/projects/65654972b687457eae297d5bc0d0d96e/users/24361c38101345ef94abddd2773d3d24/roles/a9895331e9694fa8b2b50908bb057bcb` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:29.899598 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0f2a94-b703-4de7-89ee-0f1edb6c5afd admin admin] RBAC: Authorizing `identity:create_grant(project_id=65654972b687457eae297d5bc0d0d96e, user_id=24361c38101345ef94abddd2773d3d24, role_id=a9895331e9694fa8b2b50908bb057bcb)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:29.902423 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0f2a94-b703-4de7-89ee-0f1edb6c5afd admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:29.919209 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 983/1964] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:24:29 2022] PUT /identity/v3/projects/65654972b687457eae297d5bc0d0d96e/users/24361c38101345ef94abddd2773d3d24/roles/a9895331e9694fa8b2b50908bb057bcb => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:24:29.929804 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc15a5-7db4-4195-8a10-12c150f3965e None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:29.930364 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc15a5-7db4-4195-8a10-12c150f3965e None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:29.930739 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc15a5-7db4-4195-8a10-12c150f3965e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:29.972299 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-1ffc15a5-7db4-4195-8a10-12c150f3965e None None] MFA Rules not processed for user `24361c38101345ef94abddd2773d3d24`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:24:29.973511 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-1ffc15a5-7db4-4195-8a10-12c150f3965e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:30.061808 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 982/1965] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:24:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 10:24:30.066404 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0f2a94-b703-4de7-89ee-0f1edb6c5afd admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:30.144602 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0f2a94-b703-4de7-89ee-0f1edb6c5afd admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:30.149432 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90974efb-6b63-4626-9c4a-91f47e4476f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:30.150080 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90974efb-6b63-4626-9c4a-91f47e4476f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:30.150362 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90974efb-6b63-4626-9c4a-91f47e4476f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:30.150642 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90974efb-6b63-4626-9c4a-91f47e4476f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:30.151275 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90974efb-6b63-4626-9c4a-91f47e4476f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:30.154003 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90974efb-6b63-4626-9c4a-91f47e4476f4 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:30.181465 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 984/1966] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:24:30 2022] POST /identity/v3/projects => generated 369 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:24:30.186276 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffc15a5-7db4-4195-8a10-12c150f3965e None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:30.196644 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffc15a5-7db4-4195-8a10-12c150f3965e None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:30.258650 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9b3993-edc5-44c8-8a75-28f09f09558c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:30.259313 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b3993-edc5-44c8-8a75-28f09f09558c admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:30.259666 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b3993-edc5-44c8-8a75-28f09f09558c admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:30.259942 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b3993-edc5-44c8-8a75-28f09f09558c admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:30.260576 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9b3993-edc5-44c8-8a75-28f09f09558c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:30.263900 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9b3993-edc5-44c8-8a75-28f09f09558c admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:30.294114 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 983/1967] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:24:30 2022] POST /identity/v3/users => generated 291 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:24:30.298122 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90974efb-6b63-4626-9c4a-91f47e4476f4 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:30.309986 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90974efb-6b63-4626-9c4a-91f47e4476f4 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:30.315398 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dae5c1-e8b2-4c5e-bb03-75245e17af06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:30.316068 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dae5c1-e8b2-4c5e-bb03-75245e17af06 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:30.316351 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dae5c1-e8b2-4c5e-bb03-75245e17af06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:30.316629 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dae5c1-e8b2-4c5e-bb03-75245e17af06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:30.317280 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dae5c1-e8b2-4c5e-bb03-75245e17af06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:30.318928 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dae5c1-e8b2-4c5e-bb03-75245e17af06 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:30.330457 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 985/1968] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:24:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:24:30.334627 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9b3993-edc5-44c8-8a75-28f09f09558c admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:30.344630 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9b3993-edc5-44c8-8a75-28f09f09558c admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:30.349277 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b86f98-c287-4c41-981a-0ae61c2ae11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:30.349960 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b86f98-c287-4c41-981a-0ae61c2ae11c admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:30.350243 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b86f98-c287-4c41-981a-0ae61c2ae11c admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:30.350516 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b86f98-c287-4c41-981a-0ae61c2ae11c admin admin] PATH_INFO: `/v3/projects/8207f998533e44228cbd24743b24887e/users/6ee7cfea70d1476d9c9b10d416769d9b/roles/89ca30cbbb634be8a96e9921aa56626b` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:30.366193 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b86f98-c287-4c41-981a-0ae61c2ae11c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8207f998533e44228cbd24743b24887e, user_id=6ee7cfea70d1476d9c9b10d416769d9b, role_id=89ca30cbbb634be8a96e9921aa56626b)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:30.368862 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b86f98-c287-4c41-981a-0ae61c2ae11c admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:30.381875 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 984/1969] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:24:30 2022] PUT /identity/v3/projects/8207f998533e44228cbd24743b24887e/users/6ee7cfea70d1476d9c9b10d416769d9b/roles/89ca30cbbb634be8a96e9921aa56626b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:24:30.386361 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dae5c1-e8b2-4c5e-bb03-75245e17af06 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:30.396087 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dae5c1-e8b2-4c5e-bb03-75245e17af06 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:30.444421 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:24:30.454594 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a42f1e0-bd90-4d9a-92f2-54578aafcdd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:30.455348 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a42f1e0-bd90-4d9a-92f2-54578aafcdd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:30.455713 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a42f1e0-bd90-4d9a-92f2-54578aafcdd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:30.456071 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a42f1e0-bd90-4d9a-92f2-54578aafcdd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:30.456793 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a42f1e0-bd90-4d9a-92f2-54578aafcdd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:30.458552 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a42f1e0-bd90-4d9a-92f2-54578aafcdd4 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:30.470221 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 986/1970] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:24:30 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:24:30.474432 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b86f98-c287-4c41-981a-0ae61c2ae11c admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:30.485532 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b86f98-c287-4c41-981a-0ae61c2ae11c admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:30.490050 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9433a7e3-8c35-4c91-a843-7cd1a18f3e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:30.490688 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9433a7e3-8c35-4c91-a843-7cd1a18f3e0f admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:30.490963 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9433a7e3-8c35-4c91-a843-7cd1a18f3e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:30.491233 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9433a7e3-8c35-4c91-a843-7cd1a18f3e0f admin admin] PATH_INFO: `/v3/projects/8207f998533e44228cbd24743b24887e/users/6ee7cfea70d1476d9c9b10d416769d9b/roles/89ca30cbbb634be8a96e9921aa56626b` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:30.493107 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9433a7e3-8c35-4c91-a843-7cd1a18f3e0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8207f998533e44228cbd24743b24887e, user_id=6ee7cfea70d1476d9c9b10d416769d9b, role_id=89ca30cbbb634be8a96e9921aa56626b)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:30.496065 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9433a7e3-8c35-4c91-a843-7cd1a18f3e0f admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:30.505836 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 985/1971] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:24:30 2022] PUT /identity/v3/projects/8207f998533e44228cbd24743b24887e/users/6ee7cfea70d1476d9c9b10d416769d9b/roles/89ca30cbbb634be8a96e9921aa56626b => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:24:30.516658 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c70a794-3e22-4f5d-a613-6da666013e1d None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:30.516944 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c70a794-3e22-4f5d-a613-6da666013e1d None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:30.517217 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c70a794-3e22-4f5d-a613-6da666013e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:30.546316 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-5c70a794-3e22-4f5d-a613-6da666013e1d None None] MFA Rules not processed for user `6ee7cfea70d1476d9c9b10d416769d9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:24:30.547514 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-5c70a794-3e22-4f5d-a613-6da666013e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:30.614125 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 987/1972] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:24:30 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:24:30.626836 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9433a7e3-8c35-4c91-a843-7cd1a18f3e0f admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:30.629238 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-9433a7e3-8c35-4c91-a843-7cd1a18f3e0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:30.679356 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:24:30.697284 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9433a7e3-8c35-4c91-a843-7cd1a18f3e0f admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:30.704408 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ed2b7b-7141-4d53-950d-d341f6d37d39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6c687a38524de0bf23d87ae91d3b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:30.705031 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed2b7b-7141-4d53-950d-d341f6d37d39 service cinder] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:30.705315 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed2b7b-7141-4d53-950d-d341f6d37d39 service cinder] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:30.705586 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed2b7b-7141-4d53-950d-d341f6d37d39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:30.717186 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ed2b7b-7141-4d53-950d-d341f6d37d39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:30.718826 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ed2b7b-7141-4d53-950d-d341f6d37d39 service cinder] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:30.730868 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 986/1973] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:24:30 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:24:30.777612 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c70a794-3e22-4f5d-a613-6da666013e1d None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:30.779109 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-5c70a794-3e22-4f5d-a613-6da666013e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:30.791249 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c70a794-3e22-4f5d-a613-6da666013e1d None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:30.797206 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bd3899-0811-4b0e-ac4e-12024f8336dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6c687a38524de0bf23d87ae91d3b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:30.798211 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bd3899-0811-4b0e-ac4e-12024f8336dc service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:30.798676 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bd3899-0811-4b0e-ac4e-12024f8336dc service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:30.799135 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bd3899-0811-4b0e-ac4e-12024f8336dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:30.859482 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bd3899-0811-4b0e-ac4e-12024f8336dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:30.860948 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bd3899-0811-4b0e-ac4e-12024f8336dc service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:30.870867 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 988/1974] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:24:30 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 10:24:31.186711 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ed2b7b-7141-4d53-950d-d341f6d37d39 service cinder] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:31.188200 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-39ed2b7b-7141-4d53-950d-d341f6d37d39 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:31.358934 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ed2b7b-7141-4d53-950d-d341f6d37d39 service cinder] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:31.365755 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c0df8c-4b68-4bc8-a7dc-93b93539dd59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:31.366057 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c0df8c-4b68-4bc8-a7dc-93b93539dd59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:31.366917 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c0df8c-4b68-4bc8-a7dc-93b93539dd59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:31.367289 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c0df8c-4b68-4bc8-a7dc-93b93539dd59 admin admin] PATH_INFO: `/v3/users/092e0422b6c14244a3138338d6e1a378` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:31.368709 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c0df8c-4b68-4bc8-a7dc-93b93539dd59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=092e0422b6c14244a3138338d6e1a378)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:31.371581 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c0df8c-4b68-4bc8-a7dc-93b93539dd59 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:31.437776 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-43c0df8c-4b68-4bc8-a7dc-93b93539dd59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '092e0422b6c14244a3138338d6e1a378'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:31.458818 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-43c0df8c-4b68-4bc8-a7dc-93b93539dd59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '092e0422b6c14244a3138338d6e1a378'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:31.467428 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-43c0df8c-4b68-4bc8-a7dc-93b93539dd59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '092e0422b6c14244a3138338d6e1a378'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:31.468674 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-43c0df8c-4b68-4bc8-a7dc-93b93539dd59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '092e0422b6c14244a3138338d6e1a378'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:31.477435 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-43c0df8c-4b68-4bc8-a7dc-93b93539dd59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '092e0422b6c14244a3138338d6e1a378'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:31.484849 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 987/1975] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:24:31 2022] DELETE /identity/v3/users/092e0422b6c14244a3138338d6e1a378 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:24:31.489505 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4acf20-b2e5-436a-a19a-14b44befc0bf None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:31.490257 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4acf20-b2e5-436a-a19a-14b44befc0bf None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:31.490700 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4acf20-b2e5-436a-a19a-14b44befc0bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:31.512134 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-df4acf20-b2e5-436a-a19a-14b44befc0bf None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:24:31.513413 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-df4acf20-b2e5-436a-a19a-14b44befc0bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:31.586092 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 989/1976] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:24:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:24:31.599090 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c0df8c-4b68-4bc8-a7dc-93b93539dd59 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:31.600943 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-43c0df8c-4b68-4bc8-a7dc-93b93539dd59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:31.676516 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c0df8c-4b68-4bc8-a7dc-93b93539dd59 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:31.682638 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d3960b-5064-4bfc-ac74-b0269b100cc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:31.684099 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d3960b-5064-4bfc-ac74-b0269b100cc4 service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:31.684586 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d3960b-5064-4bfc-ac74-b0269b100cc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:31.685457 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d3960b-5064-4bfc-ac74-b0269b100cc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:31.697126 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d3960b-5064-4bfc-ac74-b0269b100cc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:31.699974 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d3960b-5064-4bfc-ac74-b0269b100cc4 service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:31.710553 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 988/1977] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:24:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:24:32.256166 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4acf20-b2e5-436a-a19a-14b44befc0bf None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:32.258036 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-df4acf20-b2e5-436a-a19a-14b44befc0bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:32.278303 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4acf20-b2e5-436a-a19a-14b44befc0bf None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:32.285489 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9193f277-3f4a-4af4-8c66-1c892d8200e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:32.286751 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9193f277-3f4a-4af4-8c66-1c892d8200e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:32.287415 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9193f277-3f4a-4af4-8c66-1c892d8200e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:32.287784 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9193f277-3f4a-4af4-8c66-1c892d8200e7 admin admin] PATH_INFO: `/v3/projects/fdc2243864784192b1b77a32c3bb6d95` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:32.289059 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9193f277-3f4a-4af4-8c66-1c892d8200e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdc2243864784192b1b77a32c3bb6d95)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:32.291725 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9193f277-3f4a-4af4-8c66-1c892d8200e7 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:32.312442 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:24:32.381359 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-9193f277-3f4a-4af4-8c66-1c892d8200e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdc2243864784192b1b77a32c3bb6d95', 'request_id': 'req-9193f277-3f4a-4af4-8c66-1c892d8200e7'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:32.388521 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-9193f277-3f4a-4af4-8c66-1c892d8200e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdc2243864784192b1b77a32c3bb6d95', 'request_id': 'req-9193f277-3f4a-4af4-8c66-1c892d8200e7'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:32.395415 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-9193f277-3f4a-4af4-8c66-1c892d8200e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdc2243864784192b1b77a32c3bb6d95', 'request_id': 'req-9193f277-3f4a-4af4-8c66-1c892d8200e7'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:32.411735 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-9193f277-3f4a-4af4-8c66-1c892d8200e7 admin admin] The token cache is being invalidate because project fdc2243864784192b1b77a32c3bb6d95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:24:32.412624 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-9193f277-3f4a-4af4-8c66-1c892d8200e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:32.413375 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-9193f277-3f4a-4af4-8c66-1c892d8200e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:32.415274 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 990/1978] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:24:32 2022] DELETE /identity/v3/projects/fdc2243864784192b1b77a32c3bb6d95 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:24:32.423152 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27feb7d3-56df-4143-b5d9-723cea49c38c None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:32.423152 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27feb7d3-56df-4143-b5d9-723cea49c38c None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:32.423152 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27feb7d3-56df-4143-b5d9-723cea49c38c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:32.439602 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:24:32.483781 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-27feb7d3-56df-4143-b5d9-723cea49c38c None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:24:32.487304 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-27feb7d3-56df-4143-b5d9-723cea49c38c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:32.641693 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 989/1979] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:24:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:24:32.643315 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9247ef8c-3181-4d2c-94b5-0c172fe76dce None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:32.643601 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9247ef8c-3181-4d2c-94b5-0c172fe76dce None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:32.643874 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9247ef8c-3181-4d2c-94b5-0c172fe76dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:32.677822 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-9247ef8c-3181-4d2c-94b5-0c172fe76dce None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:24:32.680999 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-9247ef8c-3181-4d2c-94b5-0c172fe76dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:32.706230 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 991/1980] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:24:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 10:24:32.710602 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27feb7d3-56df-4143-b5d9-723cea49c38c None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:32.722920 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27feb7d3-56df-4143-b5d9-723cea49c38c None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:32.729305 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcaeed5-f320-4af1-8365-bee0539466bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:32.730742 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcaeed5-f320-4af1-8365-bee0539466bd admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:32.731670 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcaeed5-f320-4af1-8365-bee0539466bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:32.731949 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcaeed5-f320-4af1-8365-bee0539466bd admin admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:32.732613 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcaeed5-f320-4af1-8365-bee0539466bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:24:32.732908 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcaeed5-f320-4af1-8365-bee0539466bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:32.734959 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcaeed5-f320-4af1-8365-bee0539466bd admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:32.754339 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 990/1981] 10.222.0.36 () {58 vars in 1153 bytes} [Tue Aug 9 10:24:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:24:32.756064 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9247ef8c-3181-4d2c-94b5-0c172fe76dce None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:32.767184 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9247ef8c-3181-4d2c-94b5-0c172fe76dce None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:32.773652 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f49044e-e3fc-4476-9b90-b7d1aaa846ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:32.774357 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f49044e-e3fc-4476-9b90-b7d1aaa846ca admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:32.774662 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f49044e-e3fc-4476-9b90-b7d1aaa846ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:32.774931 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f49044e-e3fc-4476-9b90-b7d1aaa846ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:32.775785 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f49044e-e3fc-4476-9b90-b7d1aaa846ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:32.779377 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f49044e-e3fc-4476-9b90-b7d1aaa846ca admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:32.814693 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 992/1982] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:24:32 2022] POST /identity/v3/projects => generated 365 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:24:32.819318 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcaeed5-f320-4af1-8365-bee0539466bd admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:32.831379 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcaeed5-f320-4af1-8365-bee0539466bd admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:32.908357 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d7ef7d-e822-4851-b466-146b8a8042a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:32.909321 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d7ef7d-e822-4851-b466-146b8a8042a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:32.909805 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d7ef7d-e822-4851-b466-146b8a8042a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:32.910346 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d7ef7d-e822-4851-b466-146b8a8042a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:32.911374 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d7ef7d-e822-4851-b466-146b8a8042a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:32.914387 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d7ef7d-e822-4851-b466-146b8a8042a0 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:32.945597 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 991/1983] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:24:32 2022] POST /identity/v3/users => generated 283 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:24:32.947196 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f49044e-e3fc-4476-9b90-b7d1aaa846ca admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:32.960540 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f49044e-e3fc-4476-9b90-b7d1aaa846ca admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:32.967365 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024dac8b-2a25-4868-b058-40445e1400e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:32.967993 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024dac8b-2a25-4868-b058-40445e1400e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:32.968275 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024dac8b-2a25-4868-b058-40445e1400e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:32.968550 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024dac8b-2a25-4868-b058-40445e1400e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:32.969215 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024dac8b-2a25-4868-b058-40445e1400e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:32.971498 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024dac8b-2a25-4868-b058-40445e1400e0 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:32.983282 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 993/1984] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:24:32 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:24:32.987937 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d7ef7d-e822-4851-b466-146b8a8042a0 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:33.013404 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d7ef7d-e822-4851-b466-146b8a8042a0 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:33.019436 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0a9640-f22e-4342-9096-88ec80c4470d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:33.019948 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a9640-f22e-4342-9096-88ec80c4470d admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:33.020308 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a9640-f22e-4342-9096-88ec80c4470d admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:33.020753 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a9640-f22e-4342-9096-88ec80c4470d admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:33.022072 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0a9640-f22e-4342-9096-88ec80c4470d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:33.024252 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0a9640-f22e-4342-9096-88ec80c4470d admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:33.037728 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 992/1985] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:24:32 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:24:33.042431 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024dac8b-2a25-4868-b058-40445e1400e0 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:33.056533 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024dac8b-2a25-4868-b058-40445e1400e0 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:33.061967 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee1747a-d29d-4c6a-ad83-a9937163f575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:33.063205 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee1747a-d29d-4c6a-ad83-a9937163f575 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:33.063205 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee1747a-d29d-4c6a-ad83-a9937163f575 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:33.063205 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee1747a-d29d-4c6a-ad83-a9937163f575 admin admin] PATH_INFO: `/v3/projects/98978cd7b70d44ffaa127bb670cb4bbb/users/41db4e82e28344e597b703d36d874aec/roles/a9895331e9694fa8b2b50908bb057bcb` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:33.082698 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee1747a-d29d-4c6a-ad83-a9937163f575 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98978cd7b70d44ffaa127bb670cb4bbb, user_id=41db4e82e28344e597b703d36d874aec, role_id=a9895331e9694fa8b2b50908bb057bcb)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:33.085388 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee1747a-d29d-4c6a-ad83-a9937163f575 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:33.102004 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 994/1986] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:24:33 2022] PUT /identity/v3/projects/98978cd7b70d44ffaa127bb670cb4bbb/users/41db4e82e28344e597b703d36d874aec/roles/a9895331e9694fa8b2b50908bb057bcb => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:24:33.113586 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443bb084-7c5b-4d9e-b100-325eab7b855f None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:33.113913 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443bb084-7c5b-4d9e-b100-325eab7b855f None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:33.114192 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443bb084-7c5b-4d9e-b100-325eab7b855f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:33.147773 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-443bb084-7c5b-4d9e-b100-325eab7b855f None None] MFA Rules not processed for user `41db4e82e28344e597b703d36d874aec`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:24:33.149243 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-443bb084-7c5b-4d9e-b100-325eab7b855f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:33.217672 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:24:33.224148 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 993/1987] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:24:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:24:33.236292 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee1747a-d29d-4c6a-ad83-a9937163f575 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:33.238081 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-dee1747a-d29d-4c6a-ad83-a9937163f575 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:33.303779 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee1747a-d29d-4c6a-ad83-a9937163f575 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:33.307234 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fba996-92fa-4a5f-a359-0ed99798d963 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6c687a38524de0bf23d87ae91d3b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:33.308056 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fba996-92fa-4a5f-a359-0ed99798d963 service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:33.308332 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fba996-92fa-4a5f-a359-0ed99798d963 service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:33.308618 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fba996-92fa-4a5f-a359-0ed99798d963 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:33.316852 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fba996-92fa-4a5f-a359-0ed99798d963 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:33.318410 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fba996-92fa-4a5f-a359-0ed99798d963 service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:33.327693 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 995/1988] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:24:33 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:24:34.643233 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443bb084-7c5b-4d9e-b100-325eab7b855f None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:34.644753 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-443bb084-7c5b-4d9e-b100-325eab7b855f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:34.734435 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443bb084-7c5b-4d9e-b100-325eab7b855f None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:34.739028 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083f935b-3069-45a0-bcb5-dc1735559417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:34.739735 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f935b-3069-45a0-bcb5-dc1735559417 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:34.740085 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f935b-3069-45a0-bcb5-dc1735559417 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:34.740430 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f935b-3069-45a0-bcb5-dc1735559417 admin admin] PATH_INFO: `/v3/users/24361c38101345ef94abddd2773d3d24` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:34.741678 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083f935b-3069-45a0-bcb5-dc1735559417 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24361c38101345ef94abddd2773d3d24)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:34.743685 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083f935b-3069-45a0-bcb5-dc1735559417 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:34.795988 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-083f935b-3069-45a0-bcb5-dc1735559417 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24361c38101345ef94abddd2773d3d24'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:34.808200 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-083f935b-3069-45a0-bcb5-dc1735559417 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24361c38101345ef94abddd2773d3d24'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:34.815022 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-083f935b-3069-45a0-bcb5-dc1735559417 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24361c38101345ef94abddd2773d3d24'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:34.815773 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-083f935b-3069-45a0-bcb5-dc1735559417 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24361c38101345ef94abddd2773d3d24'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:34.824431 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-083f935b-3069-45a0-bcb5-dc1735559417 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24361c38101345ef94abddd2773d3d24'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:34.830756 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 994/1989] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:24:34 2022] DELETE /identity/v3/users/24361c38101345ef94abddd2773d3d24 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:24:34.835697 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fda3d4-8635-4ae6-b35b-967c21e5b0a2 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:34.836252 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fda3d4-8635-4ae6-b35b-967c21e5b0a2 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:34.836252 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fda3d4-8635-4ae6-b35b-967c21e5b0a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:34.856359 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-00fda3d4-8635-4ae6-b35b-967c21e5b0a2 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:24:34.857591 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-00fda3d4-8635-4ae6-b35b-967c21e5b0a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:34.903738 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:24:34.923726 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 996/1990] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:24:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:24:34.933980 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083f935b-3069-45a0-bcb5-dc1735559417 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:34.935623 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-083f935b-3069-45a0-bcb5-dc1735559417 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:35.008728 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083f935b-3069-45a0-bcb5-dc1735559417 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:35.013520 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af502dd-bb39-46e8-a6b8-cc0431f69fab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:35.014262 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af502dd-bb39-46e8-a6b8-cc0431f69fab service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:35.014610 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af502dd-bb39-46e8-a6b8-cc0431f69fab service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:35.014956 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af502dd-bb39-46e8-a6b8-cc0431f69fab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:35.026009 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af502dd-bb39-46e8-a6b8-cc0431f69fab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:35.028041 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af502dd-bb39-46e8-a6b8-cc0431f69fab service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:35.042659 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 995/1991] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:24:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:24:35.362964 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fda3d4-8635-4ae6-b35b-967c21e5b0a2 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:35.364627 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-00fda3d4-8635-4ae6-b35b-967c21e5b0a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:35.377699 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fda3d4-8635-4ae6-b35b-967c21e5b0a2 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:35.383393 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b23cee-abd7-4e31-9f17-7201dcced728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:35.384265 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b23cee-abd7-4e31-9f17-7201dcced728 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:35.384749 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b23cee-abd7-4e31-9f17-7201dcced728 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:35.385096 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b23cee-abd7-4e31-9f17-7201dcced728 admin admin] PATH_INFO: `/v3/projects/65654972b687457eae297d5bc0d0d96e` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:35.387116 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b23cee-abd7-4e31-9f17-7201dcced728 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65654972b687457eae297d5bc0d0d96e)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:35.389201 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b23cee-abd7-4e31-9f17-7201dcced728 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:35.467214 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-d1b23cee-abd7-4e31-9f17-7201dcced728 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65654972b687457eae297d5bc0d0d96e', 'request_id': 'req-d1b23cee-abd7-4e31-9f17-7201dcced728'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:35.474363 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-d1b23cee-abd7-4e31-9f17-7201dcced728 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65654972b687457eae297d5bc0d0d96e', 'request_id': 'req-d1b23cee-abd7-4e31-9f17-7201dcced728'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:35.481386 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-d1b23cee-abd7-4e31-9f17-7201dcced728 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65654972b687457eae297d5bc0d0d96e', 'request_id': 'req-d1b23cee-abd7-4e31-9f17-7201dcced728'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:35.495870 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-d1b23cee-abd7-4e31-9f17-7201dcced728 admin admin] The token cache is being invalidate because project 65654972b687457eae297d5bc0d0d96e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:24:35.496161 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-d1b23cee-abd7-4e31-9f17-7201dcced728 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:35.496812 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-d1b23cee-abd7-4e31-9f17-7201dcced728 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:35.498347 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 997/1992] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:24:35 2022] DELETE /identity/v3/projects/65654972b687457eae297d5bc0d0d96e => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:24:35.502410 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af502dd-bb39-46e8-a6b8-cc0431f69fab service neutron] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:35.512655 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af502dd-bb39-46e8-a6b8-cc0431f69fab service neutron] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:35.530512 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:24:35.572129 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcfcb6c-2a48-49b0-b2b0-ea7f4fa73070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:35.572850 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcfcb6c-2a48-49b0-b2b0-ea7f4fa73070 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:35.573288 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcfcb6c-2a48-49b0-b2b0-ea7f4fa73070 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:35.573642 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcfcb6c-2a48-49b0-b2b0-ea7f4fa73070 admin admin] PATH_INFO: `/v3/users/6ee7cfea70d1476d9c9b10d416769d9b` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:35.574814 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcfcb6c-2a48-49b0-b2b0-ea7f4fa73070 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ee7cfea70d1476d9c9b10d416769d9b)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:35.576779 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcfcb6c-2a48-49b0-b2b0-ea7f4fa73070 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:35.628483 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-0fcfcb6c-2a48-49b0-b2b0-ea7f4fa73070 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ee7cfea70d1476d9c9b10d416769d9b'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:35.641253 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-0fcfcb6c-2a48-49b0-b2b0-ea7f4fa73070 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ee7cfea70d1476d9c9b10d416769d9b'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:35.648867 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-0fcfcb6c-2a48-49b0-b2b0-ea7f4fa73070 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ee7cfea70d1476d9c9b10d416769d9b'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:35.649492 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-0fcfcb6c-2a48-49b0-b2b0-ea7f4fa73070 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ee7cfea70d1476d9c9b10d416769d9b'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:35.657464 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-0fcfcb6c-2a48-49b0-b2b0-ea7f4fa73070 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ee7cfea70d1476d9c9b10d416769d9b'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:35.663587 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 996/1993] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:24:35 2022] DELETE /identity/v3/users/6ee7cfea70d1476d9c9b10d416769d9b => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 10:24:35.962004 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b23cee-abd7-4e31-9f17-7201dcced728 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:35.963973 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-d1b23cee-abd7-4e31-9f17-7201dcced728 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:35.985274 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b23cee-abd7-4e31-9f17-7201dcced728 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:36.049708 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2737160c-6c2a-4585-ae64-12bf472aac66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:36.050483 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2737160c-6c2a-4585-ae64-12bf472aac66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:36.050877 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2737160c-6c2a-4585-ae64-12bf472aac66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:36.051254 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2737160c-6c2a-4585-ae64-12bf472aac66 admin admin] PATH_INFO: `/v3/projects/8207f998533e44228cbd24743b24887e` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:36.052522 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2737160c-6c2a-4585-ae64-12bf472aac66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8207f998533e44228cbd24743b24887e)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:36.054595 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2737160c-6c2a-4585-ae64-12bf472aac66 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:36.113007 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-2737160c-6c2a-4585-ae64-12bf472aac66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8207f998533e44228cbd24743b24887e', 'request_id': 'req-2737160c-6c2a-4585-ae64-12bf472aac66'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:36.118701 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-2737160c-6c2a-4585-ae64-12bf472aac66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8207f998533e44228cbd24743b24887e', 'request_id': 'req-2737160c-6c2a-4585-ae64-12bf472aac66'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:36.127271 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-2737160c-6c2a-4585-ae64-12bf472aac66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8207f998533e44228cbd24743b24887e', 'request_id': 'req-2737160c-6c2a-4585-ae64-12bf472aac66'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:36.129813 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:24:36.141698 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-2737160c-6c2a-4585-ae64-12bf472aac66 admin admin] The token cache is being invalidate because project 8207f998533e44228cbd24743b24887e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:24:36.142014 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-2737160c-6c2a-4585-ae64-12bf472aac66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:36.142638 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-2737160c-6c2a-4585-ae64-12bf472aac66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:36.144121 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 998/1994] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:24:35 2022] DELETE /identity/v3/projects/8207f998533e44228cbd24743b24887e => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:24:36.148909 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c75e73a-a0ef-493f-89b5-c9d1616d5be1 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:36.149192 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c75e73a-a0ef-493f-89b5-c9d1616d5be1 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:36.149485 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c75e73a-a0ef-493f-89b5-c9d1616d5be1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:36.171728 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-8c75e73a-a0ef-493f-89b5-c9d1616d5be1 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:24:36.172888 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-8c75e73a-a0ef-493f-89b5-c9d1616d5be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:36.235301 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 997/1995] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:24:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 10:24:36.243099 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9cf91-3e0f-4c06-a9d8-75a49605c324 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:36.243393 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9cf91-3e0f-4c06-a9d8-75a49605c324 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:36.243751 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9cf91-3e0f-4c06-a9d8-75a49605c324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:36.265725 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-19d9cf91-3e0f-4c06-a9d8-75a49605c324 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:24:36.266995 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-19d9cf91-3e0f-4c06-a9d8-75a49605c324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:36.274698 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 999/1996] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:24:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:24:36.279275 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c75e73a-a0ef-493f-89b5-c9d1616d5be1 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:36.289939 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c75e73a-a0ef-493f-89b5-c9d1616d5be1 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:36.294871 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18df53ed-72ad-4037-9260-78cb8dcbe86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:36.295472 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df53ed-72ad-4037-9260-78cb8dcbe86e admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:36.295754 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df53ed-72ad-4037-9260-78cb8dcbe86e admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:36.296028 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df53ed-72ad-4037-9260-78cb8dcbe86e admin admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:36.296668 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18df53ed-72ad-4037-9260-78cb8dcbe86e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:24:36.296977 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18df53ed-72ad-4037-9260-78cb8dcbe86e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:36.298603 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18df53ed-72ad-4037-9260-78cb8dcbe86e admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:36.315364 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 998/1997] 10.222.0.36 () {58 vars in 1153 bytes} [Tue Aug 9 10:24:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:24:36.321451 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d9cf91-3e0f-4c06-a9d8-75a49605c324 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:36.336177 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d9cf91-3e0f-4c06-a9d8-75a49605c324 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:36.342117 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2781b4ce-c104-4cef-bf5d-77e959c4c45e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:36.342907 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781b4ce-c104-4cef-bf5d-77e959c4c45e admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:36.343188 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781b4ce-c104-4cef-bf5d-77e959c4c45e admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:36.343462 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781b4ce-c104-4cef-bf5d-77e959c4c45e admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:36.344109 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2781b4ce-c104-4cef-bf5d-77e959c4c45e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:36.346032 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2781b4ce-c104-4cef-bf5d-77e959c4c45e admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:36.380115 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1000/1998] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:24:36 2022] POST /identity/v3/projects => generated 385 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:24:36.384224 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18df53ed-72ad-4037-9260-78cb8dcbe86e admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:36.397898 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18df53ed-72ad-4037-9260-78cb8dcbe86e admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:36.431983 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:24:36.516102 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9222913-b554-4d5f-8a65-87666eea8d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:36.516878 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9222913-b554-4d5f-8a65-87666eea8d58 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:36.517265 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9222913-b554-4d5f-8a65-87666eea8d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:36.517644 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9222913-b554-4d5f-8a65-87666eea8d58 admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:36.518417 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9222913-b554-4d5f-8a65-87666eea8d58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:36.520500 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9222913-b554-4d5f-8a65-87666eea8d58 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:36.558565 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 999/1999] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:24:36 2022] POST /identity/v3/users => generated 293 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:24:36.562720 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2781b4ce-c104-4cef-bf5d-77e959c4c45e admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:36.574563 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2781b4ce-c104-4cef-bf5d-77e959c4c45e admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:36.579543 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c319a3c4-a95f-48ad-b649-c5a4b8bd8b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:36.580350 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c319a3c4-a95f-48ad-b649-c5a4b8bd8b4a admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:36.580633 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c319a3c4-a95f-48ad-b649-c5a4b8bd8b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:36.580948 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c319a3c4-a95f-48ad-b649-c5a4b8bd8b4a admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:36.583828 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c319a3c4-a95f-48ad-b649-c5a4b8bd8b4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:36.583828 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c319a3c4-a95f-48ad-b649-c5a4b8bd8b4a admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:36.619393 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1001/2000] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:24:36 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:24:36.623610 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9222913-b554-4d5f-8a65-87666eea8d58 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:36.636067 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9222913-b554-4d5f-8a65-87666eea8d58 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:36.642330 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403da3b8-3094-437c-8daf-09ca4b9c056f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:36.642943 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403da3b8-3094-437c-8daf-09ca4b9c056f admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:36.643222 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403da3b8-3094-437c-8daf-09ca4b9c056f admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:36.643625 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403da3b8-3094-437c-8daf-09ca4b9c056f admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:36.644279 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403da3b8-3094-437c-8daf-09ca4b9c056f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:36.645954 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403da3b8-3094-437c-8daf-09ca4b9c056f admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:36.661350 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1000/2001] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:24:36 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 10:24:36.665466 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c319a3c4-a95f-48ad-b649-c5a4b8bd8b4a admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:36.679157 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c319a3c4-a95f-48ad-b649-c5a4b8bd8b4a admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:36.686709 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6755963-161e-497b-a42d-4e5bc1500ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:36.687765 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6755963-161e-497b-a42d-4e5bc1500ee7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:36.688222 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6755963-161e-497b-a42d-4e5bc1500ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:36.689491 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6755963-161e-497b-a42d-4e5bc1500ee7 admin admin] PATH_INFO: `/v3/projects/ad5a2dbd759747779f3c5ba2ec3f2ca9/users/655792b45b634ddaad7287d5916d0a65/roles/a9895331e9694fa8b2b50908bb057bcb` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:36.709905 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6755963-161e-497b-a42d-4e5bc1500ee7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad5a2dbd759747779f3c5ba2ec3f2ca9, user_id=655792b45b634ddaad7287d5916d0a65, role_id=a9895331e9694fa8b2b50908bb057bcb)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:36.712787 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6755963-161e-497b-a42d-4e5bc1500ee7 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:36.745125 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1002/2002] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:24:36 2022] PUT /identity/v3/projects/ad5a2dbd759747779f3c5ba2ec3f2ca9/users/655792b45b634ddaad7287d5916d0a65/roles/a9895331e9694fa8b2b50908bb057bcb => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:24:36.746399 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3919a-5a49-4687-9d7a-5a80ca788004 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:36.746516 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3919a-5a49-4687-9d7a-5a80ca788004 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:36.746789 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3919a-5a49-4687-9d7a-5a80ca788004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:36.808064 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-6ce3919a-5a49-4687-9d7a-5a80ca788004 None None] MFA Rules not processed for user `655792b45b634ddaad7287d5916d0a65`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:24:36.809964 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-6ce3919a-5a49-4687-9d7a-5a80ca788004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:36.902268 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1001/2003] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:24:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:24:36.913812 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6755963-161e-497b-a42d-4e5bc1500ee7 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:36.917664 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-f6755963-161e-497b-a42d-4e5bc1500ee7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:37.004322 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6755963-161e-497b-a42d-4e5bc1500ee7 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:37.008294 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6556d005-06e5-48e1-a554-bce642f6f3a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6c687a38524de0bf23d87ae91d3b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:37.008898 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6556d005-06e5-48e1-a554-bce642f6f3a3 service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:37.009178 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6556d005-06e5-48e1-a554-bce642f6f3a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:37.009582 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6556d005-06e5-48e1-a554-bce642f6f3a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:37.022082 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6556d005-06e5-48e1-a554-bce642f6f3a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:37.024269 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6556d005-06e5-48e1-a554-bce642f6f3a3 service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:37.041923 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1003/2004] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:24:36 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:24:40.063958 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce3919a-5a49-4687-9d7a-5a80ca788004 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:40.076044 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce3919a-5a49-4687-9d7a-5a80ca788004 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:40.080263 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b6cc14-048b-4fc8-b8e1-eeea92544adc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6c687a38524de0bf23d87ae91d3b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:40.080879 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b6cc14-048b-4fc8-b8e1-eeea92544adc service cinder] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:40.081156 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b6cc14-048b-4fc8-b8e1-eeea92544adc service cinder] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:40.081428 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b6cc14-048b-4fc8-b8e1-eeea92544adc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:40.084650 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-e9b6cc14-048b-4fc8-b8e1-eeea92544adc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:40.161086 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b6cc14-048b-4fc8-b8e1-eeea92544adc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:40.162740 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b6cc14-048b-4fc8-b8e1-eeea92544adc service cinder] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:40.174488 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1002/2005] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:24:40 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:24:42.990334 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6556d005-06e5-48e1-a554-bce642f6f3a3 service cinder] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:43.055981 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6556d005-06e5-48e1-a554-bce642f6f3a3 service cinder] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:43.061716 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef6bbfc-40d0-4674-8769-b20c1b6dcbc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:43.062341 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef6bbfc-40d0-4674-8769-b20c1b6dcbc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:43.062616 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef6bbfc-40d0-4674-8769-b20c1b6dcbc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:43.062887 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef6bbfc-40d0-4674-8769-b20c1b6dcbc4 admin admin] PATH_INFO: `/v3/users/655792b45b634ddaad7287d5916d0a65` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:43.064001 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef6bbfc-40d0-4674-8769-b20c1b6dcbc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=655792b45b634ddaad7287d5916d0a65)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:43.065930 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef6bbfc-40d0-4674-8769-b20c1b6dcbc4 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:43.112634 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:24:43.124175 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-7ef6bbfc-40d0-4674-8769-b20c1b6dcbc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '655792b45b634ddaad7287d5916d0a65'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:43.129904 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d928ad6f-b1c1-4bb9-975b-4e48e01a546f None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:43.130939 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d928ad6f-b1c1-4bb9-975b-4e48e01a546f None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:43.131320 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d928ad6f-b1c1-4bb9-975b-4e48e01a546f None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:43.132984 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1003/2006] 10.222.0.36 () {54 vars in 921 bytes} [Tue Aug 9 10:24:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 10:24:43.142024 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-7ef6bbfc-40d0-4674-8769-b20c1b6dcbc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '655792b45b634ddaad7287d5916d0a65'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:43.150004 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-7ef6bbfc-40d0-4674-8769-b20c1b6dcbc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '655792b45b634ddaad7287d5916d0a65'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:43.151080 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-7ef6bbfc-40d0-4674-8769-b20c1b6dcbc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '655792b45b634ddaad7287d5916d0a65'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:43.161912 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-7ef6bbfc-40d0-4674-8769-b20c1b6dcbc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '655792b45b634ddaad7287d5916d0a65'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:43.171024 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1004/2007] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:24:42 2022] DELETE /identity/v3/users/655792b45b634ddaad7287d5916d0a65 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:24:43.171223 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a65af9-34c5-49b0-939e-57b4c379c086 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:43.171223 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a65af9-34c5-49b0-939e-57b4c379c086 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:43.171223 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a65af9-34c5-49b0-939e-57b4c379c086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:43.176795 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ee9fb-4fce-45d2-9954-216ef9c3aeb4 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:43.177067 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ee9fb-4fce-45d2-9954-216ef9c3aeb4 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:43.177337 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ee9fb-4fce-45d2-9954-216ef9c3aeb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:43.195192 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-59a65af9-34c5-49b0-939e-57b4c379c086 None None] MFA Rules not processed for user `c4d3b6a332394adf9e1b81ee9c171c48`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:24:43.196637 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-59a65af9-34c5-49b0-939e-57b4c379c086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:43.199050 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-129ee9fb-4fce-45d2-9954-216ef9c3aeb4 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:24:43.200263 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-129ee9fb-4fce-45d2-9954-216ef9c3aeb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:43.245423 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:24:43.299678 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1005/2008] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:24:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:24:43.303994 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129ee9fb-4fce-45d2-9954-216ef9c3aeb4 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:43.304816 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-129ee9fb-4fce-45d2-9954-216ef9c3aeb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:43.313942 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1004/2009] 10.222.0.36 () {58 vars in 1018 bytes} [Tue Aug 9 10:24:43 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 10:24:43.318428 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129ee9fb-4fce-45d2-9954-216ef9c3aeb4 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:43.322336 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a65af9-34c5-49b0-939e-57b4c379c086 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:43.324634 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-59a65af9-34c5-49b0-939e-57b4c379c086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:43.326689 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4931abeb-573e-49b1-b676-5e3efc00e0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:43.327421 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4931abeb-573e-49b1-b676-5e3efc00e0dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:43.327701 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4931abeb-573e-49b1-b676-5e3efc00e0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:43.327973 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4931abeb-573e-49b1-b676-5e3efc00e0dc admin admin] PATH_INFO: `/v3/users/e475e2e663794a3c83cfc9e82947a70f` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:43.329202 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4931abeb-573e-49b1-b676-5e3efc00e0dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=e475e2e663794a3c83cfc9e82947a70f)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:43.331407 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4931abeb-573e-49b1-b676-5e3efc00e0dc admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:43.341615 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a65af9-34c5-49b0-939e-57b4c379c086 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:43.352649 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25849850-a3bc-4270-9b4e-73cef5855e6c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4d3b6a332394adf9e1b81ee9c171c48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:43.353199 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25849850-a3bc-4270-9b4e-73cef5855e6c service placement] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:43.353484 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25849850-a3bc-4270-9b4e-73cef5855e6c service placement] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:43.353792 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25849850-a3bc-4270-9b4e-73cef5855e6c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:43.373941 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25849850-a3bc-4270-9b4e-73cef5855e6c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:43.375823 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25849850-a3bc-4270-9b4e-73cef5855e6c service placement] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:43.388923 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1005/2010] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:24:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 10:24:43.390158 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25849850-a3bc-4270-9b4e-73cef5855e6c service placement] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:43.391492 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-25849850-a3bc-4270-9b4e-73cef5855e6c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:43.401787 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-4931abeb-573e-49b1-b676-5e3efc00e0dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e475e2e663794a3c83cfc9e82947a70f'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:43.417433 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-4931abeb-573e-49b1-b676-5e3efc00e0dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e475e2e663794a3c83cfc9e82947a70f'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:43.428305 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-4931abeb-573e-49b1-b676-5e3efc00e0dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e475e2e663794a3c83cfc9e82947a70f'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:43.429307 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-4931abeb-573e-49b1-b676-5e3efc00e0dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e475e2e663794a3c83cfc9e82947a70f'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:43.443188 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-4931abeb-573e-49b1-b676-5e3efc00e0dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e475e2e663794a3c83cfc9e82947a70f'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:43.461457 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1006/2011] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:24:43 2022] DELETE /identity/v3/users/e475e2e663794a3c83cfc9e82947a70f => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:24:43.466753 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25849850-a3bc-4270-9b4e-73cef5855e6c service placement] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:43.555498 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2014235d-716c-4ba6-89e7-76c7c1943952 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:43.556175 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2014235d-716c-4ba6-89e7-76c7c1943952 service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:43.556551 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2014235d-716c-4ba6-89e7-76c7c1943952 service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:43.557566 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2014235d-716c-4ba6-89e7-76c7c1943952 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:43.560390 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-2014235d-716c-4ba6-89e7-76c7c1943952 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:43.637493 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2014235d-716c-4ba6-89e7-76c7c1943952 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:43.639212 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2014235d-716c-4ba6-89e7-76c7c1943952 service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:43.653764 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1006/2012] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:24:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:24:43.891236 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4931abeb-573e-49b1-b676-5e3efc00e0dc admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:43.896551 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-4931abeb-573e-49b1-b676-5e3efc00e0dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:43.926775 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4931abeb-573e-49b1-b676-5e3efc00e0dc admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:43.939993 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d852cfcd-d387-4b3f-a103-4ce9864901bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:43.940683 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852cfcd-d387-4b3f-a103-4ce9864901bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:43.940955 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852cfcd-d387-4b3f-a103-4ce9864901bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:43.941229 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852cfcd-d387-4b3f-a103-4ce9864901bc admin admin] PATH_INFO: `/v3/projects/a9a8731d3b324b3c9d054a82652a2f3b` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:43.945585 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d852cfcd-d387-4b3f-a103-4ce9864901bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9a8731d3b324b3c9d054a82652a2f3b)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:43.947525 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d852cfcd-d387-4b3f-a103-4ce9864901bc admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:43.984119 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:24:44.030104 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-d852cfcd-d387-4b3f-a103-4ce9864901bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9a8731d3b324b3c9d054a82652a2f3b', 'request_id': 'req-d852cfcd-d387-4b3f-a103-4ce9864901bc'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:44.037398 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-d852cfcd-d387-4b3f-a103-4ce9864901bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9a8731d3b324b3c9d054a82652a2f3b', 'request_id': 'req-d852cfcd-d387-4b3f-a103-4ce9864901bc'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:44.048517 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-d852cfcd-d387-4b3f-a103-4ce9864901bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9a8731d3b324b3c9d054a82652a2f3b', 'request_id': 'req-d852cfcd-d387-4b3f-a103-4ce9864901bc'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:44.085491 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-d852cfcd-d387-4b3f-a103-4ce9864901bc admin admin] The token cache is being invalidate because project a9a8731d3b324b3c9d054a82652a2f3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:24:44.085690 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-d852cfcd-d387-4b3f-a103-4ce9864901bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:44.086920 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-d852cfcd-d387-4b3f-a103-4ce9864901bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:44.088619 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1007/2013] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:24:43 2022] DELETE /identity/v3/projects/a9a8731d3b324b3c9d054a82652a2f3b => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:24:44.093124 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a9b034-ebc9-4aad-a616-c5f7f8249445 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:44.093418 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a9b034-ebc9-4aad-a616-c5f7f8249445 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:44.093694 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a9b034-ebc9-4aad-a616-c5f7f8249445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:44.114343 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-94a9b034-ebc9-4aad-a616-c5f7f8249445 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:24:44.115577 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-94a9b034-ebc9-4aad-a616-c5f7f8249445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:44.131058 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:24:44.198817 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1007/2014] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:24:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:24:44.200223 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d852cfcd-d387-4b3f-a103-4ce9864901bc admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:44.201822 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-d852cfcd-d387-4b3f-a103-4ce9864901bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:44.203278 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dbba89-014d-4dc5-9093-d01e0d265346 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:44.203698 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dbba89-014d-4dc5-9093-d01e0d265346 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:44.203992 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dbba89-014d-4dc5-9093-d01e0d265346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:44.219530 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d852cfcd-d387-4b3f-a103-4ce9864901bc admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:44.224642 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c68d30-9a23-40a3-b39a-2ef0d0d54efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:44.225337 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c68d30-9a23-40a3-b39a-2ef0d0d54efb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:44.225564 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c68d30-9a23-40a3-b39a-2ef0d0d54efb admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:44.225780 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c68d30-9a23-40a3-b39a-2ef0d0d54efb admin admin] PATH_INFO: `/v3/projects/ad5a2dbd759747779f3c5ba2ec3f2ca9` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:44.227647 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c68d30-9a23-40a3-b39a-2ef0d0d54efb admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad5a2dbd759747779f3c5ba2ec3f2ca9)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:44.230416 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c68d30-9a23-40a3-b39a-2ef0d0d54efb admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:44.234632 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-f6dbba89-014d-4dc5-9093-d01e0d265346 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:24:44.236070 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-f6dbba89-014d-4dc5-9093-d01e0d265346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:44.244258 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1008/2015] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:24:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 10:24:44.248390 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dbba89-014d-4dc5-9093-d01e0d265346 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:44.258443 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dbba89-014d-4dc5-9093-d01e0d265346 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:44.264662 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cdf984-53e7-43a9-ac6a-54d387530b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:44.265840 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cdf984-53e7-43a9-ac6a-54d387530b40 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:44.266308 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cdf984-53e7-43a9-ac6a-54d387530b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:44.266588 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cdf984-53e7-43a9-ac6a-54d387530b40 admin admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:44.267380 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cdf984-53e7-43a9-ac6a-54d387530b40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:24:44.267684 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cdf984-53e7-43a9-ac6a-54d387530b40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:44.269560 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cdf984-53e7-43a9-ac6a-54d387530b40 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:44.284760 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1009/2016] 10.222.0.36 () {58 vars in 1153 bytes} [Tue Aug 9 10:24:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:24:44.286549 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-93c68d30-9a23-40a3-b39a-2ef0d0d54efb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad5a2dbd759747779f3c5ba2ec3f2ca9', 'request_id': 'req-93c68d30-9a23-40a3-b39a-2ef0d0d54efb'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:44.288923 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cdf984-53e7-43a9-ac6a-54d387530b40 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:44.293735 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-93c68d30-9a23-40a3-b39a-2ef0d0d54efb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad5a2dbd759747779f3c5ba2ec3f2ca9', 'request_id': 'req-93c68d30-9a23-40a3-b39a-2ef0d0d54efb'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:44.299769 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cdf984-53e7-43a9-ac6a-54d387530b40 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:44.299962 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-93c68d30-9a23-40a3-b39a-2ef0d0d54efb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad5a2dbd759747779f3c5ba2ec3f2ca9', 'request_id': 'req-93c68d30-9a23-40a3-b39a-2ef0d0d54efb'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:44.313311 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-93c68d30-9a23-40a3-b39a-2ef0d0d54efb admin admin] The token cache is being invalidate because project ad5a2dbd759747779f3c5ba2ec3f2ca9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:24:44.313832 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-93c68d30-9a23-40a3-b39a-2ef0d0d54efb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:44.314488 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-93c68d30-9a23-40a3-b39a-2ef0d0d54efb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:44.315996 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1008/2017] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:24:44 2022] DELETE /identity/v3/projects/ad5a2dbd759747779f3c5ba2ec3f2ca9 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:24:44.321025 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbde41c-ca79-42fc-a67a-2acb089188a5 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:44.321593 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbde41c-ca79-42fc-a67a-2acb089188a5 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:44.321893 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbde41c-ca79-42fc-a67a-2acb089188a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:44.341387 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-ecbde41c-ca79-42fc-a67a-2acb089188a5 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:24:44.342585 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-ecbde41c-ca79-42fc-a67a-2acb089188a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:44.357708 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16b22ce-0d3d-417a-a36b-626a2209fe3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:44.358345 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b22ce-0d3d-417a-a36b-626a2209fe3f admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:44.358625 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b22ce-0d3d-417a-a36b-626a2209fe3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:44.358908 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b22ce-0d3d-417a-a36b-626a2209fe3f admin admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:44.359516 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16b22ce-0d3d-417a-a36b-626a2209fe3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:44.361388 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16b22ce-0d3d-417a-a36b-626a2209fe3f admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:44.390704 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1010/2018] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:24:44 2022] POST /identity/v3/projects => generated 365 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 10:24:44.394665 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16b22ce-0d3d-417a-a36b-626a2209fe3f admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:44.396590 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-f16b22ce-0d3d-417a-a36b-626a2209fe3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:44.406159 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1009/2019] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:24:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:24:44.415092 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef18113-a15d-452a-ab8f-2ba81d3fd275 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:44.415409 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef18113-a15d-452a-ab8f-2ba81d3fd275 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:44.415683 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef18113-a15d-452a-ab8f-2ba81d3fd275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:44.435731 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-5ef18113-a15d-452a-ab8f-2ba81d3fd275 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:24:44.436992 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-5ef18113-a15d-452a-ab8f-2ba81d3fd275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:44.462209 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16b22ce-0d3d-417a-a36b-626a2209fe3f admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:44.463890 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:24:44.467275 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a169d14a-b192-479f-a6a8-85e2ddb74719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:44.467884 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a169d14a-b192-479f-a6a8-85e2ddb74719 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:44.468163 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a169d14a-b192-479f-a6a8-85e2ddb74719 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:44.468436 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a169d14a-b192-479f-a6a8-85e2ddb74719 admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:44.469064 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a169d14a-b192-479f-a6a8-85e2ddb74719 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:44.471125 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a169d14a-b192-479f-a6a8-85e2ddb74719 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:44.493295 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1011/2020] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:24:44 2022] POST /identity/v3/users => generated 283 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:24:44.497968 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a169d14a-b192-479f-a6a8-85e2ddb74719 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:44.500935 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1010/2021] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:24:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 10:24:44.504969 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef18113-a15d-452a-ab8f-2ba81d3fd275 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:44.509083 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a169d14a-b192-479f-a6a8-85e2ddb74719 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:44.514022 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8311671f-d250-4591-9907-c9077a530825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:44.514628 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8311671f-d250-4591-9907-c9077a530825 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:44.514910 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8311671f-d250-4591-9907-c9077a530825 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:44.515181 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8311671f-d250-4591-9907-c9077a530825 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:44.515732 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef18113-a15d-452a-ab8f-2ba81d3fd275 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:44.515845 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8311671f-d250-4591-9907-c9077a530825 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:44.517418 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8311671f-d250-4591-9907-c9077a530825 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:44.521408 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d587afa-5667-4077-b428-172619e1d55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:44.522045 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d587afa-5667-4077-b428-172619e1d55d admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:44.522326 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d587afa-5667-4077-b428-172619e1d55d admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:44.522603 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d587afa-5667-4077-b428-172619e1d55d admin admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:44.523246 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d587afa-5667-4077-b428-172619e1d55d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:24:44.523973 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d587afa-5667-4077-b428-172619e1d55d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:44.526190 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d587afa-5667-4077-b428-172619e1d55d admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:44.532901 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1012/2022] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:24:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 10:24:44.533992 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8311671f-d250-4591-9907-c9077a530825 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:44.539542 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:24:44.542263 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1011/2023] 10.222.0.36 () {58 vars in 1153 bytes} [Tue Aug 9 10:24:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:24:44.545207 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d587afa-5667-4077-b428-172619e1d55d admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:44.547084 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8311671f-d250-4591-9907-c9077a530825 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:44.553029 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9defd83-9091-41f3-b164-67d53dfa875a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:44.553632 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9defd83-9091-41f3-b164-67d53dfa875a admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:44.553941 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9defd83-9091-41f3-b164-67d53dfa875a admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:44.554216 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9defd83-9091-41f3-b164-67d53dfa875a admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:44.554847 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9defd83-9091-41f3-b164-67d53dfa875a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:44.555994 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d587afa-5667-4077-b428-172619e1d55d admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:44.556426 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9defd83-9091-41f3-b164-67d53dfa875a admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:44.560794 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdea7d87-b3ba-4f83-8b20-9c3c3299d699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:44.561390 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea7d87-b3ba-4f83-8b20-9c3c3299d699 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:44.561668 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea7d87-b3ba-4f83-8b20-9c3c3299d699 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:44.561969 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea7d87-b3ba-4f83-8b20-9c3c3299d699 admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:44.562598 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdea7d87-b3ba-4f83-8b20-9c3c3299d699 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:44.564499 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdea7d87-b3ba-4f83-8b20-9c3c3299d699 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:44.567330 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1013/2024] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:24:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:24:44.571668 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9defd83-9091-41f3-b164-67d53dfa875a admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:44.582291 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9defd83-9091-41f3-b164-67d53dfa875a admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:44.587880 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ff5a1a-ab71-4c68-a024-9f883ada7225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:44.589203 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff5a1a-ab71-4c68-a024-9f883ada7225 admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:44.589699 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff5a1a-ab71-4c68-a024-9f883ada7225 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:44.590104 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff5a1a-ab71-4c68-a024-9f883ada7225 admin admin] PATH_INFO: `/v3/projects/878a79477bf748aeb8a96901b164d423/users/d539b4c676b94547ab1ba8dcd14f591c/roles/a9895331e9694fa8b2b50908bb057bcb` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:44.598595 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1012/2025] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:24:44 2022] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 10:24:44.602918 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdea7d87-b3ba-4f83-8b20-9c3c3299d699 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:44.611304 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ff5a1a-ab71-4c68-a024-9f883ada7225 admin admin] RBAC: Authorizing `identity:create_grant(project_id=878a79477bf748aeb8a96901b164d423, user_id=d539b4c676b94547ab1ba8dcd14f591c, role_id=a9895331e9694fa8b2b50908bb057bcb)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:44.615060 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ff5a1a-ab71-4c68-a024-9f883ada7225 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:44.631286 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1014/2026] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:24:44 2022] PUT /identity/v3/projects/878a79477bf748aeb8a96901b164d423/users/d539b4c676b94547ab1ba8dcd14f591c/roles/a9895331e9694fa8b2b50908bb057bcb => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 10:24:44.641780 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3240174-ee6a-4135-a3ea-bc3a2980982a None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:44.642090 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3240174-ee6a-4135-a3ea-bc3a2980982a None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:44.642359 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3240174-ee6a-4135-a3ea-bc3a2980982a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:44.671052 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-a3240174-ee6a-4135-a3ea-bc3a2980982a None None] MFA Rules not processed for user `d539b4c676b94547ab1ba8dcd14f591c`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:24:44.672227 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-a3240174-ee6a-4135-a3ea-bc3a2980982a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:44.678272 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdea7d87-b3ba-4f83-8b20-9c3c3299d699 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:44.738779 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b38799-4e42-4688-953d-616b090b37e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:44.739642 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b38799-4e42-4688-953d-616b090b37e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:44.739754 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1015/2027] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:24:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 10:24:44.739865 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b38799-4e42-4688-953d-616b090b37e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:44.739944 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b38799-4e42-4688-953d-616b090b37e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:44.740524 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b38799-4e42-4688-953d-616b090b37e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:44.742479 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b38799-4e42-4688-953d-616b090b37e8 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:44.752307 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3240174-ee6a-4135-a3ea-bc3a2980982a None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:44.755010 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-a3240174-ee6a-4135-a3ea-bc3a2980982a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:44.766539 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1013/2028] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:24:44 2022] POST /identity/v3/users => generated 288 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 10:24:44.770744 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b38799-4e42-4688-953d-616b090b37e8 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:44.781728 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b38799-4e42-4688-953d-616b090b37e8 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:44.786747 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8204f656-2871-4cf5-9266-4a68032ca94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:44.787370 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8204f656-2871-4cf5-9266-4a68032ca94c admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:44.787648 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8204f656-2871-4cf5-9266-4a68032ca94c admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:44.788302 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8204f656-2871-4cf5-9266-4a68032ca94c admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:44.788950 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8204f656-2871-4cf5-9266-4a68032ca94c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:44.791081 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8204f656-2871-4cf5-9266-4a68032ca94c admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:44.802813 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1014/2029] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:24:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 10:24:44.810956 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8204f656-2871-4cf5-9266-4a68032ca94c admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:44.825439 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8204f656-2871-4cf5-9266-4a68032ca94c admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:44.830436 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3240174-ee6a-4135-a3ea-bc3a2980982a None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:44.831767 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126a9767-4597-43c0-afcc-9f62d27b7853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:44.832527 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126a9767-4597-43c0-afcc-9f62d27b7853 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:44.832878 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126a9767-4597-43c0-afcc-9f62d27b7853 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:44.833427 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126a9767-4597-43c0-afcc-9f62d27b7853 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:44.834406 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126a9767-4597-43c0-afcc-9f62d27b7853 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:44.835486 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c676a56-fcc9-4989-b9a6-5cde853a5b0d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6c687a38524de0bf23d87ae91d3b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:44.836247 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126a9767-4597-43c0-afcc-9f62d27b7853 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:44.836771 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c676a56-fcc9-4989-b9a6-5cde853a5b0d service cinder] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:44.837185 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c676a56-fcc9-4989-b9a6-5cde853a5b0d service cinder] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:44.837584 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c676a56-fcc9-4989-b9a6-5cde853a5b0d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:44.851096 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1015/2030] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:24:44 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:24:44.852682 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c676a56-fcc9-4989-b9a6-5cde853a5b0d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:44.855784 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126a9767-4597-43c0-afcc-9f62d27b7853 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:44.855940 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c676a56-fcc9-4989-b9a6-5cde853a5b0d service cinder] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:44.875298 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1016/2031] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:24:44 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 10:24:44.878923 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126a9767-4597-43c0-afcc-9f62d27b7853 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:44.884332 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad37bdf8-c9c4-4bcf-97d2-bac0867019fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:44.885299 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad37bdf8-c9c4-4bcf-97d2-bac0867019fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:44.885578 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad37bdf8-c9c4-4bcf-97d2-bac0867019fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:44.885871 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad37bdf8-c9c4-4bcf-97d2-bac0867019fd admin admin] PATH_INFO: `/v3/projects/06eba2ff96294583880d4b03fd20498d/users/92d706299dad47c0a375ad04dd8d84cb/roles/a9895331e9694fa8b2b50908bb057bcb` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:44.896054 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:24:44.905638 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad37bdf8-c9c4-4bcf-97d2-bac0867019fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=06eba2ff96294583880d4b03fd20498d, user_id=92d706299dad47c0a375ad04dd8d84cb, role_id=a9895331e9694fa8b2b50908bb057bcb)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:44.908590 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad37bdf8-c9c4-4bcf-97d2-bac0867019fd admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:44.926163 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1016/2032] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:24:44 2022] PUT /identity/v3/projects/06eba2ff96294583880d4b03fd20498d/users/92d706299dad47c0a375ad04dd8d84cb/roles/a9895331e9694fa8b2b50908bb057bcb => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:24:44.937164 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f634f3-9333-418e-b92f-5cee2921f791 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:44.937689 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f634f3-9333-418e-b92f-5cee2921f791 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:44.937689 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f634f3-9333-418e-b92f-5cee2921f791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:44.973482 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-a6f634f3-9333-418e-b92f-5cee2921f791 None None] MFA Rules not processed for user `92d706299dad47c0a375ad04dd8d84cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:24:44.974895 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-a6f634f3-9333-418e-b92f-5cee2921f791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:45.030796 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:24:45.060855 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1017/2033] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:24:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:24:45.126980 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad37bdf8-c9c4-4bcf-97d2-bac0867019fd admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:45.134432 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-ad37bdf8-c9c4-4bcf-97d2-bac0867019fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:45.248632 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad37bdf8-c9c4-4bcf-97d2-bac0867019fd admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:45.252553 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae7b2df-b1a6-4497-a14c-31ed10a3350a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6c687a38524de0bf23d87ae91d3b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:45.253219 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae7b2df-b1a6-4497-a14c-31ed10a3350a service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:45.253535 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae7b2df-b1a6-4497-a14c-31ed10a3350a service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:45.253861 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae7b2df-b1a6-4497-a14c-31ed10a3350a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:45.265670 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae7b2df-b1a6-4497-a14c-31ed10a3350a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:45.267561 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae7b2df-b1a6-4497-a14c-31ed10a3350a service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:45.280678 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1017/2034] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:24:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:24:48.363047 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f634f3-9333-418e-b92f-5cee2921f791 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:48.426548 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f634f3-9333-418e-b92f-5cee2921f791 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:48.431115 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9d7028-112a-4d00-8d06-128189f0c99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:48.432333 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9d7028-112a-4d00-8d06-128189f0c99a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:48.432608 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9d7028-112a-4d00-8d06-128189f0c99a admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:48.432878 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9d7028-112a-4d00-8d06-128189f0c99a admin admin] PATH_INFO: `/v3/users/92d706299dad47c0a375ad04dd8d84cb` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:48.434076 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9d7028-112a-4d00-8d06-128189f0c99a admin admin] RBAC: Authorizing `identity:delete_user(user_id=92d706299dad47c0a375ad04dd8d84cb)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:48.436091 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9d7028-112a-4d00-8d06-128189f0c99a admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:48.483698 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-bc9d7028-112a-4d00-8d06-128189f0c99a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92d706299dad47c0a375ad04dd8d84cb'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:48.496158 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-bc9d7028-112a-4d00-8d06-128189f0c99a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92d706299dad47c0a375ad04dd8d84cb'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:48.503056 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-bc9d7028-112a-4d00-8d06-128189f0c99a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92d706299dad47c0a375ad04dd8d84cb'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:48.503739 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-bc9d7028-112a-4d00-8d06-128189f0c99a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92d706299dad47c0a375ad04dd8d84cb'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:48.511258 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-bc9d7028-112a-4d00-8d06-128189f0c99a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92d706299dad47c0a375ad04dd8d84cb'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:48.517015 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1018/2035] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:24:48 2022] DELETE /identity/v3/users/92d706299dad47c0a375ad04dd8d84cb => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:24:48.521469 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371655c-042f-42d1-a24b-867c35c875a9 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:48.521999 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371655c-042f-42d1-a24b-867c35c875a9 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:48.522095 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371655c-042f-42d1-a24b-867c35c875a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:48.540756 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-6371655c-042f-42d1-a24b-867c35c875a9 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:24:48.542580 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-6371655c-042f-42d1-a24b-867c35c875a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:48.601043 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1018/2036] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:24:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:24:48.611188 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9d7028-112a-4d00-8d06-128189f0c99a admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:48.612727 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-bc9d7028-112a-4d00-8d06-128189f0c99a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:48.671063 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9d7028-112a-4d00-8d06-128189f0c99a admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:48.675418 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a54712d-c069-4ab4-8b77-ec58a321e417 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:48.676021 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a54712d-c069-4ab4-8b77-ec58a321e417 service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:48.676300 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a54712d-c069-4ab4-8b77-ec58a321e417 service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:48.676571 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a54712d-c069-4ab4-8b77-ec58a321e417 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:48.686425 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a54712d-c069-4ab4-8b77-ec58a321e417 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:48.687846 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a54712d-c069-4ab4-8b77-ec58a321e417 service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:48.697460 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1019/2037] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:24:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:24:49.086884 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6371655c-042f-42d1-a24b-867c35c875a9 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:49.089092 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-6371655c-042f-42d1-a24b-867c35c875a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:49.104219 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6371655c-042f-42d1-a24b-867c35c875a9 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:49.110004 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e03b8-1b10-42ed-8ad8-dcbc219c191f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:49.110756 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e03b8-1b10-42ed-8ad8-dcbc219c191f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:49.110920 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e03b8-1b10-42ed-8ad8-dcbc219c191f admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:49.111636 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e03b8-1b10-42ed-8ad8-dcbc219c191f admin admin] PATH_INFO: `/v3/projects/06eba2ff96294583880d4b03fd20498d` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:49.112438 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06e03b8-1b10-42ed-8ad8-dcbc219c191f admin admin] RBAC: Authorizing `identity:delete_project(project_id=06eba2ff96294583880d4b03fd20498d)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:49.114392 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06e03b8-1b10-42ed-8ad8-dcbc219c191f admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:49.177840 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-e06e03b8-1b10-42ed-8ad8-dcbc219c191f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06eba2ff96294583880d4b03fd20498d', 'request_id': 'req-e06e03b8-1b10-42ed-8ad8-dcbc219c191f'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:49.183304 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-e06e03b8-1b10-42ed-8ad8-dcbc219c191f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06eba2ff96294583880d4b03fd20498d', 'request_id': 'req-e06e03b8-1b10-42ed-8ad8-dcbc219c191f'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:49.189479 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-e06e03b8-1b10-42ed-8ad8-dcbc219c191f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06eba2ff96294583880d4b03fd20498d', 'request_id': 'req-e06e03b8-1b10-42ed-8ad8-dcbc219c191f'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:49.204329 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-e06e03b8-1b10-42ed-8ad8-dcbc219c191f admin admin] The token cache is being invalidate because project 06eba2ff96294583880d4b03fd20498d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:24:49.204625 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-e06e03b8-1b10-42ed-8ad8-dcbc219c191f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:49.205241 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-e06e03b8-1b10-42ed-8ad8-dcbc219c191f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:49.206871 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1019/2038] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:24:49 2022] DELETE /identity/v3/projects/06eba2ff96294583880d4b03fd20498d => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:24:49.212448 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa0d65-7114-494f-9cd2-82805945a74c None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:49.213367 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa0d65-7114-494f-9cd2-82805945a74c None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:49.213766 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa0d65-7114-494f-9cd2-82805945a74c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:49.234674 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-f6aa0d65-7114-494f-9cd2-82805945a74c None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:24:49.235878 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-f6aa0d65-7114-494f-9cd2-82805945a74c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:49.241871 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:24:49.306894 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1020/2039] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:24:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:24:49.321817 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c4cb4-8160-4a0f-a3fa-ac933dbab1ac None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:49.322118 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c4cb4-8160-4a0f-a3fa-ac933dbab1ac None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:49.323035 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c4cb4-8160-4a0f-a3fa-ac933dbab1ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:49.344642 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-df1c4cb4-8160-4a0f-a3fa-ac933dbab1ac None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:24:49.345866 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-df1c4cb4-8160-4a0f-a3fa-ac933dbab1ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:49.353836 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1020/2040] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:24:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:24:49.358916 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aa0d65-7114-494f-9cd2-82805945a74c None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:49.376743 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aa0d65-7114-494f-9cd2-82805945a74c None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:49.382037 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e4a9af-28df-42cd-9950-3b397807bf27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:49.382633 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e4a9af-28df-42cd-9950-3b397807bf27 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:49.382908 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e4a9af-28df-42cd-9950-3b397807bf27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:49.383177 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e4a9af-28df-42cd-9950-3b397807bf27 admin admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:49.383820 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e4a9af-28df-42cd-9950-3b397807bf27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:24:49.384115 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e4a9af-28df-42cd-9950-3b397807bf27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:49.386390 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e4a9af-28df-42cd-9950-3b397807bf27 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:49.398577 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1021/2041] 10.222.0.36 () {58 vars in 1153 bytes} [Tue Aug 9 10:24:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:24:49.403584 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1c4cb4-8160-4a0f-a3fa-ac933dbab1ac None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:49.413118 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1c4cb4-8160-4a0f-a3fa-ac933dbab1ac None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:49.417778 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5acbd4c-457e-4ea4-8014-573075184265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:49.418410 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5acbd4c-457e-4ea4-8014-573075184265 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:49.418689 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5acbd4c-457e-4ea4-8014-573075184265 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:49.418960 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5acbd4c-457e-4ea4-8014-573075184265 admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:49.419581 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5acbd4c-457e-4ea4-8014-573075184265 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:49.421736 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5acbd4c-457e-4ea4-8014-573075184265 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:49.426293 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:24:49.455580 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1021/2042] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:24:49 2022] POST /identity/v3/projects => generated 369 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:24:49.456632 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e4a9af-28df-42cd-9950-3b397807bf27 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:49.468865 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e4a9af-28df-42cd-9950-3b397807bf27 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:49.534463 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58de51c1-a742-4ae0-adf4-dcb118690fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:49.535070 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58de51c1-a742-4ae0-adf4-dcb118690fcd admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:49.535352 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58de51c1-a742-4ae0-adf4-dcb118690fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:49.535623 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58de51c1-a742-4ae0-adf4-dcb118690fcd admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:49.536233 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58de51c1-a742-4ae0-adf4-dcb118690fcd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:49.538148 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58de51c1-a742-4ae0-adf4-dcb118690fcd admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:49.568918 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1022/2043] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:24:49 2022] POST /identity/v3/users => generated 285 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:24:49.570212 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5acbd4c-457e-4ea4-8014-573075184265 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:49.580793 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5acbd4c-457e-4ea4-8014-573075184265 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:49.585507 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650a75ed-247c-4eaf-bec4-77a5f39fc3f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:49.586138 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a75ed-247c-4eaf-bec4-77a5f39fc3f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:49.586422 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a75ed-247c-4eaf-bec4-77a5f39fc3f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:49.586693 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a75ed-247c-4eaf-bec4-77a5f39fc3f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:49.587338 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650a75ed-247c-4eaf-bec4-77a5f39fc3f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:49.589206 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650a75ed-247c-4eaf-bec4-77a5f39fc3f3 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:49.599083 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1022/2044] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:24:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:24:49.603238 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58de51c1-a742-4ae0-adf4-dcb118690fcd admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:49.613770 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58de51c1-a742-4ae0-adf4-dcb118690fcd admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:49.618367 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb882fd-0492-4529-948b-fa128346f952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:49.618960 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb882fd-0492-4529-948b-fa128346f952 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:49.620365 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb882fd-0492-4529-948b-fa128346f952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:49.620365 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb882fd-0492-4529-948b-fa128346f952 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:49.620933 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb882fd-0492-4529-948b-fa128346f952 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:49.622626 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb882fd-0492-4529-948b-fa128346f952 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:49.634161 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1023/2045] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:24:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:24:49.638500 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650a75ed-247c-4eaf-bec4-77a5f39fc3f3 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:49.649151 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650a75ed-247c-4eaf-bec4-77a5f39fc3f3 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:49.654126 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022982fa-2b64-48f9-b99a-7fddbe137652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:49.655039 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022982fa-2b64-48f9-b99a-7fddbe137652 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:49.655321 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022982fa-2b64-48f9-b99a-7fddbe137652 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:49.655597 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022982fa-2b64-48f9-b99a-7fddbe137652 admin admin] PATH_INFO: `/v3/projects/82a016a6907b47fab6968db4797183c5/users/25a53e70d6cb4a15a2f71719b82cca77/roles/a9895331e9694fa8b2b50908bb057bcb` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:49.672558 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022982fa-2b64-48f9-b99a-7fddbe137652 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82a016a6907b47fab6968db4797183c5, user_id=25a53e70d6cb4a15a2f71719b82cca77, role_id=a9895331e9694fa8b2b50908bb057bcb)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:49.675849 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022982fa-2b64-48f9-b99a-7fddbe137652 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:49.690542 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1023/2046] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:24:49 2022] PUT /identity/v3/projects/82a016a6907b47fab6968db4797183c5/users/25a53e70d6cb4a15a2f71719b82cca77/roles/a9895331e9694fa8b2b50908bb057bcb => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 10:24:49.701786 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f357c0a-8e63-4bc5-ae6b-63939448660f None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:49.702111 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f357c0a-8e63-4bc5-ae6b-63939448660f None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:49.702388 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f357c0a-8e63-4bc5-ae6b-63939448660f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:49.733275 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-5f357c0a-8e63-4bc5-ae6b-63939448660f None None] MFA Rules not processed for user `25a53e70d6cb4a15a2f71719b82cca77`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:24:49.734501 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-5f357c0a-8e63-4bc5-ae6b-63939448660f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:49.800881 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1024/2047] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:24:49 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 10:24:49.813353 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022982fa-2b64-48f9-b99a-7fddbe137652 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:49.815172 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-022982fa-2b64-48f9-b99a-7fddbe137652 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:49.909208 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022982fa-2b64-48f9-b99a-7fddbe137652 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:49.913097 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d71363-10f6-4ddc-b717-d9cba06f7bf1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07540b72afd34927855c41db09a7b030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:49.913704 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d71363-10f6-4ddc-b717-d9cba06f7bf1 service glance] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:49.914028 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d71363-10f6-4ddc-b717-d9cba06f7bf1 service glance] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:49.914295 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d71363-10f6-4ddc-b717-d9cba06f7bf1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:49.923894 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d71363-10f6-4ddc-b717-d9cba06f7bf1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:49.925308 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d71363-10f6-4ddc-b717-d9cba06f7bf1 service glance] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:49.935066 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1024/2048] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:24:49 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:24:53.940533 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f357c0a-8e63-4bc5-ae6b-63939448660f None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:53.942171 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-5f357c0a-8e63-4bc5-ae6b-63939448660f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:53.964402 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:24:54.024875 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f357c0a-8e63-4bc5-ae6b-63939448660f None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:54.030378 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecac2d6a-9cb0-4263-8b23-6bc9abd602b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:54.031034 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac2d6a-9cb0-4263-8b23-6bc9abd602b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:54.031312 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac2d6a-9cb0-4263-8b23-6bc9abd602b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:54.031582 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac2d6a-9cb0-4263-8b23-6bc9abd602b7 admin admin] PATH_INFO: `/v3/users/d539b4c676b94547ab1ba8dcd14f591c` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:54.032690 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecac2d6a-9cb0-4263-8b23-6bc9abd602b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d539b4c676b94547ab1ba8dcd14f591c)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:54.034628 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecac2d6a-9cb0-4263-8b23-6bc9abd602b7 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:54.082511 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-ecac2d6a-9cb0-4263-8b23-6bc9abd602b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd539b4c676b94547ab1ba8dcd14f591c'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:54.094072 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-ecac2d6a-9cb0-4263-8b23-6bc9abd602b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd539b4c676b94547ab1ba8dcd14f591c'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:54.100761 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-ecac2d6a-9cb0-4263-8b23-6bc9abd602b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd539b4c676b94547ab1ba8dcd14f591c'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:54.101424 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-ecac2d6a-9cb0-4263-8b23-6bc9abd602b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd539b4c676b94547ab1ba8dcd14f591c'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:54.109207 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-ecac2d6a-9cb0-4263-8b23-6bc9abd602b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd539b4c676b94547ab1ba8dcd14f591c'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:54.115256 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1025/2049] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:24:53 2022] DELETE /identity/v3/users/d539b4c676b94547ab1ba8dcd14f591c => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:24:54.120726 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eabfe3-f976-4c69-9146-67da946a1c7b None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:54.121233 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eabfe3-f976-4c69-9146-67da946a1c7b None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:54.121332 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eabfe3-f976-4c69-9146-67da946a1c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:54.140249 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-73eabfe3-f976-4c69-9146-67da946a1c7b None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:24:54.141425 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-73eabfe3-f976-4c69-9146-67da946a1c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:54.198891 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1025/2050] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:24:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:24:54.208509 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecac2d6a-9cb0-4263-8b23-6bc9abd602b7 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:54.209948 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-ecac2d6a-9cb0-4263-8b23-6bc9abd602b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:54.266567 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecac2d6a-9cb0-4263-8b23-6bc9abd602b7 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:54.270366 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f37073e-8729-4d89-ac3f-60b963b0f3ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:54.270967 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f37073e-8729-4d89-ac3f-60b963b0f3ca service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:54.271241 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f37073e-8729-4d89-ac3f-60b963b0f3ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:54.271506 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f37073e-8729-4d89-ac3f-60b963b0f3ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:54.281528 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f37073e-8729-4d89-ac3f-60b963b0f3ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:54.283009 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f37073e-8729-4d89-ac3f-60b963b0f3ca service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:54.302037 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1026/2051] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:24:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:24:54.596064 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eabfe3-f976-4c69-9146-67da946a1c7b None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:54.597508 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-73eabfe3-f976-4c69-9146-67da946a1c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:54.612304 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eabfe3-f976-4c69-9146-67da946a1c7b None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:54.618555 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668e8fd8-4297-4627-a67a-3b8ee0962791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:54.619563 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e8fd8-4297-4627-a67a-3b8ee0962791 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:54.624858 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e8fd8-4297-4627-a67a-3b8ee0962791 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:54.625156 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e8fd8-4297-4627-a67a-3b8ee0962791 admin admin] PATH_INFO: `/v3/projects/878a79477bf748aeb8a96901b164d423` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:54.626444 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668e8fd8-4297-4627-a67a-3b8ee0962791 admin admin] RBAC: Authorizing `identity:delete_project(project_id=878a79477bf748aeb8a96901b164d423)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:54.628473 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668e8fd8-4297-4627-a67a-3b8ee0962791 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:54.667888 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:24:54.686136 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-668e8fd8-4297-4627-a67a-3b8ee0962791 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '878a79477bf748aeb8a96901b164d423', 'request_id': 'req-668e8fd8-4297-4627-a67a-3b8ee0962791'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:54.691591 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-668e8fd8-4297-4627-a67a-3b8ee0962791 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '878a79477bf748aeb8a96901b164d423', 'request_id': 'req-668e8fd8-4297-4627-a67a-3b8ee0962791'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:54.698268 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-668e8fd8-4297-4627-a67a-3b8ee0962791 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '878a79477bf748aeb8a96901b164d423', 'request_id': 'req-668e8fd8-4297-4627-a67a-3b8ee0962791'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:54.713587 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-668e8fd8-4297-4627-a67a-3b8ee0962791 admin admin] The token cache is being invalidate because project 878a79477bf748aeb8a96901b164d423 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:24:54.713960 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-668e8fd8-4297-4627-a67a-3b8ee0962791 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:54.714612 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-668e8fd8-4297-4627-a67a-3b8ee0962791 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:54.716122 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1026/2052] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:24:54 2022] DELETE /identity/v3/projects/878a79477bf748aeb8a96901b164d423 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:24:54.721009 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e167176-d5eb-4fe5-8dfa-6ca58785cb50 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:54.721282 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e167176-d5eb-4fe5-8dfa-6ca58785cb50 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:54.721578 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e167176-d5eb-4fe5-8dfa-6ca58785cb50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:54.744514 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-3e167176-d5eb-4fe5-8dfa-6ca58785cb50 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:24:54.745758 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-3e167176-d5eb-4fe5-8dfa-6ca58785cb50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:54.774209 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:24:54.816569 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1027/2053] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:24:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 10:24:54.827756 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5fb033-b7ac-4016-984f-b75dcae98910 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:54.827930 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5fb033-b7ac-4016-984f-b75dcae98910 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:54.828499 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5fb033-b7ac-4016-984f-b75dcae98910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:54.849662 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-2a5fb033-b7ac-4016-984f-b75dcae98910 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:24:54.850969 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-2a5fb033-b7ac-4016-984f-b75dcae98910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:54.860749 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1027/2054] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:24:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:24:54.865701 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e167176-d5eb-4fe5-8dfa-6ca58785cb50 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:54.877349 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e167176-d5eb-4fe5-8dfa-6ca58785cb50 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:54.882059 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ccd143-5437-4b7d-b784-a8c3aa1cdc9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:54.882765 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ccd143-5437-4b7d-b784-a8c3aa1cdc9c admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:54.883038 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ccd143-5437-4b7d-b784-a8c3aa1cdc9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:54.883307 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ccd143-5437-4b7d-b784-a8c3aa1cdc9c admin admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:54.883947 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ccd143-5437-4b7d-b784-a8c3aa1cdc9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:24:54.884247 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ccd143-5437-4b7d-b784-a8c3aa1cdc9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:54.886004 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ccd143-5437-4b7d-b784-a8c3aa1cdc9c admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:54.898207 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1028/2055] 10.222.0.36 () {58 vars in 1153 bytes} [Tue Aug 9 10:24:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:24:54.903205 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5fb033-b7ac-4016-984f-b75dcae98910 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:54.913369 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5fb033-b7ac-4016-984f-b75dcae98910 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:54.919105 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f207807-b08f-4ecf-9d42-e05afbcb74bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:54.919779 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f207807-b08f-4ecf-9d42-e05afbcb74bb admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:54.920087 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f207807-b08f-4ecf-9d42-e05afbcb74bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:54.920386 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f207807-b08f-4ecf-9d42-e05afbcb74bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:54.921047 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f207807-b08f-4ecf-9d42-e05afbcb74bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:54.923150 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f207807-b08f-4ecf-9d42-e05afbcb74bb admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:54.953983 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1028/2056] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:24:54 2022] POST /identity/v3/projects => generated 369 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:24:54.958328 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ccd143-5437-4b7d-b784-a8c3aa1cdc9c admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:54.972409 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ccd143-5437-4b7d-b784-a8c3aa1cdc9c admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:55.031215 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fb88d5-cd62-41b3-a9e7-264c1d760fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:55.031959 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb88d5-cd62-41b3-a9e7-264c1d760fb3 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:55.032281 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb88d5-cd62-41b3-a9e7-264c1d760fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:55.032551 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb88d5-cd62-41b3-a9e7-264c1d760fb3 admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:55.033283 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fb88d5-cd62-41b3-a9e7-264c1d760fb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:55.035309 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fb88d5-cd62-41b3-a9e7-264c1d760fb3 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:55.055905 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1029/2057] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:24:54 2022] POST /identity/v3/users => generated 285 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 10:24:55.060932 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f207807-b08f-4ecf-9d42-e05afbcb74bb admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:55.071911 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f207807-b08f-4ecf-9d42-e05afbcb74bb admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:55.077271 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf9a7a9-bd3d-4663-9025-1f684b8b0dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:55.077929 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf9a7a9-bd3d-4663-9025-1f684b8b0dc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:55.078159 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf9a7a9-bd3d-4663-9025-1f684b8b0dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:55.078435 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf9a7a9-bd3d-4663-9025-1f684b8b0dc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:55.079073 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf9a7a9-bd3d-4663-9025-1f684b8b0dc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:55.080658 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf9a7a9-bd3d-4663-9025-1f684b8b0dc1 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:55.090794 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1029/2058] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:24:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:24:55.094672 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fb88d5-cd62-41b3-a9e7-264c1d760fb3 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:55.104809 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fb88d5-cd62-41b3-a9e7-264c1d760fb3 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:55.109416 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7888decc-b8e0-4e33-88fc-d7b339c97b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:55.110020 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7888decc-b8e0-4e33-88fc-d7b339c97b1d admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:55.110295 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7888decc-b8e0-4e33-88fc-d7b339c97b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:55.110561 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7888decc-b8e0-4e33-88fc-d7b339c97b1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:55.111217 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7888decc-b8e0-4e33-88fc-d7b339c97b1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:55.112824 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7888decc-b8e0-4e33-88fc-d7b339c97b1d admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:55.123323 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1030/2059] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:24:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:24:55.127582 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf9a7a9-bd3d-4663-9025-1f684b8b0dc1 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:55.137444 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf9a7a9-bd3d-4663-9025-1f684b8b0dc1 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:55.141973 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2a46b9-99fd-40d5-b333-c6056071495b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:55.142605 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a46b9-99fd-40d5-b333-c6056071495b admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:55.142879 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a46b9-99fd-40d5-b333-c6056071495b admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:55.143150 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a46b9-99fd-40d5-b333-c6056071495b admin admin] PATH_INFO: `/v3/projects/608dcf74969f4e49b2aeda78ba5df041/users/81c46a501b424b9f97cfe78875194807/roles/a9895331e9694fa8b2b50908bb057bcb` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:55.159567 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2a46b9-99fd-40d5-b333-c6056071495b admin admin] RBAC: Authorizing `identity:create_grant(project_id=608dcf74969f4e49b2aeda78ba5df041, user_id=81c46a501b424b9f97cfe78875194807, role_id=a9895331e9694fa8b2b50908bb057bcb)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:55.163112 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2a46b9-99fd-40d5-b333-c6056071495b admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:55.180887 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1030/2060] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:24:55 2022] PUT /identity/v3/projects/608dcf74969f4e49b2aeda78ba5df041/users/81c46a501b424b9f97cfe78875194807/roles/a9895331e9694fa8b2b50908bb057bcb => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 10:24:55.193835 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1952f2e3-6dc3-4797-b784-4aa0dc4efa12 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:55.194186 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1952f2e3-6dc3-4797-b784-4aa0dc4efa12 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:55.194497 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1952f2e3-6dc3-4797-b784-4aa0dc4efa12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:55.227012 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-1952f2e3-6dc3-4797-b784-4aa0dc4efa12 None None] MFA Rules not processed for user `81c46a501b424b9f97cfe78875194807`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:24:55.228179 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-1952f2e3-6dc3-4797-b784-4aa0dc4efa12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:55.293171 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1031/2061] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:24:55 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:24:55.297653 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2a46b9-99fd-40d5-b333-c6056071495b admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:55.359825 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2a46b9-99fd-40d5-b333-c6056071495b admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:55.364389 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3540442-944d-4ac4-a594-d2218b44fbd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:55.364983 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3540442-944d-4ac4-a594-d2218b44fbd9 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:55.365259 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3540442-944d-4ac4-a594-d2218b44fbd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:55.365530 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3540442-944d-4ac4-a594-d2218b44fbd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:55.366185 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3540442-944d-4ac4-a594-d2218b44fbd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:55.368057 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3540442-944d-4ac4-a594-d2218b44fbd9 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:55.393935 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1031/2062] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:24:55 2022] POST /identity/v3/projects => generated 367 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:24:55.397945 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1952f2e3-6dc3-4797-b784-4aa0dc4efa12 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:55.409283 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1952f2e3-6dc3-4797-b784-4aa0dc4efa12 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:55.431017 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:24:55.468726 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68f68e8-0579-4952-938c-6b9ef333ded7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:55.469325 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68f68e8-0579-4952-938c-6b9ef333ded7 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:55.469610 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68f68e8-0579-4952-938c-6b9ef333ded7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:55.469900 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68f68e8-0579-4952-938c-6b9ef333ded7 admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:55.472485 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68f68e8-0579-4952-938c-6b9ef333ded7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:55.472485 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68f68e8-0579-4952-938c-6b9ef333ded7 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:55.493318 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1032/2063] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:24:55 2022] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 10:24:55.497267 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3540442-944d-4ac4-a594-d2218b44fbd9 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:55.507379 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3540442-944d-4ac4-a594-d2218b44fbd9 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:55.512638 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c052dfe4-1482-4f48-972c-41fa6e573541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:55.513220 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c052dfe4-1482-4f48-972c-41fa6e573541 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:55.513497 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c052dfe4-1482-4f48-972c-41fa6e573541 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:55.513765 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c052dfe4-1482-4f48-972c-41fa6e573541 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:55.514428 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c052dfe4-1482-4f48-972c-41fa6e573541 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:55.516010 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c052dfe4-1482-4f48-972c-41fa6e573541 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:55.527050 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1032/2064] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:24:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:24:55.532176 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68f68e8-0579-4952-938c-6b9ef333ded7 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:55.545183 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68f68e8-0579-4952-938c-6b9ef333ded7 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:55.550778 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc7ce05-e3ea-4ec6-9f39-20e23e506a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:55.551452 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc7ce05-e3ea-4ec6-9f39-20e23e506a7e admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:55.551726 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc7ce05-e3ea-4ec6-9f39-20e23e506a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:55.551994 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc7ce05-e3ea-4ec6-9f39-20e23e506a7e admin admin] PATH_INFO: `/v3/projects/2471233f86ad4f8faf457ce70586e975/users/e34ca28f4e464159858abc34c025e03e/roles/89ca30cbbb634be8a96e9921aa56626b` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:55.567888 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc7ce05-e3ea-4ec6-9f39-20e23e506a7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2471233f86ad4f8faf457ce70586e975, user_id=e34ca28f4e464159858abc34c025e03e, role_id=89ca30cbbb634be8a96e9921aa56626b)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:55.570544 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc7ce05-e3ea-4ec6-9f39-20e23e506a7e admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:55.588622 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1033/2065] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:24:55 2022] PUT /identity/v3/projects/2471233f86ad4f8faf457ce70586e975/users/e34ca28f4e464159858abc34c025e03e/roles/89ca30cbbb634be8a96e9921aa56626b => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:24:55.600728 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c052dfe4-1482-4f48-972c-41fa6e573541 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:55.611946 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c052dfe4-1482-4f48-972c-41fa6e573541 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:55.636902 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:24:55.678408 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe14d70-cafa-4692-9932-38683a006338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:55.679014 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe14d70-cafa-4692-9932-38683a006338 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:55.679305 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe14d70-cafa-4692-9932-38683a006338 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:55.679563 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe14d70-cafa-4692-9932-38683a006338 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:55.680205 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe14d70-cafa-4692-9932-38683a006338 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:55.683102 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe14d70-cafa-4692-9932-38683a006338 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:55.694305 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1033/2066] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:24:55 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:24:55.698844 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc7ce05-e3ea-4ec6-9f39-20e23e506a7e admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:55.709124 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc7ce05-e3ea-4ec6-9f39-20e23e506a7e admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:55.715752 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21356086-8993-4b56-b0a3-e68ef7b2cd2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:55.716422 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21356086-8993-4b56-b0a3-e68ef7b2cd2e admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:55.716736 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21356086-8993-4b56-b0a3-e68ef7b2cd2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:55.716981 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21356086-8993-4b56-b0a3-e68ef7b2cd2e admin admin] PATH_INFO: `/v3/projects/2471233f86ad4f8faf457ce70586e975/users/e34ca28f4e464159858abc34c025e03e/roles/89ca30cbbb634be8a96e9921aa56626b` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:55.718997 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21356086-8993-4b56-b0a3-e68ef7b2cd2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2471233f86ad4f8faf457ce70586e975, user_id=e34ca28f4e464159858abc34c025e03e, role_id=89ca30cbbb634be8a96e9921aa56626b)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:55.721566 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21356086-8993-4b56-b0a3-e68ef7b2cd2e admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:55.732914 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1034/2067] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:24:55 2022] PUT /identity/v3/projects/2471233f86ad4f8faf457ce70586e975/users/e34ca28f4e464159858abc34c025e03e/roles/89ca30cbbb634be8a96e9921aa56626b => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:24:55.743640 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d832dec-d843-4450-b8d3-10578f27ad26 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:55.743897 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d832dec-d843-4450-b8d3-10578f27ad26 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:55.744570 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d832dec-d843-4450-b8d3-10578f27ad26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:55.774514 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-3d832dec-d843-4450-b8d3-10578f27ad26 None None] MFA Rules not processed for user `e34ca28f4e464159858abc34c025e03e`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:24:55.776952 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-3d832dec-d843-4450-b8d3-10578f27ad26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:55.896999 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1034/2068] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:24:55 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:24:55.910520 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21356086-8993-4b56-b0a3-e68ef7b2cd2e admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:55.912261 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-21356086-8993-4b56-b0a3-e68ef7b2cd2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:55.975852 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21356086-8993-4b56-b0a3-e68ef7b2cd2e admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:55.980139 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cff90c-22ce-4304-8c43-71a6a2122643 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6c687a38524de0bf23d87ae91d3b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:55.980733 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cff90c-22ce-4304-8c43-71a6a2122643 service cinder] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:55.981007 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cff90c-22ce-4304-8c43-71a6a2122643 service cinder] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:55.981275 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cff90c-22ce-4304-8c43-71a6a2122643 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:55.990087 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cff90c-22ce-4304-8c43-71a6a2122643 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:55.991496 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cff90c-22ce-4304-8c43-71a6a2122643 service cinder] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:56.002281 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1035/2069] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:24:55 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 10:24:57.459213 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d832dec-d843-4450-b8d3-10578f27ad26 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:57.525328 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d832dec-d843-4450-b8d3-10578f27ad26 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:57.530219 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c14f80-3433-42b3-9f16-471ce4aec7a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:57.530835 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c14f80-3433-42b3-9f16-471ce4aec7a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:57.531130 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c14f80-3433-42b3-9f16-471ce4aec7a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:57.531409 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c14f80-3433-42b3-9f16-471ce4aec7a4 admin admin] PATH_INFO: `/v3/users/81c46a501b424b9f97cfe78875194807` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:57.532564 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c14f80-3433-42b3-9f16-471ce4aec7a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81c46a501b424b9f97cfe78875194807)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:57.534508 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c14f80-3433-42b3-9f16-471ce4aec7a4 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:57.594637 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a4c14f80-3433-42b3-9f16-471ce4aec7a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81c46a501b424b9f97cfe78875194807'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:57.596580 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:24:57.611701 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a4c14f80-3433-42b3-9f16-471ce4aec7a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81c46a501b424b9f97cfe78875194807'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:57.620422 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a4c14f80-3433-42b3-9f16-471ce4aec7a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81c46a501b424b9f97cfe78875194807'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:57.621150 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a4c14f80-3433-42b3-9f16-471ce4aec7a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81c46a501b424b9f97cfe78875194807'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:57.628590 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a4c14f80-3433-42b3-9f16-471ce4aec7a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81c46a501b424b9f97cfe78875194807'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:57.634434 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1035/2070] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:24:57 2022] DELETE /identity/v3/users/81c46a501b424b9f97cfe78875194807 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:24:57.639641 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c695d342-27f6-4b60-9f5b-ac578e945966 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:57.640139 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c695d342-27f6-4b60-9f5b-ac578e945966 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:57.640268 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c695d342-27f6-4b60-9f5b-ac578e945966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:57.658850 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-c695d342-27f6-4b60-9f5b-ac578e945966 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:24:57.660034 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-c695d342-27f6-4b60-9f5b-ac578e945966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:57.723048 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1036/2071] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:24:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:24:57.733316 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c14f80-3433-42b3-9f16-471ce4aec7a4 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:57.734760 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-a4c14f80-3433-42b3-9f16-471ce4aec7a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:57.793447 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c14f80-3433-42b3-9f16-471ce4aec7a4 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:57.797395 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd95f7b-3b55-441c-a06c-348906f03790 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:57.798038 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd95f7b-3b55-441c-a06c-348906f03790 service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:57.798317 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd95f7b-3b55-441c-a06c-348906f03790 service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:57.798588 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd95f7b-3b55-441c-a06c-348906f03790 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:57.808599 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd95f7b-3b55-441c-a06c-348906f03790 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:57.810481 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd95f7b-3b55-441c-a06c-348906f03790 service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:57.821051 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1036/2072] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:24:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:24:58.108055 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c695d342-27f6-4b60-9f5b-ac578e945966 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:58.109112 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-c695d342-27f6-4b60-9f5b-ac578e945966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:58.121952 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c695d342-27f6-4b60-9f5b-ac578e945966 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:58.126825 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e691d681-4f5d-4974-ab83-1ec81b3788e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:58.127572 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e691d681-4f5d-4974-ab83-1ec81b3788e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:58.127891 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e691d681-4f5d-4974-ab83-1ec81b3788e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:58.128169 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e691d681-4f5d-4974-ab83-1ec81b3788e9 admin admin] PATH_INFO: `/v3/projects/608dcf74969f4e49b2aeda78ba5df041` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:58.129408 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e691d681-4f5d-4974-ab83-1ec81b3788e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=608dcf74969f4e49b2aeda78ba5df041)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:58.131572 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e691d681-4f5d-4974-ab83-1ec81b3788e9 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:58.149292 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:24:58.182247 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-e691d681-4f5d-4974-ab83-1ec81b3788e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '608dcf74969f4e49b2aeda78ba5df041', 'request_id': 'req-e691d681-4f5d-4974-ab83-1ec81b3788e9'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:58.189315 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-e691d681-4f5d-4974-ab83-1ec81b3788e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '608dcf74969f4e49b2aeda78ba5df041', 'request_id': 'req-e691d681-4f5d-4974-ab83-1ec81b3788e9'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:58.196653 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-e691d681-4f5d-4974-ab83-1ec81b3788e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '608dcf74969f4e49b2aeda78ba5df041', 'request_id': 'req-e691d681-4f5d-4974-ab83-1ec81b3788e9'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:58.212918 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-e691d681-4f5d-4974-ab83-1ec81b3788e9 admin admin] The token cache is being invalidate because project 608dcf74969f4e49b2aeda78ba5df041 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80105) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:24:58.213241 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-e691d681-4f5d-4974-ab83-1ec81b3788e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:58.214000 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-e691d681-4f5d-4974-ab83-1ec81b3788e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:58.215489 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1037/2073] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:24:58 2022] DELETE /identity/v3/projects/608dcf74969f4e49b2aeda78ba5df041 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:24:58.220315 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd95f7b-3b55-441c-a06c-348906f03790 service neutron] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:58.230126 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd95f7b-3b55-441c-a06c-348906f03790 service neutron] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:58.285289 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da633a9-bceb-4e34-b2c9-27a5061ade08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:58.285938 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da633a9-bceb-4e34-b2c9-27a5061ade08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:58.286222 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da633a9-bceb-4e34-b2c9-27a5061ade08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:58.286497 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da633a9-bceb-4e34-b2c9-27a5061ade08 admin admin] PATH_INFO: `/v3/users/e34ca28f4e464159858abc34c025e03e` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:58.287614 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da633a9-bceb-4e34-b2c9-27a5061ade08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e34ca28f4e464159858abc34c025e03e)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:58.289559 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da633a9-bceb-4e34-b2c9-27a5061ade08 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:58.337226 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-9da633a9-bceb-4e34-b2c9-27a5061ade08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e34ca28f4e464159858abc34c025e03e'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:58.349922 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-9da633a9-bceb-4e34-b2c9-27a5061ade08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e34ca28f4e464159858abc34c025e03e'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:58.355639 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:24:58.357458 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-9da633a9-bceb-4e34-b2c9-27a5061ade08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e34ca28f4e464159858abc34c025e03e'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:58.358165 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-9da633a9-bceb-4e34-b2c9-27a5061ade08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e34ca28f4e464159858abc34c025e03e'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:58.370205 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-9da633a9-bceb-4e34-b2c9-27a5061ade08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e34ca28f4e464159858abc34c025e03e'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:58.377288 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1037/2074] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:24:58 2022] DELETE /identity/v3/users/e34ca28f4e464159858abc34c025e03e => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:24:58.663903 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e691d681-4f5d-4974-ab83-1ec81b3788e9 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:58.666200 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-e691d681-4f5d-4974-ab83-1ec81b3788e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:58.682615 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e691d681-4f5d-4974-ab83-1ec81b3788e9 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:58.750147 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d2da30-1e58-4cd1-b47d-14e61de2de26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:58.750797 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d2da30-1e58-4cd1-b47d-14e61de2de26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:58.751071 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d2da30-1e58-4cd1-b47d-14e61de2de26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:58.751349 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d2da30-1e58-4cd1-b47d-14e61de2de26 admin admin] PATH_INFO: `/v3/projects/2471233f86ad4f8faf457ce70586e975` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:58.752433 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d2da30-1e58-4cd1-b47d-14e61de2de26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2471233f86ad4f8faf457ce70586e975)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:58.754355 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d2da30-1e58-4cd1-b47d-14e61de2de26 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:58.804435 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-04d2da30-1e58-4cd1-b47d-14e61de2de26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2471233f86ad4f8faf457ce70586e975', 'request_id': 'req-04d2da30-1e58-4cd1-b47d-14e61de2de26'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:58.810772 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-04d2da30-1e58-4cd1-b47d-14e61de2de26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2471233f86ad4f8faf457ce70586e975', 'request_id': 'req-04d2da30-1e58-4cd1-b47d-14e61de2de26'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:58.817712 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-04d2da30-1e58-4cd1-b47d-14e61de2de26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2471233f86ad4f8faf457ce70586e975', 'request_id': 'req-04d2da30-1e58-4cd1-b47d-14e61de2de26'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:58.835182 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-04d2da30-1e58-4cd1-b47d-14e61de2de26 admin admin] The token cache is being invalidate because project 2471233f86ad4f8faf457ce70586e975 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80105) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:24:58.835803 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-04d2da30-1e58-4cd1-b47d-14e61de2de26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:58.837053 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-04d2da30-1e58-4cd1-b47d-14e61de2de26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:24:58.839881 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1038/2075] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:24:58 2022] DELETE /identity/v3/projects/2471233f86ad4f8faf457ce70586e975 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:24:58.846303 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207ec403-5474-4e60-9dbe-2a7e6e785454 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:58.846858 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207ec403-5474-4e60-9dbe-2a7e6e785454 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:58.846858 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207ec403-5474-4e60-9dbe-2a7e6e785454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:58.869248 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-207ec403-5474-4e60-9dbe-2a7e6e785454 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:24:58.870389 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-207ec403-5474-4e60-9dbe-2a7e6e785454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:58.929052 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1038/2076] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:24:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:24:58.937882 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f3ca5d-0342-4fea-8470-5f76cea0dfd4 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:58.938173 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f3ca5d-0342-4fea-8470-5f76cea0dfd4 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:58.938453 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f3ca5d-0342-4fea-8470-5f76cea0dfd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:58.963957 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-d9f3ca5d-0342-4fea-8470-5f76cea0dfd4 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:24:58.965367 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-d9f3ca5d-0342-4fea-8470-5f76cea0dfd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:58.974096 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1039/2077] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:24:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:24:58.978836 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207ec403-5474-4e60-9dbe-2a7e6e785454 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:58.988602 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207ec403-5474-4e60-9dbe-2a7e6e785454 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:58.993313 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055b7cfc-ed23-418b-ac29-5bcaa933936c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:58.994235 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b7cfc-ed23-418b-ac29-5bcaa933936c admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:58.994516 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b7cfc-ed23-418b-ac29-5bcaa933936c admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:58.994790 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b7cfc-ed23-418b-ac29-5bcaa933936c admin admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:58.995499 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055b7cfc-ed23-418b-ac29-5bcaa933936c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:24:58.995799 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055b7cfc-ed23-418b-ac29-5bcaa933936c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:58.997403 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055b7cfc-ed23-418b-ac29-5bcaa933936c admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:59.009382 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1039/2078] 10.222.0.36 () {58 vars in 1153 bytes} [Tue Aug 9 10:24:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:24:59.014261 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f3ca5d-0342-4fea-8470-5f76cea0dfd4 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:59.025776 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f3ca5d-0342-4fea-8470-5f76cea0dfd4 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:59.031328 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c444a3-dbf5-40fa-96e6-6a369228a637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:59.031934 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c444a3-dbf5-40fa-96e6-6a369228a637 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:59.032205 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c444a3-dbf5-40fa-96e6-6a369228a637 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:59.032470 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c444a3-dbf5-40fa-96e6-6a369228a637 admin admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:59.033107 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c444a3-dbf5-40fa-96e6-6a369228a637 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:59.035046 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c444a3-dbf5-40fa-96e6-6a369228a637 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:59.069036 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1040/2079] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:24:59 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:24:59.070425 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055b7cfc-ed23-418b-ac29-5bcaa933936c admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:59.081248 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055b7cfc-ed23-418b-ac29-5bcaa933936c admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:59.138292 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197547cc-7d01-4e23-8a34-ccf2450947fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:59.138927 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197547cc-7d01-4e23-8a34-ccf2450947fc admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:59.139204 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197547cc-7d01-4e23-8a34-ccf2450947fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:59.139475 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197547cc-7d01-4e23-8a34-ccf2450947fc admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:59.140088 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197547cc-7d01-4e23-8a34-ccf2450947fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:59.142106 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197547cc-7d01-4e23-8a34-ccf2450947fc admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:59.162953 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1040/2080] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:24:59 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:24:59.168151 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c444a3-dbf5-40fa-96e6-6a369228a637 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:59.174714 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:24:59.178790 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c444a3-dbf5-40fa-96e6-6a369228a637 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:59.185730 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ad08e6-1ddc-4ad4-9f70-34dc4c65dd19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:59.186583 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad08e6-1ddc-4ad4-9f70-34dc4c65dd19 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:59.187023 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad08e6-1ddc-4ad4-9f70-34dc4c65dd19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:59.187310 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad08e6-1ddc-4ad4-9f70-34dc4c65dd19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:59.188149 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ad08e6-1ddc-4ad4-9f70-34dc4c65dd19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:59.189770 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ad08e6-1ddc-4ad4-9f70-34dc4c65dd19 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:59.199721 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1041/2081] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:24:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:24:59.203549 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197547cc-7d01-4e23-8a34-ccf2450947fc admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:59.214118 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197547cc-7d01-4e23-8a34-ccf2450947fc admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:59.219015 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9745356-8e0d-4f86-b6b8-1389b493b6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:59.219631 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9745356-8e0d-4f86-b6b8-1389b493b6b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:59.219907 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9745356-8e0d-4f86-b6b8-1389b493b6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:59.220177 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9745356-8e0d-4f86-b6b8-1389b493b6b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:59.220809 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9745356-8e0d-4f86-b6b8-1389b493b6b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:59.222472 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9745356-8e0d-4f86-b6b8-1389b493b6b2 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:59.233303 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1041/2082] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:24:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:24:59.237504 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ad08e6-1ddc-4ad4-9f70-34dc4c65dd19 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:59.248028 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ad08e6-1ddc-4ad4-9f70-34dc4c65dd19 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:59.252659 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a8c796-06df-4b79-935d-fd1ebfd19341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:59.253298 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a8c796-06df-4b79-935d-fd1ebfd19341 admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:59.253576 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a8c796-06df-4b79-935d-fd1ebfd19341 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:59.253870 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a8c796-06df-4b79-935d-fd1ebfd19341 admin admin] PATH_INFO: `/v3/projects/4067a0c0997f4f84838b20683aadcb97/users/062bddac56df488796ddba988c974c1a/roles/a9895331e9694fa8b2b50908bb057bcb` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:59.268404 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a8c796-06df-4b79-935d-fd1ebfd19341 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4067a0c0997f4f84838b20683aadcb97, user_id=062bddac56df488796ddba988c974c1a, role_id=a9895331e9694fa8b2b50908bb057bcb)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:59.271082 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a8c796-06df-4b79-935d-fd1ebfd19341 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:59.284064 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1042/2083] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:24:59 2022] PUT /identity/v3/projects/4067a0c0997f4f84838b20683aadcb97/users/062bddac56df488796ddba988c974c1a/roles/a9895331e9694fa8b2b50908bb057bcb => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 10:24:59.295213 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3073a22-aaac-4ce0-a6ab-cdce48568cb7 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:59.295499 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3073a22-aaac-4ce0-a6ab-cdce48568cb7 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:59.295772 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3073a22-aaac-4ce0-a6ab-cdce48568cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:59.324105 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-f3073a22-aaac-4ce0-a6ab-cdce48568cb7 None None] MFA Rules not processed for user `062bddac56df488796ddba988c974c1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:24:59.325317 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-f3073a22-aaac-4ce0-a6ab-cdce48568cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:59.373120 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:24:59.399153 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1042/2084] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:24:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:24:59.403679 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a8c796-06df-4b79-935d-fd1ebfd19341 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:59.469597 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a8c796-06df-4b79-935d-fd1ebfd19341 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:59.474283 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f033d1c-91a7-4f36-87e2-f8610bc59882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:59.474904 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f033d1c-91a7-4f36-87e2-f8610bc59882 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:59.475184 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f033d1c-91a7-4f36-87e2-f8610bc59882 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:59.475478 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f033d1c-91a7-4f36-87e2-f8610bc59882 admin admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:59.476094 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f033d1c-91a7-4f36-87e2-f8610bc59882 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:59.479273 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f033d1c-91a7-4f36-87e2-f8610bc59882 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:59.504636 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1043/2085] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:24:59 2022] POST /identity/v3/projects => generated 387 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:24:59.508806 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3073a22-aaac-4ce0-a6ab-cdce48568cb7 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:59.519706 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3073a22-aaac-4ce0-a6ab-cdce48568cb7 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:59.576087 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4def3a6-e448-4996-b4d7-ed9c16f9628b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:59.576684 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4def3a6-e448-4996-b4d7-ed9c16f9628b admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:59.576964 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4def3a6-e448-4996-b4d7-ed9c16f9628b admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:59.577233 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4def3a6-e448-4996-b4d7-ed9c16f9628b admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:59.577878 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4def3a6-e448-4996-b4d7-ed9c16f9628b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:59.579776 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4def3a6-e448-4996-b4d7-ed9c16f9628b admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:59.601219 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1043/2086] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:24:59 2022] POST /identity/v3/users => generated 300 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:24:59.605747 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f033d1c-91a7-4f36-87e2-f8610bc59882 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:59.617403 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f033d1c-91a7-4f36-87e2-f8610bc59882 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:59.622634 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17519d1c-d8bb-4e9c-8830-84531e6b7a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:59.623228 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17519d1c-d8bb-4e9c-8830-84531e6b7a8c admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:59.623578 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17519d1c-d8bb-4e9c-8830-84531e6b7a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:59.623845 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17519d1c-d8bb-4e9c-8830-84531e6b7a8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:59.624477 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17519d1c-d8bb-4e9c-8830-84531e6b7a8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:59.626125 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17519d1c-d8bb-4e9c-8830-84531e6b7a8c admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:59.638029 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1044/2087] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:24:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 10:24:59.642480 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4def3a6-e448-4996-b4d7-ed9c16f9628b admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:59.653270 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4def3a6-e448-4996-b4d7-ed9c16f9628b admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:59.658363 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a46367e-ad06-46cd-9f2b-5ac82be803ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:59.659029 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a46367e-ad06-46cd-9f2b-5ac82be803ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:59.659311 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a46367e-ad06-46cd-9f2b-5ac82be803ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:59.659596 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a46367e-ad06-46cd-9f2b-5ac82be803ba admin admin] PATH_INFO: `/v3/projects/23ce4fc849044b6fa78c341832446b93/users/4bace6f510bf4c92ae0c45aa5a6affc6/roles/89ca30cbbb634be8a96e9921aa56626b` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:59.680555 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a46367e-ad06-46cd-9f2b-5ac82be803ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=23ce4fc849044b6fa78c341832446b93, user_id=4bace6f510bf4c92ae0c45aa5a6affc6, role_id=89ca30cbbb634be8a96e9921aa56626b)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:59.683504 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a46367e-ad06-46cd-9f2b-5ac82be803ba admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:59.697083 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1044/2088] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:24:59 2022] PUT /identity/v3/projects/23ce4fc849044b6fa78c341832446b93/users/4bace6f510bf4c92ae0c45aa5a6affc6/roles/89ca30cbbb634be8a96e9921aa56626b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:24:59.701129 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17519d1c-d8bb-4e9c-8830-84531e6b7a8c admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:59.716593 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17519d1c-d8bb-4e9c-8830-84531e6b7a8c admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:59.778917 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf5e594-c508-4802-af51-26d726ddaff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:59.779881 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf5e594-c508-4802-af51-26d726ddaff5 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:59.780157 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf5e594-c508-4802-af51-26d726ddaff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:59.780469 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf5e594-c508-4802-af51-26d726ddaff5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:59.781148 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf5e594-c508-4802-af51-26d726ddaff5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:59.782833 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf5e594-c508-4802-af51-26d726ddaff5 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:59.793051 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1045/2089] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:24:59 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 10:24:59.797295 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a46367e-ad06-46cd-9f2b-5ac82be803ba admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:59.808069 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a46367e-ad06-46cd-9f2b-5ac82be803ba admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:24:59.812829 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b1c02b-241a-445e-a77d-033104883d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:24:59.813507 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b1c02b-241a-445e-a77d-033104883d64 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:59.813795 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b1c02b-241a-445e-a77d-033104883d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:59.814100 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b1c02b-241a-445e-a77d-033104883d64 admin admin] PATH_INFO: `/v3/projects/23ce4fc849044b6fa78c341832446b93/users/4bace6f510bf4c92ae0c45aa5a6affc6/roles/89ca30cbbb634be8a96e9921aa56626b` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:59.815991 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b1c02b-241a-445e-a77d-033104883d64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23ce4fc849044b6fa78c341832446b93, user_id=4bace6f510bf4c92ae0c45aa5a6affc6, role_id=89ca30cbbb634be8a96e9921aa56626b)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:24:59.818669 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b1c02b-241a-445e-a77d-033104883d64 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:24:59.833547 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1045/2090] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:24:59 2022] PUT /identity/v3/projects/23ce4fc849044b6fa78c341832446b93/users/4bace6f510bf4c92ae0c45aa5a6affc6/roles/89ca30cbbb634be8a96e9921aa56626b => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 10:24:59.847152 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9d8762-4f94-4840-9b07-7f85927c15b9 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:24:59.847633 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9d8762-4f94-4840-9b07-7f85927c15b9 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:24:59.847911 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9d8762-4f94-4840-9b07-7f85927c15b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:24:59.878369 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-8e9d8762-4f94-4840-9b07-7f85927c15b9 None None] MFA Rules not processed for user `4bace6f510bf4c92ae0c45aa5a6affc6`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:24:59.879804 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-8e9d8762-4f94-4840-9b07-7f85927c15b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:24:59.911048 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:24:59.965374 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1046/2091] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:24:59 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:24:59.976558 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b1c02b-241a-445e-a77d-033104883d64 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:24:59.978541 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-40b1c02b-241a-445e-a77d-033104883d64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:00.044888 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b1c02b-241a-445e-a77d-033104883d64 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:00.048761 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7787f0-fb92-4ca4-b488-67bdbb0ddab1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6c687a38524de0bf23d87ae91d3b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:00.049362 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7787f0-fb92-4ca4-b488-67bdbb0ddab1 service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:00.049633 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7787f0-fb92-4ca4-b488-67bdbb0ddab1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:00.049921 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7787f0-fb92-4ca4-b488-67bdbb0ddab1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:00.069584 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7787f0-fb92-4ca4-b488-67bdbb0ddab1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:00.071296 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7787f0-fb92-4ca4-b488-67bdbb0ddab1 service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:00.082763 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1046/2092] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:24:59 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:25:00.117681 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9d8762-4f94-4840-9b07-7f85927c15b9 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:00.202171 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9d8762-4f94-4840-9b07-7f85927c15b9 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:00.206663 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e906db-5e9d-4855-8e84-83f2267f5e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:00.207306 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e906db-5e9d-4855-8e84-83f2267f5e73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:00.207582 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e906db-5e9d-4855-8e84-83f2267f5e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:00.207852 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e906db-5e9d-4855-8e84-83f2267f5e73 admin admin] PATH_INFO: `/v3/users/062bddac56df488796ddba988c974c1a` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:00.208992 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e906db-5e9d-4855-8e84-83f2267f5e73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=062bddac56df488796ddba988c974c1a)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:00.210953 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e906db-5e9d-4855-8e84-83f2267f5e73 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:00.273265 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-15e906db-5e9d-4855-8e84-83f2267f5e73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '062bddac56df488796ddba988c974c1a'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:00.297179 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-15e906db-5e9d-4855-8e84-83f2267f5e73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '062bddac56df488796ddba988c974c1a'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:00.307800 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-15e906db-5e9d-4855-8e84-83f2267f5e73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '062bddac56df488796ddba988c974c1a'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:00.308778 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-15e906db-5e9d-4855-8e84-83f2267f5e73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '062bddac56df488796ddba988c974c1a'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:00.319210 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-15e906db-5e9d-4855-8e84-83f2267f5e73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '062bddac56df488796ddba988c974c1a'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:00.327587 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1047/2093] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:25:00 2022] DELETE /identity/v3/users/062bddac56df488796ddba988c974c1a => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:25:00.331976 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa91c30-7824-4617-a866-94b6e12da533 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:00.332324 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa91c30-7824-4617-a866-94b6e12da533 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:00.332703 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa91c30-7824-4617-a866-94b6e12da533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:00.351610 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-5fa91c30-7824-4617-a866-94b6e12da533 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:25:00.352959 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-5fa91c30-7824-4617-a866-94b6e12da533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:00.389891 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:25:00.419353 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1047/2094] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:25:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:25:00.429506 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e906db-5e9d-4855-8e84-83f2267f5e73 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:00.431604 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-15e906db-5e9d-4855-8e84-83f2267f5e73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:00.483624 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:25:00.494186 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e906db-5e9d-4855-8e84-83f2267f5e73 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:00.499496 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6402f09d-4600-4c31-8e5b-1b6c51943206 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:00.500331 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6402f09d-4600-4c31-8e5b-1b6c51943206 service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:00.501001 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6402f09d-4600-4c31-8e5b-1b6c51943206 service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:00.501491 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6402f09d-4600-4c31-8e5b-1b6c51943206 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:00.512803 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6402f09d-4600-4c31-8e5b-1b6c51943206 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:00.514275 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6402f09d-4600-4c31-8e5b-1b6c51943206 service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:00.523876 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1048/2095] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:25:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 10:25:00.858733 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa91c30-7824-4617-a866-94b6e12da533 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:00.860547 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-5fa91c30-7824-4617-a866-94b6e12da533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:00.885841 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa91c30-7824-4617-a866-94b6e12da533 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:00.892781 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0961dfd8-963b-444c-8b26-52fc9e8d8509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:00.894133 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0961dfd8-963b-444c-8b26-52fc9e8d8509 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:00.894577 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0961dfd8-963b-444c-8b26-52fc9e8d8509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:00.894996 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0961dfd8-963b-444c-8b26-52fc9e8d8509 admin admin] PATH_INFO: `/v3/projects/4067a0c0997f4f84838b20683aadcb97` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:00.896358 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0961dfd8-963b-444c-8b26-52fc9e8d8509 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4067a0c0997f4f84838b20683aadcb97)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:00.898343 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0961dfd8-963b-444c-8b26-52fc9e8d8509 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:00.959149 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-0961dfd8-963b-444c-8b26-52fc9e8d8509 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4067a0c0997f4f84838b20683aadcb97', 'request_id': 'req-0961dfd8-963b-444c-8b26-52fc9e8d8509'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:00.968042 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-0961dfd8-963b-444c-8b26-52fc9e8d8509 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4067a0c0997f4f84838b20683aadcb97', 'request_id': 'req-0961dfd8-963b-444c-8b26-52fc9e8d8509'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:00.974630 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-0961dfd8-963b-444c-8b26-52fc9e8d8509 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4067a0c0997f4f84838b20683aadcb97', 'request_id': 'req-0961dfd8-963b-444c-8b26-52fc9e8d8509'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:00.987924 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-0961dfd8-963b-444c-8b26-52fc9e8d8509 admin admin] The token cache is being invalidate because project 4067a0c0997f4f84838b20683aadcb97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:25:00.988551 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-0961dfd8-963b-444c-8b26-52fc9e8d8509 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:00.988891 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-0961dfd8-963b-444c-8b26-52fc9e8d8509 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:00.990482 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1048/2096] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:25:00 2022] DELETE /identity/v3/projects/4067a0c0997f4f84838b20683aadcb97 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:25:00.994490 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6402f09d-4600-4c31-8e5b-1b6c51943206 service neutron] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:01.008267 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6402f09d-4600-4c31-8e5b-1b6c51943206 service neutron] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:01.084315 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21087f24-177e-4c00-b1dd-c9a14f7b3e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:01.084951 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21087f24-177e-4c00-b1dd-c9a14f7b3e3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:01.085238 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21087f24-177e-4c00-b1dd-c9a14f7b3e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:01.085511 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21087f24-177e-4c00-b1dd-c9a14f7b3e3b admin admin] PATH_INFO: `/v3/users/4bace6f510bf4c92ae0c45aa5a6affc6` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:01.086671 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21087f24-177e-4c00-b1dd-c9a14f7b3e3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bace6f510bf4c92ae0c45aa5a6affc6)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:01.089450 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21087f24-177e-4c00-b1dd-c9a14f7b3e3b admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:01.150919 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-21087f24-177e-4c00-b1dd-c9a14f7b3e3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bace6f510bf4c92ae0c45aa5a6affc6'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:01.164182 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-21087f24-177e-4c00-b1dd-c9a14f7b3e3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bace6f510bf4c92ae0c45aa5a6affc6'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:01.172050 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-21087f24-177e-4c00-b1dd-c9a14f7b3e3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bace6f510bf4c92ae0c45aa5a6affc6'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:01.172841 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-21087f24-177e-4c00-b1dd-c9a14f7b3e3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bace6f510bf4c92ae0c45aa5a6affc6'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:01.183028 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-21087f24-177e-4c00-b1dd-c9a14f7b3e3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bace6f510bf4c92ae0c45aa5a6affc6'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:01.190243 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1049/2097] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:25:00 2022] DELETE /identity/v3/users/4bace6f510bf4c92ae0c45aa5a6affc6 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:25:01.363993 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c06392-105f-48ed-a249-63274abb7f74 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:01.364281 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c06392-105f-48ed-a249-63274abb7f74 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:01.364556 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c06392-105f-48ed-a249-63274abb7f74 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:01.365950 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1049/2098] 10.222.0.36 () {54 vars in 921 bytes} [Tue Aug 9 10:25:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 10:25:01.411038 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3639f1f-8634-4f48-9829-92d17c302274 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:01.411352 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3639f1f-8634-4f48-9829-92d17c302274 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:01.411632 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3639f1f-8634-4f48-9829-92d17c302274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:01.437222 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-c3639f1f-8634-4f48-9829-92d17c302274 None None] MFA Rules not processed for user `c4d3b6a332394adf9e1b81ee9c171c48`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:25:01.438589 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-c3639f1f-8634-4f48-9829-92d17c302274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:01.475878 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c06392-105f-48ed-a249-63274abb7f74 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:01.478452 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-c8c06392-105f-48ed-a249-63274abb7f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:01.516652 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1050/2099] 10.222.0.36 () {58 vars in 1018 bytes} [Tue Aug 9 10:25:01 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:25:01.532344 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3639f1f-8634-4f48-9829-92d17c302274 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:01.534355 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-c3639f1f-8634-4f48-9829-92d17c302274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:01.545372 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:25:01.552434 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3639f1f-8634-4f48-9829-92d17c302274 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:01.563598 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec35308f-656c-4369-846c-7c24fae1a579 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4d3b6a332394adf9e1b81ee9c171c48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:01.564420 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec35308f-656c-4369-846c-7c24fae1a579 service placement] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:01.564651 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec35308f-656c-4369-846c-7c24fae1a579 service placement] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:01.564930 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec35308f-656c-4369-846c-7c24fae1a579 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:01.571554 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c06392-105f-48ed-a249-63274abb7f74 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:01.574694 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec35308f-656c-4369-846c-7c24fae1a579 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:01.576651 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec35308f-656c-4369-846c-7c24fae1a579 service placement] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:01.579669 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54990a33-68f7-48dd-962d-9722cf7c4219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:01.580304 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54990a33-68f7-48dd-962d-9722cf7c4219 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:01.580625 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54990a33-68f7-48dd-962d-9722cf7c4219 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:01.580843 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54990a33-68f7-48dd-962d-9722cf7c4219 admin admin] PATH_INFO: `/v3/users/8105de43df804312a4a8f00b95b0632b` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:01.582028 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54990a33-68f7-48dd-962d-9722cf7c4219 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8105de43df804312a4a8f00b95b0632b)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:01.584963 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54990a33-68f7-48dd-962d-9722cf7c4219 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:01.590561 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1051/2100] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:25:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 10:25:01.591782 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec35308f-656c-4369-846c-7c24fae1a579 service placement] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:01.593196 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-ec35308f-656c-4369-846c-7c24fae1a579 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:01.609401 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec35308f-656c-4369-846c-7c24fae1a579 service placement] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:01.617748 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea146c7-c90b-475b-a3fe-5fa540524705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:01.618624 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea146c7-c90b-475b-a3fe-5fa540524705 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:01.620377 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea146c7-c90b-475b-a3fe-5fa540524705 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:01.620777 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea146c7-c90b-475b-a3fe-5fa540524705 admin admin] PATH_INFO: `/v3/projects/23ce4fc849044b6fa78c341832446b93` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:01.622149 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea146c7-c90b-475b-a3fe-5fa540524705 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23ce4fc849044b6fa78c341832446b93)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:01.624286 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea146c7-c90b-475b-a3fe-5fa540524705 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:01.647057 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-54990a33-68f7-48dd-962d-9722cf7c4219 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8105de43df804312a4a8f00b95b0632b'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:01.661419 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-54990a33-68f7-48dd-962d-9722cf7c4219 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8105de43df804312a4a8f00b95b0632b'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:01.662831 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:25:01.676380 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-54990a33-68f7-48dd-962d-9722cf7c4219 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8105de43df804312a4a8f00b95b0632b'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:01.680944 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-54990a33-68f7-48dd-962d-9722cf7c4219 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8105de43df804312a4a8f00b95b0632b'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:01.693425 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-54990a33-68f7-48dd-962d-9722cf7c4219 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8105de43df804312a4a8f00b95b0632b'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:01.695907 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-5ea146c7-c90b-475b-a3fe-5fa540524705 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23ce4fc849044b6fa78c341832446b93', 'request_id': 'req-5ea146c7-c90b-475b-a3fe-5fa540524705'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:01.701763 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1050/2101] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:25:01 2022] DELETE /identity/v3/users/8105de43df804312a4a8f00b95b0632b => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 10:25:01.711982 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-5ea146c7-c90b-475b-a3fe-5fa540524705 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23ce4fc849044b6fa78c341832446b93', 'request_id': 'req-5ea146c7-c90b-475b-a3fe-5fa540524705'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:01.723671 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-5ea146c7-c90b-475b-a3fe-5fa540524705 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23ce4fc849044b6fa78c341832446b93', 'request_id': 'req-5ea146c7-c90b-475b-a3fe-5fa540524705'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:01.739619 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-5ea146c7-c90b-475b-a3fe-5fa540524705 admin admin] The token cache is being invalidate because project 23ce4fc849044b6fa78c341832446b93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80105) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:25:01.739895 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-5ea146c7-c90b-475b-a3fe-5fa540524705 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:01.740420 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-5ea146c7-c90b-475b-a3fe-5fa540524705 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:01.742043 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1052/2102] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:25:01 2022] DELETE /identity/v3/projects/23ce4fc849044b6fa78c341832446b93 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:25:01.747615 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2faacc0-409e-4058-9836-b7b98035c425 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:01.748065 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2faacc0-409e-4058-9836-b7b98035c425 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:01.748401 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2faacc0-409e-4058-9836-b7b98035c425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:01.774399 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-e2faacc0-409e-4058-9836-b7b98035c425 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:25:01.776276 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-e2faacc0-409e-4058-9836-b7b98035c425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:01.843850 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1051/2103] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:25:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:25:01.854348 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2228c0-0350-4f52-9bb5-e0609b7635a8 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:01.854829 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2228c0-0350-4f52-9bb5-e0609b7635a8 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:01.855192 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2228c0-0350-4f52-9bb5-e0609b7635a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:01.879367 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-fb2228c0-0350-4f52-9bb5-e0609b7635a8 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:25:01.882245 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-fb2228c0-0350-4f52-9bb5-e0609b7635a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:01.898327 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1053/2104] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:25:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:25:01.900979 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2228c0-0350-4f52-9bb5-e0609b7635a8 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:01.901140 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2faacc0-409e-4058-9836-b7b98035c425 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:01.903314 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-e2faacc0-409e-4058-9836-b7b98035c425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:01.918733 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2228c0-0350-4f52-9bb5-e0609b7635a8 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:01.926029 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4184829-28b7-4a6c-a706-16f0a32cb6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:01.926659 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2faacc0-409e-4058-9836-b7b98035c425 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:01.927245 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4184829-28b7-4a6c-a706-16f0a32cb6df admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:01.927834 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4184829-28b7-4a6c-a706-16f0a32cb6df admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:01.928363 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4184829-28b7-4a6c-a706-16f0a32cb6df admin admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:01.929452 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4184829-28b7-4a6c-a706-16f0a32cb6df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:25:01.929978 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4184829-28b7-4a6c-a706-16f0a32cb6df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:01.932998 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4184829-28b7-4a6c-a706-16f0a32cb6df admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:01.934240 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bde4ab-9ed6-42c5-9c6a-861591e242e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:01.935184 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bde4ab-9ed6-42c5-9c6a-861591e242e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:01.935613 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bde4ab-9ed6-42c5-9c6a-861591e242e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:01.936048 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bde4ab-9ed6-42c5-9c6a-861591e242e4 admin admin] PATH_INFO: `/v3/projects/05a5a4904fb0410389c4369d9db98e20` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:01.937597 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bde4ab-9ed6-42c5-9c6a-861591e242e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05a5a4904fb0410389c4369d9db98e20)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:01.941081 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bde4ab-9ed6-42c5-9c6a-861591e242e4 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:01.951854 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1054/2105] 10.222.0.36 () {58 vars in 1153 bytes} [Tue Aug 9 10:25:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:25:01.959649 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4184829-28b7-4a6c-a706-16f0a32cb6df admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:01.974048 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4184829-28b7-4a6c-a706-16f0a32cb6df admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:01.979532 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7249aadd-8c28-4cb3-9c9b-588c30ba126b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:01.980111 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7249aadd-8c28-4cb3-9c9b-588c30ba126b admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:01.980467 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7249aadd-8c28-4cb3-9c9b-588c30ba126b admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:01.980871 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7249aadd-8c28-4cb3-9c9b-588c30ba126b admin admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:01.981440 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7249aadd-8c28-4cb3-9c9b-588c30ba126b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:01.983509 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7249aadd-8c28-4cb3-9c9b-588c30ba126b admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:02.002811 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a5bde4ab-9ed6-42c5-9c6a-861591e242e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05a5a4904fb0410389c4369d9db98e20', 'request_id': 'req-a5bde4ab-9ed6-42c5-9c6a-861591e242e4'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:02.011189 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a5bde4ab-9ed6-42c5-9c6a-861591e242e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05a5a4904fb0410389c4369d9db98e20', 'request_id': 'req-a5bde4ab-9ed6-42c5-9c6a-861591e242e4'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:02.018875 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a5bde4ab-9ed6-42c5-9c6a-861591e242e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05a5a4904fb0410389c4369d9db98e20', 'request_id': 'req-a5bde4ab-9ed6-42c5-9c6a-861591e242e4'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:02.035258 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1055/2106] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:25:01 2022] POST /identity/v3/projects => generated 383 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:25:02.035782 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a5bde4ab-9ed6-42c5-9c6a-861591e242e4 admin admin] The token cache is being invalidate because project 05a5a4904fb0410389c4369d9db98e20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:25:02.035782 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a5bde4ab-9ed6-42c5-9c6a-861591e242e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:02.036403 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7249aadd-8c28-4cb3-9c9b-588c30ba126b admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:02.036682 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a5bde4ab-9ed6-42c5-9c6a-861591e242e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:02.038155 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-7249aadd-8c28-4cb3-9c9b-588c30ba126b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:02.039378 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1052/2107] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:25:01 2022] DELETE /identity/v3/projects/05a5a4904fb0410389c4369d9db98e20 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:25:02.043394 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bde4ab-9ed6-42c5-9c6a-861591e242e4 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:02.045009 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-a5bde4ab-9ed6-42c5-9c6a-861591e242e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:02.115535 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7249aadd-8c28-4cb3-9c9b-588c30ba126b admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:02.127778 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ceee9-7f1b-4539-8694-cf718f0005b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:02.128897 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ceee9-7f1b-4539-8694-cf718f0005b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:02.129369 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ceee9-7f1b-4539-8694-cf718f0005b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:02.129864 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ceee9-7f1b-4539-8694-cf718f0005b5 admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:02.130890 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756ceee9-7f1b-4539-8694-cf718f0005b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:02.134775 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756ceee9-7f1b-4539-8694-cf718f0005b5 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:02.152365 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bde4ab-9ed6-42c5-9c6a-861591e242e4 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:02.160463 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dcd56c-8767-4cfb-9c11-b0323e407201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:02.161219 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dcd56c-8767-4cfb-9c11-b0323e407201 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:02.161573 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dcd56c-8767-4cfb-9c11-b0323e407201 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:02.161950 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dcd56c-8767-4cfb-9c11-b0323e407201 admin admin] PATH_INFO: `/v3/users/5ab080716d014067b3bc1ae73c5eb22b` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:02.163263 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dcd56c-8767-4cfb-9c11-b0323e407201 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ab080716d014067b3bc1ae73c5eb22b)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:02.165480 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dcd56c-8767-4cfb-9c11-b0323e407201 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:02.169492 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1056/2108] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:25:02 2022] POST /identity/v3/users => generated 292 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 10:25:02.174106 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:25:02.178405 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ceee9-7f1b-4539-8694-cf718f0005b5 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:02.203919 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ceee9-7f1b-4539-8694-cf718f0005b5 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:02.214771 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e039f6bf-bb1e-4081-b2b2-3397fde882ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:02.215600 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e039f6bf-bb1e-4081-b2b2-3397fde882ab admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:02.215998 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e039f6bf-bb1e-4081-b2b2-3397fde882ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:02.216275 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e039f6bf-bb1e-4081-b2b2-3397fde882ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:02.217294 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e039f6bf-bb1e-4081-b2b2-3397fde882ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:02.221211 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e039f6bf-bb1e-4081-b2b2-3397fde882ab admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:02.241723 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-06dcd56c-8767-4cfb-9c11-b0323e407201 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ab080716d014067b3bc1ae73c5eb22b'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:02.250262 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1057/2109] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:25:02 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:25:02.260239 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e039f6bf-bb1e-4081-b2b2-3397fde882ab admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:02.271038 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-06dcd56c-8767-4cfb-9c11-b0323e407201 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ab080716d014067b3bc1ae73c5eb22b'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:02.280874 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e039f6bf-bb1e-4081-b2b2-3397fde882ab admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:02.287266 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-06dcd56c-8767-4cfb-9c11-b0323e407201 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ab080716d014067b3bc1ae73c5eb22b'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:02.289058 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-06dcd56c-8767-4cfb-9c11-b0323e407201 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ab080716d014067b3bc1ae73c5eb22b'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:02.293699 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbe6862-67ff-48c9-9f39-57b7466d8138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:02.294415 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe6862-67ff-48c9-9f39-57b7466d8138 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:02.294757 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe6862-67ff-48c9-9f39-57b7466d8138 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:02.295155 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe6862-67ff-48c9-9f39-57b7466d8138 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:02.295979 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbe6862-67ff-48c9-9f39-57b7466d8138 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:02.299618 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbe6862-67ff-48c9-9f39-57b7466d8138 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:02.302758 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:25:02.311382 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-06dcd56c-8767-4cfb-9c11-b0323e407201 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ab080716d014067b3bc1ae73c5eb22b'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:02.321760 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1058/2110] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:25:02 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:25:02.324440 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbe6862-67ff-48c9-9f39-57b7466d8138 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:02.326452 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-8fbe6862-67ff-48c9-9f39-57b7466d8138 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:02.335476 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1053/2111] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:25:02 2022] DELETE /identity/v3/users/5ab080716d014067b3bc1ae73c5eb22b => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:25:02.341472 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbe6862-67ff-48c9-9f39-57b7466d8138 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:02.412306 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca0d60e-39f8-4a0c-85b5-09e2cf728e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:02.412989 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca0d60e-39f8-4a0c-85b5-09e2cf728e40 admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:02.413259 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca0d60e-39f8-4a0c-85b5-09e2cf728e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:02.413528 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca0d60e-39f8-4a0c-85b5-09e2cf728e40 admin admin] PATH_INFO: `/v3/projects/5a4f818c9d884d2ea7303b98b7bbcc61/users/be05cd1273f348a5a37b9c82b61e4122/roles/a9895331e9694fa8b2b50908bb057bcb` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:02.429520 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca0d60e-39f8-4a0c-85b5-09e2cf728e40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a4f818c9d884d2ea7303b98b7bbcc61, user_id=be05cd1273f348a5a37b9c82b61e4122, role_id=a9895331e9694fa8b2b50908bb057bcb)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:02.433221 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca0d60e-39f8-4a0c-85b5-09e2cf728e40 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:02.449086 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1059/2112] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:25:02 2022] PUT /identity/v3/projects/5a4f818c9d884d2ea7303b98b7bbcc61/users/be05cd1273f348a5a37b9c82b61e4122/roles/a9895331e9694fa8b2b50908bb057bcb => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:25:02.460828 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c6744-d344-4972-bcc3-fe37daa56d5c None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:02.461112 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c6744-d344-4972-bcc3-fe37daa56d5c None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:02.461391 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c6744-d344-4972-bcc3-fe37daa56d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:02.490182 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-0f8c6744-d344-4972-bcc3-fe37daa56d5c None None] MFA Rules not processed for user `be05cd1273f348a5a37b9c82b61e4122`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:25:02.491499 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-0f8c6744-d344-4972-bcc3-fe37daa56d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:02.532787 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca0d60e-39f8-4a0c-85b5-09e2cf728e40 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:02.534933 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-bca0d60e-39f8-4a0c-85b5-09e2cf728e40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:02.601983 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1054/2113] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:25:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 10:25:02.607499 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8c6744-d344-4972-bcc3-fe37daa56d5c None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:02.619728 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8c6744-d344-4972-bcc3-fe37daa56d5c None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:02.620134 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca0d60e-39f8-4a0c-85b5-09e2cf728e40 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:02.624370 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61623f19-c018-4134-b575-0ca908f75042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:02.624961 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61623f19-c018-4134-b575-0ca908f75042 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:02.625236 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61623f19-c018-4134-b575-0ca908f75042 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:02.625506 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61623f19-c018-4134-b575-0ca908f75042 admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:02.625767 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a85e21-c0b3-43dd-b30f-14bba61172b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:02.626158 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61623f19-c018-4134-b575-0ca908f75042 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:02.626570 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a85e21-c0b3-43dd-b30f-14bba61172b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:02.626882 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a85e21-c0b3-43dd-b30f-14bba61172b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:02.627234 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a85e21-c0b3-43dd-b30f-14bba61172b4 admin admin] PATH_INFO: `/v3/projects/c84d178af27e4bf2aff1d34dcaa18852` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:02.628062 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61623f19-c018-4134-b575-0ca908f75042 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:02.628535 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a85e21-c0b3-43dd-b30f-14bba61172b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c84d178af27e4bf2aff1d34dcaa18852)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:02.630781 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a85e21-c0b3-43dd-b30f-14bba61172b4 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:02.656965 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1055/2114] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:25:02 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 10:25:02.661347 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61623f19-c018-4134-b575-0ca908f75042 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:02.695877 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-78a85e21-c0b3-43dd-b30f-14bba61172b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c84d178af27e4bf2aff1d34dcaa18852', 'request_id': 'req-78a85e21-c0b3-43dd-b30f-14bba61172b4'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:02.702073 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-78a85e21-c0b3-43dd-b30f-14bba61172b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c84d178af27e4bf2aff1d34dcaa18852', 'request_id': 'req-78a85e21-c0b3-43dd-b30f-14bba61172b4'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:02.708290 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-78a85e21-c0b3-43dd-b30f-14bba61172b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c84d178af27e4bf2aff1d34dcaa18852', 'request_id': 'req-78a85e21-c0b3-43dd-b30f-14bba61172b4'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:02.720804 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:25:02.722924 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-78a85e21-c0b3-43dd-b30f-14bba61172b4 admin admin] The token cache is being invalidate because project c84d178af27e4bf2aff1d34dcaa18852 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80105) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:25:02.723190 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-78a85e21-c0b3-43dd-b30f-14bba61172b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:02.723880 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-78a85e21-c0b3-43dd-b30f-14bba61172b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:02.725432 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1060/2115] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:25:02 2022] DELETE /identity/v3/projects/c84d178af27e4bf2aff1d34dcaa18852 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 10:25:02.731583 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ea97b5-b925-47d9-926d-cd2e39095d3d None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:02.731863 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ea97b5-b925-47d9-926d-cd2e39095d3d None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:02.732189 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ea97b5-b925-47d9-926d-cd2e39095d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:02.734301 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61623f19-c018-4134-b575-0ca908f75042 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:02.754151 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-a9ea97b5-b925-47d9-926d-cd2e39095d3d None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:25:02.755451 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-a9ea97b5-b925-47d9-926d-cd2e39095d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:02.760901 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:25:02.795941 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e0e1b8-e489-432c-b69a-649b56fd870f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:02.796512 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e0e1b8-e489-432c-b69a-649b56fd870f admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:02.796799 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e0e1b8-e489-432c-b69a-649b56fd870f admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:02.797085 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e0e1b8-e489-432c-b69a-649b56fd870f admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:02.797931 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e0e1b8-e489-432c-b69a-649b56fd870f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:02.800237 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e0e1b8-e489-432c-b69a-649b56fd870f admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:02.831666 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1061/2116] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:25:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 10:25:02.831950 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1056/2117] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:25:02 2022] POST /identity/v3/users => generated 298 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 10:25:02.840553 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a05d2c-b1d7-4482-9635-fa352bc2baf5 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:02.840836 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a05d2c-b1d7-4482-9635-fa352bc2baf5 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:02.840984 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e0e1b8-e489-432c-b69a-649b56fd870f admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:02.841112 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a05d2c-b1d7-4482-9635-fa352bc2baf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:02.842659 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-02e0e1b8-e489-432c-b69a-649b56fd870f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:02.855441 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e0e1b8-e489-432c-b69a-649b56fd870f admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:02.860485 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8775bc-d02e-4afe-859a-1e66a1ffdafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:02.861077 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8775bc-d02e-4afe-859a-1e66a1ffdafd admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:02.861365 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8775bc-d02e-4afe-859a-1e66a1ffdafd admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:02.861804 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8775bc-d02e-4afe-859a-1e66a1ffdafd admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:02.862331 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8775bc-d02e-4afe-859a-1e66a1ffdafd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:02.863949 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8775bc-d02e-4afe-859a-1e66a1ffdafd admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:02.865958 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-96a05d2c-b1d7-4482-9635-fa352bc2baf5 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:25:02.867481 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-96a05d2c-b1d7-4482-9635-fa352bc2baf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:02.877505 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1062/2119] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:25:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 10:25:02.878099 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1057/2119] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:25:02 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 10:25:02.881322 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a05d2c-b1d7-4482-9635-fa352bc2baf5 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:02.881802 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8775bc-d02e-4afe-859a-1e66a1ffdafd admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:02.892288 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a05d2c-b1d7-4482-9635-fa352bc2baf5 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:02.893169 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8775bc-d02e-4afe-859a-1e66a1ffdafd admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:02.896832 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e39d926-3fed-4a6c-b934-e9812c639d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:02.897474 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e39d926-3fed-4a6c-b934-e9812c639d1a admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:02.897756 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e39d926-3fed-4a6c-b934-e9812c639d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:02.897985 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2041ab4-9790-4862-b32c-336161b612c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:02.898101 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e39d926-3fed-4a6c-b934-e9812c639d1a admin admin] PATH_INFO: `/v3/projects/998faa43e03041e2b5da72ae7bf02fe6/users/7c614962bab64f7a9aa9feaf6318c138/roles/89ca30cbbb634be8a96e9921aa56626b` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:02.898393 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2041ab4-9790-4862-b32c-336161b612c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:02.898661 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2041ab4-9790-4862-b32c-336161b612c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:02.898920 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2041ab4-9790-4862-b32c-336161b612c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:02.899567 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2041ab4-9790-4862-b32c-336161b612c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:25:02.900844 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2041ab4-9790-4862-b32c-336161b612c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:02.902576 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2041ab4-9790-4862-b32c-336161b612c6 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:02.914342 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e39d926-3fed-4a6c-b934-e9812c639d1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=998faa43e03041e2b5da72ae7bf02fe6, user_id=7c614962bab64f7a9aa9feaf6318c138, role_id=89ca30cbbb634be8a96e9921aa56626b)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:02.915493 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1058/2120] 10.222.0.36 () {58 vars in 1153 bytes} [Tue Aug 9 10:25:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:25:02.919945 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2041ab4-9790-4862-b32c-336161b612c6 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:02.920248 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e39d926-3fed-4a6c-b934-e9812c639d1a admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:02.930584 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2041ab4-9790-4862-b32c-336161b612c6 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:02.934280 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1063/2121] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:25:02 2022] PUT /identity/v3/projects/998faa43e03041e2b5da72ae7bf02fe6/users/7c614962bab64f7a9aa9feaf6318c138/roles/89ca30cbbb634be8a96e9921aa56626b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 10:25:02.937753 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e39d926-3fed-4a6c-b934-e9812c639d1a admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:02.995805 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d2c8ee-1beb-4ba2-bbe2-624a898d42af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:02.996422 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d2c8ee-1beb-4ba2-bbe2-624a898d42af admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:02.996672 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d2c8ee-1beb-4ba2-bbe2-624a898d42af admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:02.996956 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d2c8ee-1beb-4ba2-bbe2-624a898d42af admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:02.997575 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d2c8ee-1beb-4ba2-bbe2-624a898d42af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:02.999541 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d2c8ee-1beb-4ba2-bbe2-624a898d42af admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:03.028504 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1059/2122] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:25:02 2022] POST /identity/v3/projects => generated 375 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 10:25:03.032924 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d2c8ee-1beb-4ba2-bbe2-624a898d42af admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:03.034939 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e39d926-3fed-4a6c-b934-e9812c639d1a admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:03.083469 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:25:03.096322 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d2c8ee-1beb-4ba2-bbe2-624a898d42af admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:03.098720 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615d05f0-5b56-4e22-98f7-b0327ce01f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:03.099460 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d05f0-5b56-4e22-98f7-b0327ce01f41 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:03.099821 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d05f0-5b56-4e22-98f7-b0327ce01f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:03.100166 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d05f0-5b56-4e22-98f7-b0327ce01f41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:03.100882 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615d05f0-5b56-4e22-98f7-b0327ce01f41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:03.101125 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9588833c-1248-46ee-852c-6300b266d792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:03.101721 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9588833c-1248-46ee-852c-6300b266d792 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:03.102031 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9588833c-1248-46ee-852c-6300b266d792 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:03.102305 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9588833c-1248-46ee-852c-6300b266d792 admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:03.102589 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615d05f0-5b56-4e22-98f7-b0327ce01f41 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:03.102954 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9588833c-1248-46ee-852c-6300b266d792 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:03.104874 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9588833c-1248-46ee-852c-6300b266d792 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:03.113555 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1064/2123] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:25:02 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:25:03.118124 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615d05f0-5b56-4e22-98f7-b0327ce01f41 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:03.129689 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1060/2124] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:25:03 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 10:25:03.129896 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615d05f0-5b56-4e22-98f7-b0327ce01f41 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:03.130872 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9588833c-1248-46ee-852c-6300b266d792 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:03.135439 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3b794d-8a9a-4ca8-b46e-84cd28c4f6fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:03.136040 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b794d-8a9a-4ca8-b46e-84cd28c4f6fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:03.136318 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b794d-8a9a-4ca8-b46e-84cd28c4f6fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:03.136595 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b794d-8a9a-4ca8-b46e-84cd28c4f6fa admin admin] PATH_INFO: `/v3/projects/998faa43e03041e2b5da72ae7bf02fe6/users/7c614962bab64f7a9aa9feaf6318c138/roles/89ca30cbbb634be8a96e9921aa56626b` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:03.138541 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3b794d-8a9a-4ca8-b46e-84cd28c4f6fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=998faa43e03041e2b5da72ae7bf02fe6, user_id=7c614962bab64f7a9aa9feaf6318c138, role_id=89ca30cbbb634be8a96e9921aa56626b)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:03.141200 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3b794d-8a9a-4ca8-b46e-84cd28c4f6fa admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:03.143564 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9588833c-1248-46ee-852c-6300b266d792 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:03.148349 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0f214a-9569-4623-bfe8-7c78df33d766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:03.148958 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f214a-9569-4623-bfe8-7c78df33d766 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:03.149236 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f214a-9569-4623-bfe8-7c78df33d766 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:03.149499 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f214a-9569-4623-bfe8-7c78df33d766 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:03.151241 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0f214a-9569-4623-bfe8-7c78df33d766 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:03.152640 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1065/2125] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:25:03 2022] PUT /identity/v3/projects/998faa43e03041e2b5da72ae7bf02fe6/users/7c614962bab64f7a9aa9feaf6318c138/roles/89ca30cbbb634be8a96e9921aa56626b => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 10:25:03.162144 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0f214a-9569-4623-bfe8-7c78df33d766 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:03.164145 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc34959-5a3a-469c-85ad-06ade03e843a None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:03.164436 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc34959-5a3a-469c-85ad-06ade03e843a None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:03.164716 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc34959-5a3a-469c-85ad-06ade03e843a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:03.167849 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1061/2126] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:25:03 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:25:03.171624 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0f214a-9569-4623-bfe8-7c78df33d766 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:03.181975 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0f214a-9569-4623-bfe8-7c78df33d766 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:03.189317 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:25:03.198654 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-cbc34959-5a3a-469c-85ad-06ade03e843a None None] MFA Rules not processed for user `7c614962bab64f7a9aa9feaf6318c138`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:25:03.200783 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-cbc34959-5a3a-469c-85ad-06ade03e843a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:03.241406 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d575b8-9270-436f-a291-2b804c909c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:03.242104 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d575b8-9270-436f-a291-2b804c909c92 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:03.242496 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d575b8-9270-436f-a291-2b804c909c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:03.242824 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d575b8-9270-436f-a291-2b804c909c92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:03.244586 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d575b8-9270-436f-a291-2b804c909c92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:03.246247 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d575b8-9270-436f-a291-2b804c909c92 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:03.261224 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1062/2127] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:25:03 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 10:25:03.262198 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d575b8-9270-436f-a291-2b804c909c92 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:03.276388 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d575b8-9270-436f-a291-2b804c909c92 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:03.284975 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d15444-bfaa-4a58-9060-0c4afd2be476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:03.285710 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d15444-bfaa-4a58-9060-0c4afd2be476 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:03.286151 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d15444-bfaa-4a58-9060-0c4afd2be476 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:03.286471 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d15444-bfaa-4a58-9060-0c4afd2be476 admin admin] PATH_INFO: `/v3/projects/66f2b7f88ede4466aec2f211809e0318/users/075991ab4a1141ffb6532896b56b4ed7/roles/a9895331e9694fa8b2b50908bb057bcb` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:03.309443 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1066/2128] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:25:03 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 10:25:03.310118 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc34959-5a3a-469c-85ad-06ade03e843a None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:03.312331 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-cbc34959-5a3a-469c-85ad-06ade03e843a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:03.318484 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d15444-bfaa-4a58-9060-0c4afd2be476 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66f2b7f88ede4466aec2f211809e0318, user_id=075991ab4a1141ffb6532896b56b4ed7, role_id=a9895331e9694fa8b2b50908bb057bcb)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:03.322337 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d15444-bfaa-4a58-9060-0c4afd2be476 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:03.339561 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1063/2129] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:25:03 2022] PUT /identity/v3/projects/66f2b7f88ede4466aec2f211809e0318/users/075991ab4a1141ffb6532896b56b4ed7/roles/a9895331e9694fa8b2b50908bb057bcb => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:25:03.349934 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe27d1-a798-4acd-8c11-f6de424b2fc4 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:03.350196 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe27d1-a798-4acd-8c11-f6de424b2fc4 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:03.350471 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe27d1-a798-4acd-8c11-f6de424b2fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:03.389494 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-47fe27d1-a798-4acd-8c11-f6de424b2fc4 None None] MFA Rules not processed for user `075991ab4a1141ffb6532896b56b4ed7`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:25:03.390747 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-47fe27d1-a798-4acd-8c11-f6de424b2fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:03.406854 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc34959-5a3a-469c-85ad-06ade03e843a None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:03.463281 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1064/2130] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:25:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 10:25:03.467223 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c4adad-ec39-4356-ac1f-f88d1fbfd8ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6c687a38524de0bf23d87ae91d3b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:03.467917 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c4adad-ec39-4356-ac1f-f88d1fbfd8ff service cinder] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:03.468264 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c4adad-ec39-4356-ac1f-f88d1fbfd8ff service cinder] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:03.468632 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c4adad-ec39-4356-ac1f-f88d1fbfd8ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:03.534469 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c4adad-ec39-4356-ac1f-f88d1fbfd8ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:03.535912 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c4adad-ec39-4356-ac1f-f88d1fbfd8ff service cinder] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:03.546463 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1067/2131] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:25:03 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 10:25:03.658653 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fe27d1-a798-4acd-8c11-f6de424b2fc4 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:03.669140 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fe27d1-a798-4acd-8c11-f6de424b2fc4 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:03.673231 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22222de0-2283-4d05-b43e-69045716801c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6c687a38524de0bf23d87ae91d3b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:03.674006 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22222de0-2283-4d05-b43e-69045716801c service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:03.674239 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22222de0-2283-4d05-b43e-69045716801c service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:03.674534 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22222de0-2283-4d05-b43e-69045716801c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:03.676391 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-22222de0-2283-4d05-b43e-69045716801c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:03.707870 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:25:03.742925 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22222de0-2283-4d05-b43e-69045716801c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:03.745478 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22222de0-2283-4d05-b43e-69045716801c service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:03.755229 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1065/2132] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:25:03 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:25:06.364346 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c4adad-ec39-4356-ac1f-f88d1fbfd8ff service cinder] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:06.369074 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:25:06.437476 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c4adad-ec39-4356-ac1f-f88d1fbfd8ff service cinder] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:06.443333 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a3d5db-aacc-49c9-a02b-aa36d4560cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:06.444270 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a3d5db-aacc-49c9-a02b-aa36d4560cad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:06.444558 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a3d5db-aacc-49c9-a02b-aa36d4560cad admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:06.445066 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a3d5db-aacc-49c9-a02b-aa36d4560cad admin admin] PATH_INFO: `/v3/users/be05cd1273f348a5a37b9c82b61e4122` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:06.446386 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a3d5db-aacc-49c9-a02b-aa36d4560cad admin admin] RBAC: Authorizing `identity:delete_user(user_id=be05cd1273f348a5a37b9c82b61e4122)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:06.449336 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a3d5db-aacc-49c9-a02b-aa36d4560cad admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:06.467283 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22222de0-2283-4d05-b43e-69045716801c service cinder] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:06.469903 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-22222de0-2283-4d05-b43e-69045716801c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:06.512657 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-88a3d5db-aacc-49c9-a02b-aa36d4560cad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be05cd1273f348a5a37b9c82b61e4122'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:06.529383 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-88a3d5db-aacc-49c9-a02b-aa36d4560cad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be05cd1273f348a5a37b9c82b61e4122'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:06.538153 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-88a3d5db-aacc-49c9-a02b-aa36d4560cad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be05cd1273f348a5a37b9c82b61e4122'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:06.539148 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-88a3d5db-aacc-49c9-a02b-aa36d4560cad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be05cd1273f348a5a37b9c82b61e4122'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:06.549683 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-88a3d5db-aacc-49c9-a02b-aa36d4560cad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be05cd1273f348a5a37b9c82b61e4122'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:06.554362 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22222de0-2283-4d05-b43e-69045716801c service cinder] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:06.558429 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1068/2133] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:25:06 2022] DELETE /identity/v3/users/be05cd1273f348a5a37b9c82b61e4122 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:25:06.565569 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed61cf9-de6d-4da5-a4fa-0514b79d4f75 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07540b72afd34927855c41db09a7b030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:06.566294 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed61cf9-de6d-4da5-a4fa-0514b79d4f75 service glance] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:06.566633 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed61cf9-de6d-4da5-a4fa-0514b79d4f75 service glance] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:06.566961 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed61cf9-de6d-4da5-a4fa-0514b79d4f75 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:06.569065 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-9ed61cf9-de6d-4da5-a4fa-0514b79d4f75 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:06.569185 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb813812-2e44-44ea-b35f-77c820e2c8fc None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:06.569470 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb813812-2e44-44ea-b35f-77c820e2c8fc None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:06.569759 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb813812-2e44-44ea-b35f-77c820e2c8fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:06.581116 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed61cf9-de6d-4da5-a4fa-0514b79d4f75 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:06.582576 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed61cf9-de6d-4da5-a4fa-0514b79d4f75 service glance] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:06.590171 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-eb813812-2e44-44ea-b35f-77c820e2c8fc None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:25:06.591412 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-eb813812-2e44-44ea-b35f-77c820e2c8fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:06.592246 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1066/2134] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:25:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:25:06.655556 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1069/2135] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:25:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 10:25:06.665987 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed61cf9-de6d-4da5-a4fa-0514b79d4f75 service glance] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:06.667459 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-9ed61cf9-de6d-4da5-a4fa-0514b79d4f75 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:06.727304 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed61cf9-de6d-4da5-a4fa-0514b79d4f75 service glance] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:06.777575 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993b10bb-fb77-4445-ae4c-f53413819047 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:06.778360 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b10bb-fb77-4445-ae4c-f53413819047 service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:06.778640 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b10bb-fb77-4445-ae4c-f53413819047 service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:06.778967 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b10bb-fb77-4445-ae4c-f53413819047 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:06.789406 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993b10bb-fb77-4445-ae4c-f53413819047 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:06.791026 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993b10bb-fb77-4445-ae4c-f53413819047 service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:06.800895 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1067/2136] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:25:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:25:07.487621 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb813812-2e44-44ea-b35f-77c820e2c8fc None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:07.490645 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-eb813812-2e44-44ea-b35f-77c820e2c8fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:07.505010 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb813812-2e44-44ea-b35f-77c820e2c8fc None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:07.512324 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51559c8-781c-48c8-884c-2faeb43b38f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:07.513461 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51559c8-781c-48c8-884c-2faeb43b38f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:07.515310 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51559c8-781c-48c8-884c-2faeb43b38f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:07.515803 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51559c8-781c-48c8-884c-2faeb43b38f0 admin admin] PATH_INFO: `/v3/projects/5a4f818c9d884d2ea7303b98b7bbcc61` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:07.517391 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51559c8-781c-48c8-884c-2faeb43b38f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a4f818c9d884d2ea7303b98b7bbcc61)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:07.519914 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51559c8-781c-48c8-884c-2faeb43b38f0 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:07.540640 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:25:07.576261 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-c51559c8-781c-48c8-884c-2faeb43b38f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a4f818c9d884d2ea7303b98b7bbcc61', 'request_id': 'req-c51559c8-781c-48c8-884c-2faeb43b38f0'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:07.582854 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-c51559c8-781c-48c8-884c-2faeb43b38f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a4f818c9d884d2ea7303b98b7bbcc61', 'request_id': 'req-c51559c8-781c-48c8-884c-2faeb43b38f0'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:07.593932 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-c51559c8-781c-48c8-884c-2faeb43b38f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a4f818c9d884d2ea7303b98b7bbcc61', 'request_id': 'req-c51559c8-781c-48c8-884c-2faeb43b38f0'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:07.608136 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-c51559c8-781c-48c8-884c-2faeb43b38f0 admin admin] The token cache is being invalidate because project 5a4f818c9d884d2ea7303b98b7bbcc61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80105) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:25:07.608430 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-c51559c8-781c-48c8-884c-2faeb43b38f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:07.609068 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-c51559c8-781c-48c8-884c-2faeb43b38f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:07.610602 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1070/2137] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:25:07 2022] DELETE /identity/v3/projects/5a4f818c9d884d2ea7303b98b7bbcc61 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:25:07.614999 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993b10bb-fb77-4445-ae4c-f53413819047 service neutron] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:07.627497 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993b10bb-fb77-4445-ae4c-f53413819047 service neutron] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:07.660204 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:25:07.697159 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323e152c-96df-4b53-a615-daeb39267a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:07.697839 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323e152c-96df-4b53-a615-daeb39267a57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:07.698153 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323e152c-96df-4b53-a615-daeb39267a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:07.698431 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323e152c-96df-4b53-a615-daeb39267a57 admin admin] PATH_INFO: `/v3/users/7c614962bab64f7a9aa9feaf6318c138` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:07.699593 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323e152c-96df-4b53-a615-daeb39267a57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c614962bab64f7a9aa9feaf6318c138)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:07.701748 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323e152c-96df-4b53-a615-daeb39267a57 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:07.767360 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-323e152c-96df-4b53-a615-daeb39267a57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c614962bab64f7a9aa9feaf6318c138'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:07.786177 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-323e152c-96df-4b53-a615-daeb39267a57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c614962bab64f7a9aa9feaf6318c138'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:07.797048 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-323e152c-96df-4b53-a615-daeb39267a57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c614962bab64f7a9aa9feaf6318c138'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:07.798273 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-323e152c-96df-4b53-a615-daeb39267a57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c614962bab64f7a9aa9feaf6318c138'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:07.809396 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-323e152c-96df-4b53-a615-daeb39267a57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c614962bab64f7a9aa9feaf6318c138'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:07.815847 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1068/2138] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:25:07 2022] DELETE /identity/v3/users/7c614962bab64f7a9aa9feaf6318c138 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:25:08.241556 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51559c8-781c-48c8-884c-2faeb43b38f0 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:08.243170 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-c51559c8-781c-48c8-884c-2faeb43b38f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:08.256541 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51559c8-781c-48c8-884c-2faeb43b38f0 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:08.340692 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f86c20-bb9c-4c6b-addb-1fc513954687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:08.341272 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f86c20-bb9c-4c6b-addb-1fc513954687 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:08.341549 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f86c20-bb9c-4c6b-addb-1fc513954687 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:08.341820 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f86c20-bb9c-4c6b-addb-1fc513954687 admin admin] PATH_INFO: `/v3/projects/998faa43e03041e2b5da72ae7bf02fe6` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:08.342978 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f86c20-bb9c-4c6b-addb-1fc513954687 admin admin] RBAC: Authorizing `identity:delete_project(project_id=998faa43e03041e2b5da72ae7bf02fe6)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:08.344872 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f86c20-bb9c-4c6b-addb-1fc513954687 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:08.405733 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-99f86c20-bb9c-4c6b-addb-1fc513954687 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '998faa43e03041e2b5da72ae7bf02fe6', 'request_id': 'req-99f86c20-bb9c-4c6b-addb-1fc513954687'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:08.411636 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-99f86c20-bb9c-4c6b-addb-1fc513954687 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '998faa43e03041e2b5da72ae7bf02fe6', 'request_id': 'req-99f86c20-bb9c-4c6b-addb-1fc513954687'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:08.419507 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-99f86c20-bb9c-4c6b-addb-1fc513954687 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '998faa43e03041e2b5da72ae7bf02fe6', 'request_id': 'req-99f86c20-bb9c-4c6b-addb-1fc513954687'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:08.432793 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-99f86c20-bb9c-4c6b-addb-1fc513954687 admin admin] The token cache is being invalidate because project 998faa43e03041e2b5da72ae7bf02fe6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80105) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:25:08.433076 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-99f86c20-bb9c-4c6b-addb-1fc513954687 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:08.433695 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-99f86c20-bb9c-4c6b-addb-1fc513954687 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:08.435184 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1071/2139] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:25:08 2022] DELETE /identity/v3/projects/998faa43e03041e2b5da72ae7bf02fe6 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:25:08.440413 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d16f724-5c22-48e0-98ab-93fecaae22a3 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:08.440886 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d16f724-5c22-48e0-98ab-93fecaae22a3 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:08.441241 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d16f724-5c22-48e0-98ab-93fecaae22a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:08.464140 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-2d16f724-5c22-48e0-98ab-93fecaae22a3 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:25:08.465521 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-2d16f724-5c22-48e0-98ab-93fecaae22a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:08.548620 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1069/2140] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:25:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:25:08.552744 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53755b95-2fe4-4164-a3ac-40ab36d39183 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:08.553210 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53755b95-2fe4-4164-a3ac-40ab36d39183 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:08.553435 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53755b95-2fe4-4164-a3ac-40ab36d39183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:08.576645 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-53755b95-2fe4-4164-a3ac-40ab36d39183 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:25:08.578386 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-53755b95-2fe4-4164-a3ac-40ab36d39183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:08.611850 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1072/2141] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:25:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:25:08.615905 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d16f724-5c22-48e0-98ab-93fecaae22a3 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:08.628241 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d16f724-5c22-48e0-98ab-93fecaae22a3 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:08.633841 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d65bdf-be6c-46f0-856e-45a2f0c77841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:08.634639 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d65bdf-be6c-46f0-856e-45a2f0c77841 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:08.634920 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d65bdf-be6c-46f0-856e-45a2f0c77841 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:08.636168 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d65bdf-be6c-46f0-856e-45a2f0c77841 admin admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:08.636955 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d65bdf-be6c-46f0-856e-45a2f0c77841 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:25:08.637143 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d65bdf-be6c-46f0-856e-45a2f0c77841 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:08.638829 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d65bdf-be6c-46f0-856e-45a2f0c77841 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:08.667060 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1070/2142] 10.222.0.36 () {58 vars in 1153 bytes} [Tue Aug 9 10:25:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:25:08.671056 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53755b95-2fe4-4164-a3ac-40ab36d39183 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:08.683625 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53755b95-2fe4-4164-a3ac-40ab36d39183 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:08.693086 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35d83d6-01f2-44dd-8d82-bdbec41a3871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:08.693699 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d83d6-01f2-44dd-8d82-bdbec41a3871 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:08.694037 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d83d6-01f2-44dd-8d82-bdbec41a3871 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:08.694296 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d83d6-01f2-44dd-8d82-bdbec41a3871 admin admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:08.695034 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35d83d6-01f2-44dd-8d82-bdbec41a3871 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:08.697109 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35d83d6-01f2-44dd-8d82-bdbec41a3871 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:08.725008 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1073/2143] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:25:08 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:25:08.729590 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d65bdf-be6c-46f0-856e-45a2f0c77841 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:08.739549 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d65bdf-be6c-46f0-856e-45a2f0c77841 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:08.775223 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:25:08.802127 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc2cf15-abf8-40b3-b293-48105248f7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:08.802728 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc2cf15-abf8-40b3-b293-48105248f7ce admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:08.803005 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc2cf15-abf8-40b3-b293-48105248f7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:08.803270 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc2cf15-abf8-40b3-b293-48105248f7ce admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:08.803891 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc2cf15-abf8-40b3-b293-48105248f7ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:08.806435 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc2cf15-abf8-40b3-b293-48105248f7ce admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:08.828330 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1071/2144] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:25:08 2022] POST /identity/v3/users => generated 292 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:25:08.832254 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35d83d6-01f2-44dd-8d82-bdbec41a3871 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:08.842615 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35d83d6-01f2-44dd-8d82-bdbec41a3871 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:08.847013 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b18811-5710-4cee-abec-bdf89f51e43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:08.847597 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b18811-5710-4cee-abec-bdf89f51e43d admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:08.847871 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b18811-5710-4cee-abec-bdf89f51e43d admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:08.848140 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b18811-5710-4cee-abec-bdf89f51e43d admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:08.848770 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b18811-5710-4cee-abec-bdf89f51e43d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:08.850453 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b18811-5710-4cee-abec-bdf89f51e43d admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:08.851729 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:25:08.863164 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1074/2145] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:25:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:25:08.868084 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc2cf15-abf8-40b3-b293-48105248f7ce admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:08.884741 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc2cf15-abf8-40b3-b293-48105248f7ce admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:08.893990 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10368fe-511a-4a70-a1d1-a8aa0e64f30a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:08.893990 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10368fe-511a-4a70-a1d1-a8aa0e64f30a admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:08.893990 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10368fe-511a-4a70-a1d1-a8aa0e64f30a admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:08.893990 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10368fe-511a-4a70-a1d1-a8aa0e64f30a admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:08.894642 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10368fe-511a-4a70-a1d1-a8aa0e64f30a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:08.894642 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10368fe-511a-4a70-a1d1-a8aa0e64f30a admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:08.906316 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1072/2146] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:25:08 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:25:08.910637 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b18811-5710-4cee-abec-bdf89f51e43d admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:08.920921 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b18811-5710-4cee-abec-bdf89f51e43d admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:08.926662 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f80989-3cd7-4765-b5e9-a26dde87e100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:08.927477 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f80989-3cd7-4765-b5e9-a26dde87e100 admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:08.927792 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f80989-3cd7-4765-b5e9-a26dde87e100 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:08.928171 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f80989-3cd7-4765-b5e9-a26dde87e100 admin admin] PATH_INFO: `/v3/projects/36a033337e534c2b8d5baee49954739b/users/fcb1942c43664b19baf809891f049139/roles/a9895331e9694fa8b2b50908bb057bcb` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:08.944970 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f80989-3cd7-4765-b5e9-a26dde87e100 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36a033337e534c2b8d5baee49954739b, user_id=fcb1942c43664b19baf809891f049139, role_id=a9895331e9694fa8b2b50908bb057bcb)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:08.948866 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f80989-3cd7-4765-b5e9-a26dde87e100 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:08.963723 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1075/2147] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:25:08 2022] PUT /identity/v3/projects/36a033337e534c2b8d5baee49954739b/users/fcb1942c43664b19baf809891f049139/roles/a9895331e9694fa8b2b50908bb057bcb => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:25:08.973929 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd79595-5183-4b90-ad80-06c506f8caee None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:08.974214 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd79595-5183-4b90-ad80-06c506f8caee None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:08.974485 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd79595-5183-4b90-ad80-06c506f8caee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:09.003846 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-1dd79595-5183-4b90-ad80-06c506f8caee None None] MFA Rules not processed for user `fcb1942c43664b19baf809891f049139`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:25:09.005056 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-1dd79595-5183-4b90-ad80-06c506f8caee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:09.069446 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1073/2148] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:25:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:25:09.074039 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f80989-3cd7-4765-b5e9-a26dde87e100 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:09.136289 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f80989-3cd7-4765-b5e9-a26dde87e100 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:09.141339 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d558f1b-1aee-47c3-a238-20da80c0cadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:09.141810 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d558f1b-1aee-47c3-a238-20da80c0cadf admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:09.142326 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d558f1b-1aee-47c3-a238-20da80c0cadf admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:09.142513 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d558f1b-1aee-47c3-a238-20da80c0cadf admin admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:09.143129 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d558f1b-1aee-47c3-a238-20da80c0cadf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:09.145009 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d558f1b-1aee-47c3-a238-20da80c0cadf admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:09.181897 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1076/2149] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:25:09 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:25:09.183510 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd79595-5183-4b90-ad80-06c506f8caee None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:09.195549 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd79595-5183-4b90-ad80-06c506f8caee None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:09.258332 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2f7031-c3f5-4abe-9058-3dcc8d4f9c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:09.259069 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2f7031-c3f5-4abe-9058-3dcc8d4f9c1f admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:09.259354 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2f7031-c3f5-4abe-9058-3dcc8d4f9c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:09.259632 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2f7031-c3f5-4abe-9058-3dcc8d4f9c1f admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:09.260262 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2f7031-c3f5-4abe-9058-3dcc8d4f9c1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:09.262228 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2f7031-c3f5-4abe-9058-3dcc8d4f9c1f admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:09.286015 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1074/2150] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:25:09 2022] POST /identity/v3/users => generated 299 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 10:25:09.291136 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d558f1b-1aee-47c3-a238-20da80c0cadf admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:09.301841 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d558f1b-1aee-47c3-a238-20da80c0cadf admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:09.307942 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdbde86-7516-4314-8a3b-17b00aa45892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:09.308687 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdbde86-7516-4314-8a3b-17b00aa45892 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:09.309145 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdbde86-7516-4314-8a3b-17b00aa45892 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:09.309522 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdbde86-7516-4314-8a3b-17b00aa45892 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:09.310485 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdbde86-7516-4314-8a3b-17b00aa45892 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:09.312817 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdbde86-7516-4314-8a3b-17b00aa45892 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:09.325632 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1077/2151] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:25:09 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:25:09.329703 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2f7031-c3f5-4abe-9058-3dcc8d4f9c1f admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:09.340421 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2f7031-c3f5-4abe-9058-3dcc8d4f9c1f admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:09.345020 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3277165e-9044-4594-a47f-3fedf4859761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:09.345660 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3277165e-9044-4594-a47f-3fedf4859761 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:09.346038 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3277165e-9044-4594-a47f-3fedf4859761 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:09.346297 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3277165e-9044-4594-a47f-3fedf4859761 admin admin] PATH_INFO: `/v3/projects/d4b5decc00cb495a81fdfba8fa466ccf/users/762bcef0316246ccb9e42e117bded3d0/roles/89ca30cbbb634be8a96e9921aa56626b` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:09.362467 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3277165e-9044-4594-a47f-3fedf4859761 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4b5decc00cb495a81fdfba8fa466ccf, user_id=762bcef0316246ccb9e42e117bded3d0, role_id=89ca30cbbb634be8a96e9921aa56626b)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:09.365098 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3277165e-9044-4594-a47f-3fedf4859761 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:09.378393 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1075/2152] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:25:09 2022] PUT /identity/v3/projects/d4b5decc00cb495a81fdfba8fa466ccf/users/762bcef0316246ccb9e42e117bded3d0/roles/89ca30cbbb634be8a96e9921aa56626b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:25:09.382650 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdbde86-7516-4314-8a3b-17b00aa45892 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:09.393323 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdbde86-7516-4314-8a3b-17b00aa45892 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:09.452226 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee4ce0e-6d4b-4f72-97c6-64381ac95c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:09.452829 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee4ce0e-6d4b-4f72-97c6-64381ac95c4c admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:09.453111 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee4ce0e-6d4b-4f72-97c6-64381ac95c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:09.453391 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee4ce0e-6d4b-4f72-97c6-64381ac95c4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:09.454060 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee4ce0e-6d4b-4f72-97c6-64381ac95c4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:09.455644 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee4ce0e-6d4b-4f72-97c6-64381ac95c4c admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:09.465146 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1078/2153] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:25:09 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 10:25:09.469472 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3277165e-9044-4594-a47f-3fedf4859761 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:09.480220 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3277165e-9044-4594-a47f-3fedf4859761 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:09.484722 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af7cbef-b3f6-4d1e-840a-f5817a5448c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:09.485362 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af7cbef-b3f6-4d1e-840a-f5817a5448c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:09.485641 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af7cbef-b3f6-4d1e-840a-f5817a5448c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:09.485948 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af7cbef-b3f6-4d1e-840a-f5817a5448c8 admin admin] PATH_INFO: `/v3/projects/d4b5decc00cb495a81fdfba8fa466ccf/users/762bcef0316246ccb9e42e117bded3d0/roles/89ca30cbbb634be8a96e9921aa56626b` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:09.487912 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af7cbef-b3f6-4d1e-840a-f5817a5448c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4b5decc00cb495a81fdfba8fa466ccf, user_id=762bcef0316246ccb9e42e117bded3d0, role_id=89ca30cbbb634be8a96e9921aa56626b)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:09.490587 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af7cbef-b3f6-4d1e-840a-f5817a5448c8 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:09.496975 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:25:09.502918 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1076/2154] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:25:09 2022] PUT /identity/v3/projects/d4b5decc00cb495a81fdfba8fa466ccf/users/762bcef0316246ccb9e42e117bded3d0/roles/89ca30cbbb634be8a96e9921aa56626b => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:25:09.528880 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f32126-458a-4350-ac1f-554e968bf9ee None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:09.530458 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f32126-458a-4350-ac1f-554e968bf9ee None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:09.531130 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f32126-458a-4350-ac1f-554e968bf9ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:09.568685 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-81f32126-458a-4350-ac1f-554e968bf9ee None None] MFA Rules not processed for user `762bcef0316246ccb9e42e117bded3d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:25:09.569923 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-81f32126-458a-4350-ac1f-554e968bf9ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:09.604715 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:25:09.653448 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1079/2155] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:25:09 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:25:09.666882 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af7cbef-b3f6-4d1e-840a-f5817a5448c8 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:09.669530 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-4af7cbef-b3f6-4d1e-840a-f5817a5448c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:09.829469 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af7cbef-b3f6-4d1e-840a-f5817a5448c8 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:09.834472 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57af9c11-d564-45a9-9c14-02778f73d33e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6c687a38524de0bf23d87ae91d3b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:09.835107 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af9c11-d564-45a9-9c14-02778f73d33e service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:09.835391 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af9c11-d564-45a9-9c14-02778f73d33e service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:09.835662 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af9c11-d564-45a9-9c14-02778f73d33e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:09.921795 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57af9c11-d564-45a9-9c14-02778f73d33e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:09.923436 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57af9c11-d564-45a9-9c14-02778f73d33e service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:09.938038 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1077/2156] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:25:09 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:25:14.383306 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f32126-458a-4350-ac1f-554e968bf9ee None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:14.393063 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f32126-458a-4350-ac1f-554e968bf9ee None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:14.396795 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5123b3d3-1551-4548-9d93-7364013a5534 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6c687a38524de0bf23d87ae91d3b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:14.397383 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5123b3d3-1551-4548-9d93-7364013a5534 service cinder] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:14.397662 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5123b3d3-1551-4548-9d93-7364013a5534 service cinder] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:14.397955 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5123b3d3-1551-4548-9d93-7364013a5534 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:14.407215 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5123b3d3-1551-4548-9d93-7364013a5534 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:14.408619 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5123b3d3-1551-4548-9d93-7364013a5534 service cinder] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:14.418660 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1080/2157] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:25:14 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:25:19.365432 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57af9c11-d564-45a9-9c14-02778f73d33e service cinder] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:19.432310 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57af9c11-d564-45a9-9c14-02778f73d33e service cinder] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:19.437410 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b44419-660d-45e0-a2bb-3d655c677c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:19.438190 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b44419-660d-45e0-a2bb-3d655c677c55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:19.438585 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b44419-660d-45e0-a2bb-3d655c677c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:19.438952 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b44419-660d-45e0-a2bb-3d655c677c55 admin admin] PATH_INFO: `/v3/users/fcb1942c43664b19baf809891f049139` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:19.440340 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b44419-660d-45e0-a2bb-3d655c677c55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcb1942c43664b19baf809891f049139)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:19.442523 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b44419-660d-45e0-a2bb-3d655c677c55 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:19.495082 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-81b44419-660d-45e0-a2bb-3d655c677c55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcb1942c43664b19baf809891f049139'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:19.502303 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:25:19.511480 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-81b44419-660d-45e0-a2bb-3d655c677c55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcb1942c43664b19baf809891f049139'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:19.519166 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-81b44419-660d-45e0-a2bb-3d655c677c55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcb1942c43664b19baf809891f049139'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:19.520374 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-81b44419-660d-45e0-a2bb-3d655c677c55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcb1942c43664b19baf809891f049139'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:19.530658 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-81b44419-660d-45e0-a2bb-3d655c677c55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcb1942c43664b19baf809891f049139'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:19.537974 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1078/2158] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:25:19 2022] DELETE /identity/v3/users/fcb1942c43664b19baf809891f049139 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:25:19.544907 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8747a63-93fa-4fe0-aec0-edd220b764a2 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:19.545442 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8747a63-93fa-4fe0-aec0-edd220b764a2 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:19.545442 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8747a63-93fa-4fe0-aec0-edd220b764a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:19.564571 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-c8747a63-93fa-4fe0-aec0-edd220b764a2 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:25:19.565784 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-c8747a63-93fa-4fe0-aec0-edd220b764a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:19.643660 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1081/2159] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:25:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:25:19.654566 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b44419-660d-45e0-a2bb-3d655c677c55 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:19.656110 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-81b44419-660d-45e0-a2bb-3d655c677c55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:19.750669 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b44419-660d-45e0-a2bb-3d655c677c55 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:19.755118 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae43b00-6985-4e6e-9734-b6b13fb23b0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:19.755758 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae43b00-6985-4e6e-9734-b6b13fb23b0c service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:19.756040 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae43b00-6985-4e6e-9734-b6b13fb23b0c service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:19.756313 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae43b00-6985-4e6e-9734-b6b13fb23b0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:19.766822 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae43b00-6985-4e6e-9734-b6b13fb23b0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:19.768561 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae43b00-6985-4e6e-9734-b6b13fb23b0c service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:19.780287 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1079/2160] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:25:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 10:25:20.185397 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8747a63-93fa-4fe0-aec0-edd220b764a2 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:20.188327 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-c8747a63-93fa-4fe0-aec0-edd220b764a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:20.219077 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8747a63-93fa-4fe0-aec0-edd220b764a2 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:20.240320 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd99fed3-911d-4310-94e8-916aed8472c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:20.241170 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd99fed3-911d-4310-94e8-916aed8472c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:20.241727 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd99fed3-911d-4310-94e8-916aed8472c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:20.242178 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd99fed3-911d-4310-94e8-916aed8472c6 admin admin] PATH_INFO: `/v3/projects/36a033337e534c2b8d5baee49954739b` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:20.243765 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd99fed3-911d-4310-94e8-916aed8472c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36a033337e534c2b8d5baee49954739b)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:20.245874 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd99fed3-911d-4310-94e8-916aed8472c6 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:20.339994 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-cd99fed3-911d-4310-94e8-916aed8472c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36a033337e534c2b8d5baee49954739b', 'request_id': 'req-cd99fed3-911d-4310-94e8-916aed8472c6'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:20.355365 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-cd99fed3-911d-4310-94e8-916aed8472c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36a033337e534c2b8d5baee49954739b', 'request_id': 'req-cd99fed3-911d-4310-94e8-916aed8472c6'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:20.363077 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-cd99fed3-911d-4310-94e8-916aed8472c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36a033337e534c2b8d5baee49954739b', 'request_id': 'req-cd99fed3-911d-4310-94e8-916aed8472c6'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:20.379383 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-cd99fed3-911d-4310-94e8-916aed8472c6 admin admin] The token cache is being invalidate because project 36a033337e534c2b8d5baee49954739b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80105) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:25:20.379678 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-cd99fed3-911d-4310-94e8-916aed8472c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:20.380396 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-cd99fed3-911d-4310-94e8-916aed8472c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:20.381959 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1082/2161] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:25:20 2022] DELETE /identity/v3/projects/36a033337e534c2b8d5baee49954739b => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:25:20.386259 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae43b00-6985-4e6e-9734-b6b13fb23b0c service neutron] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:20.397229 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae43b00-6985-4e6e-9734-b6b13fb23b0c service neutron] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:20.467394 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428d2e61-8c00-4b69-b0c5-b9ea5b684424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:20.468043 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d2e61-8c00-4b69-b0c5-b9ea5b684424 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:20.468797 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d2e61-8c00-4b69-b0c5-b9ea5b684424 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:20.468797 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d2e61-8c00-4b69-b0c5-b9ea5b684424 admin admin] PATH_INFO: `/v3/users/762bcef0316246ccb9e42e117bded3d0` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:20.469951 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428d2e61-8c00-4b69-b0c5-b9ea5b684424 admin admin] RBAC: Authorizing `identity:delete_user(user_id=762bcef0316246ccb9e42e117bded3d0)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:20.471917 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428d2e61-8c00-4b69-b0c5-b9ea5b684424 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:20.543323 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-428d2e61-8c00-4b69-b0c5-b9ea5b684424 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '762bcef0316246ccb9e42e117bded3d0'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:20.556316 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-428d2e61-8c00-4b69-b0c5-b9ea5b684424 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '762bcef0316246ccb9e42e117bded3d0'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:20.564762 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-428d2e61-8c00-4b69-b0c5-b9ea5b684424 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '762bcef0316246ccb9e42e117bded3d0'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:20.566267 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-428d2e61-8c00-4b69-b0c5-b9ea5b684424 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '762bcef0316246ccb9e42e117bded3d0'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:20.573664 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:25:20.575223 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-428d2e61-8c00-4b69-b0c5-b9ea5b684424 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '762bcef0316246ccb9e42e117bded3d0'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:20.582959 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1080/2162] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:25:20 2022] DELETE /identity/v3/users/762bcef0316246ccb9e42e117bded3d0 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:25:20.907449 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d4142c-18d7-41da-bc6f-b62fde62cead None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:20.907984 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d4142c-18d7-41da-bc6f-b62fde62cead None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:20.907984 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d4142c-18d7-41da-bc6f-b62fde62cead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:20.908920 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428d2e61-8c00-4b69-b0c5-b9ea5b684424 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:20.910539 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-428d2e61-8c00-4b69-b0c5-b9ea5b684424 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:20.941410 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-87d4142c-18d7-41da-bc6f-b62fde62cead None None] MFA Rules not processed for user `3d39820fab6041b9b655c54ce74e7e4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:25:20.946976 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-87d4142c-18d7-41da-bc6f-b62fde62cead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:20.987584 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:25:21.000987 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428d2e61-8c00-4b69-b0c5-b9ea5b684424 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:21.005568 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6ee590-9fb9-4fad-9355-090554643545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:21.006326 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ee590-9fb9-4fad-9355-090554643545 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:21.006870 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ee590-9fb9-4fad-9355-090554643545 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:21.006989 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ee590-9fb9-4fad-9355-090554643545 admin admin] PATH_INFO: `/v3/projects/d4b5decc00cb495a81fdfba8fa466ccf` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:21.008190 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6ee590-9fb9-4fad-9355-090554643545 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4b5decc00cb495a81fdfba8fa466ccf)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:21.010534 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6ee590-9fb9-4fad-9355-090554643545 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:21.014384 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1083/2163] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:25:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:25:21.061460 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-6f6ee590-9fb9-4fad-9355-090554643545 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4b5decc00cb495a81fdfba8fa466ccf', 'request_id': 'req-6f6ee590-9fb9-4fad-9355-090554643545'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:21.067524 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-6f6ee590-9fb9-4fad-9355-090554643545 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4b5decc00cb495a81fdfba8fa466ccf', 'request_id': 'req-6f6ee590-9fb9-4fad-9355-090554643545'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:21.074591 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-6f6ee590-9fb9-4fad-9355-090554643545 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4b5decc00cb495a81fdfba8fa466ccf', 'request_id': 'req-6f6ee590-9fb9-4fad-9355-090554643545'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:21.090977 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-6f6ee590-9fb9-4fad-9355-090554643545 admin admin] The token cache is being invalidate because project d4b5decc00cb495a81fdfba8fa466ccf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:25:21.090977 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-6f6ee590-9fb9-4fad-9355-090554643545 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:21.090977 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-6f6ee590-9fb9-4fad-9355-090554643545 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:21.092061 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1081/2164] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:25:20 2022] DELETE /identity/v3/projects/d4b5decc00cb495a81fdfba8fa466ccf => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 10:25:21.098413 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34410e25-d92d-423a-a25e-96d99ece52f6 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:21.098749 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34410e25-d92d-423a-a25e-96d99ece52f6 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:21.099096 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34410e25-d92d-423a-a25e-96d99ece52f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:21.123480 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-34410e25-d92d-423a-a25e-96d99ece52f6 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:25:21.124863 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-34410e25-d92d-423a-a25e-96d99ece52f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:21.200149 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1084/2165] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:25:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 10:25:21.208910 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2602716-b2ca-4883-9497-d1c3c766a3ee None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:21.208910 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2602716-b2ca-4883-9497-d1c3c766a3ee None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:21.208910 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2602716-b2ca-4883-9497-d1c3c766a3ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:21.235721 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-b2602716-b2ca-4883-9497-d1c3c766a3ee None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:25:21.236150 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-b2602716-b2ca-4883-9497-d1c3c766a3ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:21.248290 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1082/2166] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:25:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:25:21.252890 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34410e25-d92d-423a-a25e-96d99ece52f6 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:21.265567 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34410e25-d92d-423a-a25e-96d99ece52f6 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:21.271278 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf19dfc8-7aea-4222-bdd0-d828a3f6694d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:21.272013 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf19dfc8-7aea-4222-bdd0-d828a3f6694d admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:21.272407 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf19dfc8-7aea-4222-bdd0-d828a3f6694d admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:21.272829 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf19dfc8-7aea-4222-bdd0-d828a3f6694d admin admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:21.273567 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf19dfc8-7aea-4222-bdd0-d828a3f6694d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:25:21.274802 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf19dfc8-7aea-4222-bdd0-d828a3f6694d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:21.277269 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf19dfc8-7aea-4222-bdd0-d828a3f6694d admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:21.297821 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2602716-b2ca-4883-9497-d1c3c766a3ee None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:21.307536 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1085/2167] 10.222.0.36 () {58 vars in 1153 bytes} [Tue Aug 9 10:25:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:25:21.310170 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2602716-b2ca-4883-9497-d1c3c766a3ee None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:21.317273 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3491295-35d0-438c-b61b-c68cda115566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:21.317798 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3491295-35d0-438c-b61b-c68cda115566 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:21.318115 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3491295-35d0-438c-b61b-c68cda115566 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:21.318383 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3491295-35d0-438c-b61b-c68cda115566 admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:21.319030 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3491295-35d0-438c-b61b-c68cda115566 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:21.320981 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3491295-35d0-438c-b61b-c68cda115566 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:21.338333 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf19dfc8-7aea-4222-bdd0-d828a3f6694d admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:21.340064 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-cf19dfc8-7aea-4222-bdd0-d828a3f6694d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:21.359022 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf19dfc8-7aea-4222-bdd0-d828a3f6694d admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:21.360601 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1083/2168] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:25:21 2022] POST /identity/v3/projects => generated 375 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 10:25:21.364682 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3491295-35d0-438c-b61b-c68cda115566 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:21.447509 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:25:21.458641 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3491295-35d0-438c-b61b-c68cda115566 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:21.466448 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b0506f-22dd-4cb0-b82d-cbd967dc8bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:21.467716 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3de2f7-6bd8-4692-872d-6e09f9185fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:21.468139 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b0506f-22dd-4cb0-b82d-cbd967dc8bf2 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:21.468637 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b0506f-22dd-4cb0-b82d-cbd967dc8bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:21.468778 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3de2f7-6bd8-4692-872d-6e09f9185fd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:21.468959 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3de2f7-6bd8-4692-872d-6e09f9185fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:21.469414 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b0506f-22dd-4cb0-b82d-cbd967dc8bf2 admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:21.469537 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3de2f7-6bd8-4692-872d-6e09f9185fd8 admin admin] PATH_INFO: `/v3/users/41db4e82e28344e597b703d36d874aec` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:21.470708 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3de2f7-6bd8-4692-872d-6e09f9185fd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41db4e82e28344e597b703d36d874aec)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:21.470902 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b0506f-22dd-4cb0-b82d-cbd967dc8bf2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:21.472618 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3de2f7-6bd8-4692-872d-6e09f9185fd8 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:21.473627 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b0506f-22dd-4cb0-b82d-cbd967dc8bf2 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:21.506513 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1084/2169] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:25:21 2022] POST /identity/v3/users => generated 288 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 10:25:21.514602 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b0506f-22dd-4cb0-b82d-cbd967dc8bf2 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:21.526466 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b0506f-22dd-4cb0-b82d-cbd967dc8bf2 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:21.535455 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4ef203-69f4-49cc-aad1-49d939983e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:21.536594 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ef203-69f4-49cc-aad1-49d939983e15 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:21.537180 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ef203-69f4-49cc-aad1-49d939983e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:21.537588 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ef203-69f4-49cc-aad1-49d939983e15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:21.538364 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-1a3de2f7-6bd8-4692-872d-6e09f9185fd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41db4e82e28344e597b703d36d874aec'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:21.538565 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4ef203-69f4-49cc-aad1-49d939983e15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:21.541392 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4ef203-69f4-49cc-aad1-49d939983e15 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:21.554325 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-1a3de2f7-6bd8-4692-872d-6e09f9185fd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41db4e82e28344e597b703d36d874aec'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:21.558470 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1085/2170] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:25:21 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:25:21.559871 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4ef203-69f4-49cc-aad1-49d939983e15 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:21.568566 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:25:21.571573 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-1a3de2f7-6bd8-4692-872d-6e09f9185fd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41db4e82e28344e597b703d36d874aec'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:21.572483 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-1a3de2f7-6bd8-4692-872d-6e09f9185fd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41db4e82e28344e597b703d36d874aec'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:21.577426 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4ef203-69f4-49cc-aad1-49d939983e15 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:21.582510 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-1a3de2f7-6bd8-4692-872d-6e09f9185fd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41db4e82e28344e597b703d36d874aec'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:21.586328 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963d816a-563e-4c2a-a74a-2e66d3082bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:21.587269 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d816a-563e-4c2a-a74a-2e66d3082bae admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:21.587548 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d816a-563e-4c2a-a74a-2e66d3082bae admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:21.587818 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d816a-563e-4c2a-a74a-2e66d3082bae admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:21.588464 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963d816a-563e-4c2a-a74a-2e66d3082bae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:21.590382 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963d816a-563e-4c2a-a74a-2e66d3082bae admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:21.592555 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1086/2171] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:25:21 2022] DELETE /identity/v3/users/41db4e82e28344e597b703d36d874aec => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:25:21.613586 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1086/2172] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:25:21 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:25:21.619458 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963d816a-563e-4c2a-a74a-2e66d3082bae admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:21.620433 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac496df-9633-4a36-bc99-52840c9b7faf None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:21.621151 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac496df-9633-4a36-bc99-52840c9b7faf None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:21.621151 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac496df-9633-4a36-bc99-52840c9b7faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:21.622764 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-963d816a-563e-4c2a-a74a-2e66d3082bae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:21.644158 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-eac496df-9633-4a36-bc99-52840c9b7faf None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:25:21.645780 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-eac496df-9633-4a36-bc99-52840c9b7faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:21.648422 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963d816a-563e-4c2a-a74a-2e66d3082bae admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:21.733285 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1087/2173] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:25:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:25:21.737727 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbe8d97-1071-4ff1-8151-5a10e65193a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:21.738471 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe8d97-1071-4ff1-8151-5a10e65193a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:21.738758 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe8d97-1071-4ff1-8151-5a10e65193a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:21.739036 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe8d97-1071-4ff1-8151-5a10e65193a0 admin admin] PATH_INFO: `/v3/projects/36157d9e907340b1b48ca7c26ae3492c/users/89f0afad96474792aeb536304dddba18/roles/a9895331e9694fa8b2b50908bb057bcb` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:21.745900 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac496df-9633-4a36-bc99-52840c9b7faf None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:21.747489 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-eac496df-9633-4a36-bc99-52840c9b7faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:21.772324 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbe8d97-1071-4ff1-8151-5a10e65193a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36157d9e907340b1b48ca7c26ae3492c, user_id=89f0afad96474792aeb536304dddba18, role_id=a9895331e9694fa8b2b50908bb057bcb)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:21.777327 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbe8d97-1071-4ff1-8151-5a10e65193a0 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:21.806945 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1087/2174] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:25:21 2022] PUT /identity/v3/projects/36157d9e907340b1b48ca7c26ae3492c/users/89f0afad96474792aeb536304dddba18/roles/a9895331e9694fa8b2b50908bb057bcb => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:25:21.818292 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d80922-b6aa-4915-bac1-4f93dbdff572 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:21.818862 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d80922-b6aa-4915-bac1-4f93dbdff572 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:21.819084 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d80922-b6aa-4915-bac1-4f93dbdff572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:21.820447 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac496df-9633-4a36-bc99-52840c9b7faf None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:21.850837 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-17d80922-b6aa-4915-bac1-4f93dbdff572 None None] MFA Rules not processed for user `89f0afad96474792aeb536304dddba18`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:25:21.852617 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-17d80922-b6aa-4915-bac1-4f93dbdff572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:21.884257 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30949109-b6cf-40e1-b373-308f389e5b74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:21.885091 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30949109-b6cf-40e1-b373-308f389e5b74 service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:21.885773 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30949109-b6cf-40e1-b373-308f389e5b74 service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:21.885773 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30949109-b6cf-40e1-b373-308f389e5b74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:21.941430 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1088/2175] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:25:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 10:25:21.946622 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d80922-b6aa-4915-bac1-4f93dbdff572 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:22.019452 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:25:22.026897 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30949109-b6cf-40e1-b373-308f389e5b74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:22.029042 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30949109-b6cf-40e1-b373-308f389e5b74 service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:22.032608 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:25:22.079808 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1088/2176] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:25:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 10:25:22.098535 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d80922-b6aa-4915-bac1-4f93dbdff572 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:22.111631 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5d22b5-440b-4e56-8846-c0864a776805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:22.112909 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d22b5-440b-4e56-8846-c0864a776805 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:22.114204 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d22b5-440b-4e56-8846-c0864a776805 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:22.114710 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d22b5-440b-4e56-8846-c0864a776805 admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:22.116298 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5d22b5-440b-4e56-8846-c0864a776805 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:22.119096 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5d22b5-440b-4e56-8846-c0864a776805 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:22.183085 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1089/2177] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:25:21 2022] POST /identity/v3/projects => generated 371 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 10:25:22.184255 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30949109-b6cf-40e1-b373-308f389e5b74 service neutron] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:22.198715 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30949109-b6cf-40e1-b373-308f389e5b74 service neutron] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:22.296144 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9030e838-8012-4d59-9e42-1998bfe008ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:22.296766 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9030e838-8012-4d59-9e42-1998bfe008ba admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:22.297045 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9030e838-8012-4d59-9e42-1998bfe008ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:22.297322 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9030e838-8012-4d59-9e42-1998bfe008ba admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:22.297983 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9030e838-8012-4d59-9e42-1998bfe008ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:22.300626 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9030e838-8012-4d59-9e42-1998bfe008ba admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:22.325104 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1089/2178] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:25:22 2022] POST /identity/v3/users => generated 292 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:25:22.329210 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5d22b5-440b-4e56-8846-c0864a776805 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:22.346339 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5d22b5-440b-4e56-8846-c0864a776805 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:22.361590 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd1fc2b-953a-467d-a8f1-645d1cf3b96f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:22.364666 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd1fc2b-953a-467d-a8f1-645d1cf3b96f admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:22.364961 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd1fc2b-953a-467d-a8f1-645d1cf3b96f admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:22.365243 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd1fc2b-953a-467d-a8f1-645d1cf3b96f admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:22.379064 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd1fc2b-953a-467d-a8f1-645d1cf3b96f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:22.379064 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd1fc2b-953a-467d-a8f1-645d1cf3b96f admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:22.386996 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1090/2179] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:25:22 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:25:22.390926 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9030e838-8012-4d59-9e42-1998bfe008ba admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:22.415033 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9030e838-8012-4d59-9e42-1998bfe008ba admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:22.432077 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6601c61c-06bf-46d9-a7ef-0785643313a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:22.433319 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6601c61c-06bf-46d9-a7ef-0785643313a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:22.433319 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6601c61c-06bf-46d9-a7ef-0785643313a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:22.433624 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6601c61c-06bf-46d9-a7ef-0785643313a9 admin admin] PATH_INFO: `/v3/projects/dfc5e55707384eeeaeadfde3f478c47e/users/7169bfbca5e8464dac9963a8a6f8dd8e/roles/89ca30cbbb634be8a96e9921aa56626b` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:22.470699 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6601c61c-06bf-46d9-a7ef-0785643313a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfc5e55707384eeeaeadfde3f478c47e, user_id=7169bfbca5e8464dac9963a8a6f8dd8e, role_id=89ca30cbbb634be8a96e9921aa56626b)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:22.473370 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6601c61c-06bf-46d9-a7ef-0785643313a9 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:22.480023 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd1fc2b-953a-467d-a8f1-645d1cf3b96f admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:22.482567 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-5bd1fc2b-953a-467d-a8f1-645d1cf3b96f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:22.506470 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1090/2180] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:25:22 2022] PUT /identity/v3/projects/dfc5e55707384eeeaeadfde3f478c47e/users/7169bfbca5e8464dac9963a8a6f8dd8e/roles/89ca30cbbb634be8a96e9921aa56626b => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:25:22.508805 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6601c61c-06bf-46d9-a7ef-0785643313a9 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:22.526089 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd1fc2b-953a-467d-a8f1-645d1cf3b96f admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:22.611743 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6601c61c-06bf-46d9-a7ef-0785643313a9 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:22.613263 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2347b5-e839-400b-bfb4-cb0e0bc4cbfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:22.614022 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2347b5-e839-400b-bfb4-cb0e0bc4cbfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:22.614307 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2347b5-e839-400b-bfb4-cb0e0bc4cbfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:22.614578 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2347b5-e839-400b-bfb4-cb0e0bc4cbfd admin admin] PATH_INFO: `/v3/projects/98978cd7b70d44ffaa127bb670cb4bbb` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:22.615721 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2347b5-e839-400b-bfb4-cb0e0bc4cbfd admin admin] RBAC: Authorizing `identity:delete_project(project_id=98978cd7b70d44ffaa127bb670cb4bbb)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:22.619007 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882f2a6b-8990-441c-8fab-5e6f3eca1e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:22.619790 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2347b5-e839-400b-bfb4-cb0e0bc4cbfd admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:22.619993 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f2a6b-8990-441c-8fab-5e6f3eca1e70 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:22.620281 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f2a6b-8990-441c-8fab-5e6f3eca1e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:22.620651 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f2a6b-8990-441c-8fab-5e6f3eca1e70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:22.621234 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882f2a6b-8990-441c-8fab-5e6f3eca1e70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:22.622957 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882f2a6b-8990-441c-8fab-5e6f3eca1e70 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:22.637644 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1091/2181] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:25:22 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:25:22.642208 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882f2a6b-8990-441c-8fab-5e6f3eca1e70 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:22.655764 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882f2a6b-8990-441c-8fab-5e6f3eca1e70 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:22.663681 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c40906f-a1ae-4c22-a47a-a8bb7777ae83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:22.664870 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c40906f-a1ae-4c22-a47a-a8bb7777ae83 admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:22.665152 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c40906f-a1ae-4c22-a47a-a8bb7777ae83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:22.665423 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c40906f-a1ae-4c22-a47a-a8bb7777ae83 admin admin] PATH_INFO: `/v3/projects/dfc5e55707384eeeaeadfde3f478c47e/users/7169bfbca5e8464dac9963a8a6f8dd8e/roles/89ca30cbbb634be8a96e9921aa56626b` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:22.676180 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c40906f-a1ae-4c22-a47a-a8bb7777ae83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfc5e55707384eeeaeadfde3f478c47e, user_id=7169bfbca5e8464dac9963a8a6f8dd8e, role_id=89ca30cbbb634be8a96e9921aa56626b)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:22.676180 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c40906f-a1ae-4c22-a47a-a8bb7777ae83 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:22.703293 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1092/2182] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:25:22 2022] PUT /identity/v3/projects/dfc5e55707384eeeaeadfde3f478c47e/users/7169bfbca5e8464dac9963a8a6f8dd8e/roles/89ca30cbbb634be8a96e9921aa56626b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:25:22.705244 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7510120-0fa8-47f7-bf6e-0ffbf68c05ba None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:22.705531 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7510120-0fa8-47f7-bf6e-0ffbf68c05ba None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:22.705837 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7510120-0fa8-47f7-bf6e-0ffbf68c05ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:22.707279 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-4b2347b5-e839-400b-bfb4-cb0e0bc4cbfd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98978cd7b70d44ffaa127bb670cb4bbb', 'request_id': 'req-4b2347b5-e839-400b-bfb4-cb0e0bc4cbfd'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:22.715746 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-4b2347b5-e839-400b-bfb4-cb0e0bc4cbfd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98978cd7b70d44ffaa127bb670cb4bbb', 'request_id': 'req-4b2347b5-e839-400b-bfb4-cb0e0bc4cbfd'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:22.723103 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-4b2347b5-e839-400b-bfb4-cb0e0bc4cbfd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98978cd7b70d44ffaa127bb670cb4bbb', 'request_id': 'req-4b2347b5-e839-400b-bfb4-cb0e0bc4cbfd'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:22.745331 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-4b2347b5-e839-400b-bfb4-cb0e0bc4cbfd admin admin] The token cache is being invalidate because project 98978cd7b70d44ffaa127bb670cb4bbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:25:22.745331 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-4b2347b5-e839-400b-bfb4-cb0e0bc4cbfd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:22.745651 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-d7510120-0fa8-47f7-bf6e-0ffbf68c05ba None None] MFA Rules not processed for user `7169bfbca5e8464dac9963a8a6f8dd8e`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:25:22.745778 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-4b2347b5-e839-400b-bfb4-cb0e0bc4cbfd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:22.746852 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-d7510120-0fa8-47f7-bf6e-0ffbf68c05ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:22.748035 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1091/2183] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:25:22 2022] DELETE /identity/v3/projects/98978cd7b70d44ffaa127bb670cb4bbb => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 10:25:22.755408 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a20372-f278-446f-bc13-2b7c05846b38 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:22.755805 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a20372-f278-446f-bc13-2b7c05846b38 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:22.756434 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a20372-f278-446f-bc13-2b7c05846b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:22.789047 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-05a20372-f278-446f-bc13-2b7c05846b38 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:25:22.791222 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-05a20372-f278-446f-bc13-2b7c05846b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:22.792535 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:25:22.865622 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:25:22.870332 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1093/2184] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:25:22 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:25:22.877514 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7510120-0fa8-47f7-bf6e-0ffbf68c05ba None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:22.882775 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-d7510120-0fa8-47f7-bf6e-0ffbf68c05ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:22.908275 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1092/2185] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:25:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 10:25:22.917037 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facaf08e-b36a-4cc6-82f9-bee076e866d6 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:22.917455 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facaf08e-b36a-4cc6-82f9-bee076e866d6 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:22.917831 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facaf08e-b36a-4cc6-82f9-bee076e866d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:22.955973 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-facaf08e-b36a-4cc6-82f9-bee076e866d6 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:25:22.957263 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-facaf08e-b36a-4cc6-82f9-bee076e866d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:22.969828 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1093/2186] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:25:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:25:22.970637 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facaf08e-b36a-4cc6-82f9-bee076e866d6 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:22.980821 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facaf08e-b36a-4cc6-82f9-bee076e866d6 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:22.985406 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7510120-0fa8-47f7-bf6e-0ffbf68c05ba None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:22.987286 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb0a4cb-88f2-4072-85d3-6ec074b42b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:22.988155 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb0a4cb-88f2-4072-85d3-6ec074b42b4f admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:22.988155 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb0a4cb-88f2-4072-85d3-6ec074b42b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:22.988538 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb0a4cb-88f2-4072-85d3-6ec074b42b4f admin admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:22.989060 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370e8f3f-3ff9-4040-add3-387491fd209d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6c687a38524de0bf23d87ae91d3b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:22.989198 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb0a4cb-88f2-4072-85d3-6ec074b42b4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:25:22.989391 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb0a4cb-88f2-4072-85d3-6ec074b42b4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:22.989679 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370e8f3f-3ff9-4040-add3-387491fd209d service cinder] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:22.989965 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370e8f3f-3ff9-4040-add3-387491fd209d service cinder] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:22.990234 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370e8f3f-3ff9-4040-add3-387491fd209d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:22.991086 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb0a4cb-88f2-4072-85d3-6ec074b42b4f admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:22.992081 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-370e8f3f-3ff9-4040-add3-387491fd209d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:23.010220 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1094/2187] 10.222.0.36 () {58 vars in 1153 bytes} [Tue Aug 9 10:25:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:25:23.013212 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb0a4cb-88f2-4072-85d3-6ec074b42b4f admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:23.024757 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb0a4cb-88f2-4072-85d3-6ec074b42b4f admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:23.030291 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb8b1a7-4f92-4122-9547-d0a0445d3e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:23.030949 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb8b1a7-4f92-4122-9547-d0a0445d3e19 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:23.031218 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb8b1a7-4f92-4122-9547-d0a0445d3e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:23.031491 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb8b1a7-4f92-4122-9547-d0a0445d3e19 admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:23.032105 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb8b1a7-4f92-4122-9547-d0a0445d3e19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:23.034036 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb8b1a7-4f92-4122-9547-d0a0445d3e19 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:23.064543 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1095/2188] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:25:23 2022] POST /identity/v3/projects => generated 389 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:25:23.068028 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370e8f3f-3ff9-4040-add3-387491fd209d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:23.068028 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370e8f3f-3ff9-4040-add3-387491fd209d service cinder] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:23.068887 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb8b1a7-4f92-4122-9547-d0a0445d3e19 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:23.081290 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1094/2189] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:25:22 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 10:25:23.180733 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb8b1a7-4f92-4122-9547-d0a0445d3e19 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:23.186578 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18125a03-d6c2-4923-b620-6be9358c68b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:23.187269 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18125a03-d6c2-4923-b620-6be9358c68b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:23.187609 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18125a03-d6c2-4923-b620-6be9358c68b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:23.187938 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18125a03-d6c2-4923-b620-6be9358c68b5 admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:23.188625 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18125a03-d6c2-4923-b620-6be9358c68b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:23.190845 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18125a03-d6c2-4923-b620-6be9358c68b5 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:23.221826 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1096/2190] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:25:23 2022] POST /identity/v3/users => generated 295 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 10:25:23.223042 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370e8f3f-3ff9-4040-add3-387491fd209d service cinder] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:23.235601 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370e8f3f-3ff9-4040-add3-387491fd209d service cinder] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:23.241480 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ce4632-bb11-4b7d-872d-367479222e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:23.242124 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce4632-bb11-4b7d-872d-367479222e22 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:23.242463 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce4632-bb11-4b7d-872d-367479222e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:23.243424 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce4632-bb11-4b7d-872d-367479222e22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:23.243424 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ce4632-bb11-4b7d-872d-367479222e22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:23.245344 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ce4632-bb11-4b7d-872d-367479222e22 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:23.261291 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1095/2191] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:25:23 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:25:23.266162 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18125a03-d6c2-4923-b620-6be9358c68b5 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:23.280914 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18125a03-d6c2-4923-b620-6be9358c68b5 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:23.298337 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d74dcee-191f-4f13-9b39-741fd204464a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:23.299819 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74dcee-191f-4f13-9b39-741fd204464a admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:23.300111 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74dcee-191f-4f13-9b39-741fd204464a admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:23.300390 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74dcee-191f-4f13-9b39-741fd204464a admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:23.301048 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d74dcee-191f-4f13-9b39-741fd204464a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:23.304686 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d74dcee-191f-4f13-9b39-741fd204464a admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:23.335990 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ce4632-bb11-4b7d-872d-367479222e22 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:23.344030 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1097/2192] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:25:23 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:25:23.349348 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ce4632-bb11-4b7d-872d-367479222e22 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:23.360842 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97570112-38f1-4a8d-b655-8cb9b515a8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:23.361928 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97570112-38f1-4a8d-b655-8cb9b515a8be admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:23.362222 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97570112-38f1-4a8d-b655-8cb9b515a8be admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:23.362557 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97570112-38f1-4a8d-b655-8cb9b515a8be admin admin] PATH_INFO: `/v3/projects/b474e66ded874ff5a12f90df99ebf64f/users/5a238c838354472f860707beb40e17ac/roles/a9895331e9694fa8b2b50908bb057bcb` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:23.387348 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97570112-38f1-4a8d-b655-8cb9b515a8be admin admin] RBAC: Authorizing `identity:create_grant(project_id=b474e66ded874ff5a12f90df99ebf64f, user_id=5a238c838354472f860707beb40e17ac, role_id=a9895331e9694fa8b2b50908bb057bcb)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:23.391872 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97570112-38f1-4a8d-b655-8cb9b515a8be admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:23.412670 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1096/2193] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:25:23 2022] PUT /identity/v3/projects/b474e66ded874ff5a12f90df99ebf64f/users/5a238c838354472f860707beb40e17ac/roles/a9895331e9694fa8b2b50908bb057bcb => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:25:23.426274 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f7d78-a198-4d3d-9dcb-6428a657c745 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:23.426545 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f7d78-a198-4d3d-9dcb-6428a657c745 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:23.426905 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f7d78-a198-4d3d-9dcb-6428a657c745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:23.502627 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-f77f7d78-a198-4d3d-9dcb-6428a657c745 None None] MFA Rules not processed for user `5a238c838354472f860707beb40e17ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:25:23.504183 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-f77f7d78-a198-4d3d-9dcb-6428a657c745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:23.640247 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1098/2194] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:25:23 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:25:23.656351 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97570112-38f1-4a8d-b655-8cb9b515a8be admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:23.721801 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:25:23.727892 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97570112-38f1-4a8d-b655-8cb9b515a8be admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:23.732580 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0ace1e-5610-4a43-bba5-70b557ad2b16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6c687a38524de0bf23d87ae91d3b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:23.733193 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0ace1e-5610-4a43-bba5-70b557ad2b16 service cinder] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:23.733477 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0ace1e-5610-4a43-bba5-70b557ad2b16 service cinder] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:23.733750 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0ace1e-5610-4a43-bba5-70b557ad2b16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:23.743304 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0ace1e-5610-4a43-bba5-70b557ad2b16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:23.744855 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0ace1e-5610-4a43-bba5-70b557ad2b16 service cinder] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:23.753927 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1097/2195] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:25:23 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:25:25.847410 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77f7d78-a198-4d3d-9dcb-6428a657c745 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:25.849530 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-f77f7d78-a198-4d3d-9dcb-6428a657c745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:25.860126 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:25:25.923893 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77f7d78-a198-4d3d-9dcb-6428a657c745 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:25.931364 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca6d2d5-3cdc-4cb2-b4b0-1b21eaaeb028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:25.932000 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca6d2d5-3cdc-4cb2-b4b0-1b21eaaeb028 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:25.932272 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca6d2d5-3cdc-4cb2-b4b0-1b21eaaeb028 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:25.932539 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca6d2d5-3cdc-4cb2-b4b0-1b21eaaeb028 admin admin] PATH_INFO: `/v3/users/89f0afad96474792aeb536304dddba18` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:25.933728 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca6d2d5-3cdc-4cb2-b4b0-1b21eaaeb028 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89f0afad96474792aeb536304dddba18)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:25.935690 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca6d2d5-3cdc-4cb2-b4b0-1b21eaaeb028 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:25.984837 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-eca6d2d5-3cdc-4cb2-b4b0-1b21eaaeb028 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89f0afad96474792aeb536304dddba18'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:25.999341 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-eca6d2d5-3cdc-4cb2-b4b0-1b21eaaeb028 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89f0afad96474792aeb536304dddba18'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:26.006169 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-eca6d2d5-3cdc-4cb2-b4b0-1b21eaaeb028 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89f0afad96474792aeb536304dddba18'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:26.006924 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-eca6d2d5-3cdc-4cb2-b4b0-1b21eaaeb028 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89f0afad96474792aeb536304dddba18'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:26.014993 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-eca6d2d5-3cdc-4cb2-b4b0-1b21eaaeb028 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89f0afad96474792aeb536304dddba18'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:26.022355 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1099/2196] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:25:25 2022] DELETE /identity/v3/users/89f0afad96474792aeb536304dddba18 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:25:26.027838 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6c3161-61e1-4bff-a6a9-c284be851d13 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:26.028353 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6c3161-61e1-4bff-a6a9-c284be851d13 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:26.028445 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6c3161-61e1-4bff-a6a9-c284be851d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:26.047761 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-5d6c3161-61e1-4bff-a6a9-c284be851d13 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:25:26.048960 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-5d6c3161-61e1-4bff-a6a9-c284be851d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:26.110175 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1098/2197] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:25:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:25:26.120483 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca6d2d5-3cdc-4cb2-b4b0-1b21eaaeb028 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:26.121968 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-eca6d2d5-3cdc-4cb2-b4b0-1b21eaaeb028 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:26.188813 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca6d2d5-3cdc-4cb2-b4b0-1b21eaaeb028 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:26.192473 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cffe6a-8b8f-48c1-a18f-165708d547e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:26.193075 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cffe6a-8b8f-48c1-a18f-165708d547e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:26.193353 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cffe6a-8b8f-48c1-a18f-165708d547e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:26.193624 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cffe6a-8b8f-48c1-a18f-165708d547e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:26.203872 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cffe6a-8b8f-48c1-a18f-165708d547e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:26.205317 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cffe6a-8b8f-48c1-a18f-165708d547e3 service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:26.215729 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1100/2198] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:25:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:25:26.544296 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6c3161-61e1-4bff-a6a9-c284be851d13 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:26.545946 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-5d6c3161-61e1-4bff-a6a9-c284be851d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:26.568541 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6c3161-61e1-4bff-a6a9-c284be851d13 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:26.580173 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c695b67-8ab0-4387-bd2f-b40ab6298f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:26.580817 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c695b67-8ab0-4387-bd2f-b40ab6298f42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:26.581095 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c695b67-8ab0-4387-bd2f-b40ab6298f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:26.581366 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c695b67-8ab0-4387-bd2f-b40ab6298f42 admin admin] PATH_INFO: `/v3/projects/36157d9e907340b1b48ca7c26ae3492c` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:26.584240 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c695b67-8ab0-4387-bd2f-b40ab6298f42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36157d9e907340b1b48ca7c26ae3492c)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:26.587655 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c695b67-8ab0-4387-bd2f-b40ab6298f42 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:26.679884 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-1c695b67-8ab0-4387-bd2f-b40ab6298f42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36157d9e907340b1b48ca7c26ae3492c', 'request_id': 'req-1c695b67-8ab0-4387-bd2f-b40ab6298f42'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:26.685478 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-1c695b67-8ab0-4387-bd2f-b40ab6298f42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36157d9e907340b1b48ca7c26ae3492c', 'request_id': 'req-1c695b67-8ab0-4387-bd2f-b40ab6298f42'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:26.691759 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-1c695b67-8ab0-4387-bd2f-b40ab6298f42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36157d9e907340b1b48ca7c26ae3492c', 'request_id': 'req-1c695b67-8ab0-4387-bd2f-b40ab6298f42'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:26.706405 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-1c695b67-8ab0-4387-bd2f-b40ab6298f42 admin admin] The token cache is being invalidate because project 36157d9e907340b1b48ca7c26ae3492c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80105) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:25:26.706753 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-1c695b67-8ab0-4387-bd2f-b40ab6298f42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:26.707636 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-1c695b67-8ab0-4387-bd2f-b40ab6298f42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:26.709407 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1099/2199] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:25:26 2022] DELETE /identity/v3/projects/36157d9e907340b1b48ca7c26ae3492c => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:25:26.714350 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cffe6a-8b8f-48c1-a18f-165708d547e3 service neutron] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:26.724350 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cffe6a-8b8f-48c1-a18f-165708d547e3 service neutron] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:26.758100 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:25:26.791571 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1fc9ca-656e-4d2e-9640-dd6316b6c6db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:26.792208 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1fc9ca-656e-4d2e-9640-dd6316b6c6db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:26.792486 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1fc9ca-656e-4d2e-9640-dd6316b6c6db admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:26.792758 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1fc9ca-656e-4d2e-9640-dd6316b6c6db admin admin] PATH_INFO: `/v3/users/7169bfbca5e8464dac9963a8a6f8dd8e` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:26.793917 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1fc9ca-656e-4d2e-9640-dd6316b6c6db admin admin] RBAC: Authorizing `identity:delete_user(user_id=7169bfbca5e8464dac9963a8a6f8dd8e)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:26.795831 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1fc9ca-656e-4d2e-9640-dd6316b6c6db admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:26.854438 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-3e1fc9ca-656e-4d2e-9640-dd6316b6c6db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7169bfbca5e8464dac9963a8a6f8dd8e'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:26.869658 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-3e1fc9ca-656e-4d2e-9640-dd6316b6c6db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7169bfbca5e8464dac9963a8a6f8dd8e'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:26.879538 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-3e1fc9ca-656e-4d2e-9640-dd6316b6c6db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7169bfbca5e8464dac9963a8a6f8dd8e'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:26.880328 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-3e1fc9ca-656e-4d2e-9640-dd6316b6c6db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7169bfbca5e8464dac9963a8a6f8dd8e'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:26.887872 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-3e1fc9ca-656e-4d2e-9640-dd6316b6c6db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7169bfbca5e8464dac9963a8a6f8dd8e'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:26.893945 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1101/2200] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:25:26 2022] DELETE /identity/v3/users/7169bfbca5e8464dac9963a8a6f8dd8e => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:25:27.279388 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c695b67-8ab0-4387-bd2f-b40ab6298f42 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:27.280849 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-1c695b67-8ab0-4387-bd2f-b40ab6298f42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:27.297114 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c695b67-8ab0-4387-bd2f-b40ab6298f42 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:27.359093 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2395713-561b-47e3-a42f-faf59f3d2883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:27.359891 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2395713-561b-47e3-a42f-faf59f3d2883 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:27.360175 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2395713-561b-47e3-a42f-faf59f3d2883 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:27.360449 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2395713-561b-47e3-a42f-faf59f3d2883 admin admin] PATH_INFO: `/v3/projects/dfc5e55707384eeeaeadfde3f478c47e` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:27.361612 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2395713-561b-47e3-a42f-faf59f3d2883 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfc5e55707384eeeaeadfde3f478c47e)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:27.363562 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2395713-561b-47e3-a42f-faf59f3d2883 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:27.382216 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:25:27.424941 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-c2395713-561b-47e3-a42f-faf59f3d2883 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfc5e55707384eeeaeadfde3f478c47e', 'request_id': 'req-c2395713-561b-47e3-a42f-faf59f3d2883'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:27.431390 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-c2395713-561b-47e3-a42f-faf59f3d2883 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfc5e55707384eeeaeadfde3f478c47e', 'request_id': 'req-c2395713-561b-47e3-a42f-faf59f3d2883'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:27.437556 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-c2395713-561b-47e3-a42f-faf59f3d2883 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfc5e55707384eeeaeadfde3f478c47e', 'request_id': 'req-c2395713-561b-47e3-a42f-faf59f3d2883'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:27.451303 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-c2395713-561b-47e3-a42f-faf59f3d2883 admin admin] The token cache is being invalidate because project dfc5e55707384eeeaeadfde3f478c47e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80105) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:25:27.451594 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-c2395713-561b-47e3-a42f-faf59f3d2883 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:27.452231 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-c2395713-561b-47e3-a42f-faf59f3d2883 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:27.453740 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1100/2201] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:25:27 2022] DELETE /identity/v3/projects/dfc5e55707384eeeaeadfde3f478c47e => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:25:27.458961 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe7eef9-d0f0-4259-a102-5b74d4746e88 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:27.459241 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe7eef9-d0f0-4259-a102-5b74d4746e88 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:27.459507 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe7eef9-d0f0-4259-a102-5b74d4746e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:27.479580 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-6fe7eef9-d0f0-4259-a102-5b74d4746e88 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:25:27.480803 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-6fe7eef9-d0f0-4259-a102-5b74d4746e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:27.542050 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1102/2202] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:25:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 10:25:27.551403 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b77559a-b3ff-484d-ad7c-ec0196325f52 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:27.551863 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b77559a-b3ff-484d-ad7c-ec0196325f52 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:27.552139 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b77559a-b3ff-484d-ad7c-ec0196325f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:27.575274 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-2b77559a-b3ff-484d-ad7c-ec0196325f52 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:25:27.576522 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-2b77559a-b3ff-484d-ad7c-ec0196325f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:27.584463 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1101/2203] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:25:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:25:27.588901 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe7eef9-d0f0-4259-a102-5b74d4746e88 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:27.598490 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe7eef9-d0f0-4259-a102-5b74d4746e88 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:27.603964 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdf9053-0bf8-4386-bf85-0a12dd62d492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:27.604565 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf9053-0bf8-4386-bf85-0a12dd62d492 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:27.604847 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf9053-0bf8-4386-bf85-0a12dd62d492 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:27.605122 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf9053-0bf8-4386-bf85-0a12dd62d492 admin admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:27.605774 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdf9053-0bf8-4386-bf85-0a12dd62d492 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:25:27.606121 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdf9053-0bf8-4386-bf85-0a12dd62d492 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:27.607721 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdf9053-0bf8-4386-bf85-0a12dd62d492 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:27.620077 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1103/2204] 10.222.0.36 () {58 vars in 1153 bytes} [Tue Aug 9 10:25:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:25:27.625446 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b77559a-b3ff-484d-ad7c-ec0196325f52 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:27.638105 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b77559a-b3ff-484d-ad7c-ec0196325f52 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:27.643930 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83aaf93-0fce-4276-a469-ab8cb2e396fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:27.644803 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83aaf93-0fce-4276-a469-ab8cb2e396fa admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:27.644936 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83aaf93-0fce-4276-a469-ab8cb2e396fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:27.645258 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83aaf93-0fce-4276-a469-ab8cb2e396fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:27.645990 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83aaf93-0fce-4276-a469-ab8cb2e396fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:27.647994 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83aaf93-0fce-4276-a469-ab8cb2e396fa admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:27.693116 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1102/2205] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:25:27 2022] POST /identity/v3/projects => generated 385 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:25:27.695027 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdf9053-0bf8-4386-bf85-0a12dd62d492 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:27.695620 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83aaf93-0fce-4276-a469-ab8cb2e396fa admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:27.697601 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-d83aaf93-0fce-4276-a469-ab8cb2e396fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:27.705706 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdf9053-0bf8-4386-bf85-0a12dd62d492 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:27.740657 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:25:27.774316 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83aaf93-0fce-4276-a469-ab8cb2e396fa admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:27.780807 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb760a41-a8c2-4181-93c1-34c39771fc21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:27.781001 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb760a41-a8c2-4181-93c1-34c39771fc21 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:27.781192 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb760a41-a8c2-4181-93c1-34c39771fc21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:27.781468 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb760a41-a8c2-4181-93c1-34c39771fc21 admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:27.782132 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb760a41-a8c2-4181-93c1-34c39771fc21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:27.784065 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb760a41-a8c2-4181-93c1-34c39771fc21 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:27.786210 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5498ad-fb44-4269-bfa4-052de466df0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:27.787196 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5498ad-fb44-4269-bfa4-052de466df0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:27.787579 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5498ad-fb44-4269-bfa4-052de466df0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:27.788005 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5498ad-fb44-4269-bfa4-052de466df0b admin admin] PATH_INFO: `/v3/users/25a53e70d6cb4a15a2f71719b82cca77` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:27.790128 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5498ad-fb44-4269-bfa4-052de466df0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=25a53e70d6cb4a15a2f71719b82cca77)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:27.792632 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5498ad-fb44-4269-bfa4-052de466df0b admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:27.826160 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1104/2206] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:25:27 2022] POST /identity/v3/users => generated 293 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:25:27.829391 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb760a41-a8c2-4181-93c1-34c39771fc21 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:27.845520 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb760a41-a8c2-4181-93c1-34c39771fc21 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:27.850997 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7cc7b9-2562-482d-ad21-f91f8191c1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:27.851710 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7cc7b9-2562-482d-ad21-f91f8191c1aa admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:27.852193 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7cc7b9-2562-482d-ad21-f91f8191c1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:27.852435 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7cc7b9-2562-482d-ad21-f91f8191c1aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:27.853174 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7cc7b9-2562-482d-ad21-f91f8191c1aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:27.855138 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7cc7b9-2562-482d-ad21-f91f8191c1aa admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:27.869241 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1105/2207] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:25:27 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:25:27.873217 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7cc7b9-2562-482d-ad21-f91f8191c1aa admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:27.885707 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-2b5498ad-fb44-4269-bfa4-052de466df0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25a53e70d6cb4a15a2f71719b82cca77'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:27.890720 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7cc7b9-2562-482d-ad21-f91f8191c1aa admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:27.897919 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867c210b-42d3-4bcc-a850-32d72f2abbcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:27.899501 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867c210b-42d3-4bcc-a850-32d72f2abbcb admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:27.900205 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867c210b-42d3-4bcc-a850-32d72f2abbcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:27.900622 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867c210b-42d3-4bcc-a850-32d72f2abbcb admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:27.901668 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867c210b-42d3-4bcc-a850-32d72f2abbcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:27.904070 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867c210b-42d3-4bcc-a850-32d72f2abbcb admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:27.904668 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-2b5498ad-fb44-4269-bfa4-052de466df0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25a53e70d6cb4a15a2f71719b82cca77'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:27.916351 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-2b5498ad-fb44-4269-bfa4-052de466df0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25a53e70d6cb4a15a2f71719b82cca77'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:27.917255 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-2b5498ad-fb44-4269-bfa4-052de466df0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25a53e70d6cb4a15a2f71719b82cca77'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:27.920177 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1106/2208] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:25:27 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:25:27.925967 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:25:27.927763 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867c210b-42d3-4bcc-a850-32d72f2abbcb admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:27.931844 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-2b5498ad-fb44-4269-bfa4-052de466df0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25a53e70d6cb4a15a2f71719b82cca77'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:27.943789 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867c210b-42d3-4bcc-a850-32d72f2abbcb admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:27.952476 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b9ec2e-96b5-428a-bd4e-aa2460222543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:27.953274 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b9ec2e-96b5-428a-bd4e-aa2460222543 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:27.953552 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b9ec2e-96b5-428a-bd4e-aa2460222543 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:27.953825 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b9ec2e-96b5-428a-bd4e-aa2460222543 admin admin] PATH_INFO: `/v3/projects/16fb8774ffc3411bb5444d5bb90998f6/users/43020346e4664c41baa23fc95496b35b/roles/a9895331e9694fa8b2b50908bb057bcb` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:27.958694 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1103/2209] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:25:27 2022] DELETE /identity/v3/users/25a53e70d6cb4a15a2f71719b82cca77 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:25:27.966253 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e6dd43-755b-4e1c-bcd8-4e25461be4b5 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:27.966729 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e6dd43-755b-4e1c-bcd8-4e25461be4b5 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:27.967066 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e6dd43-755b-4e1c-bcd8-4e25461be4b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:27.983442 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b9ec2e-96b5-428a-bd4e-aa2460222543 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16fb8774ffc3411bb5444d5bb90998f6, user_id=43020346e4664c41baa23fc95496b35b, role_id=a9895331e9694fa8b2b50908bb057bcb)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:27.988661 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b9ec2e-96b5-428a-bd4e-aa2460222543 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:27.995541 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-b4e6dd43-755b-4e1c-bcd8-4e25461be4b5 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:25:27.997224 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-b4e6dd43-755b-4e1c-bcd8-4e25461be4b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:28.020779 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1107/2210] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:25:27 2022] PUT /identity/v3/projects/16fb8774ffc3411bb5444d5bb90998f6/users/43020346e4664c41baa23fc95496b35b/roles/a9895331e9694fa8b2b50908bb057bcb => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:25:28.026164 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc26503e-f3e1-464c-aba9-d594bcdab0ea None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:28.027107 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc26503e-f3e1-464c-aba9-d594bcdab0ea None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:28.029345 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc26503e-f3e1-464c-aba9-d594bcdab0ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:28.068106 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-fc26503e-f3e1-464c-aba9-d594bcdab0ea None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:25:28.069500 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-fc26503e-f3e1-464c-aba9-d594bcdab0ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:28.120256 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1104/2211] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:25:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:25:28.134607 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e6dd43-755b-4e1c-bcd8-4e25461be4b5 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:28.137518 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-b4e6dd43-755b-4e1c-bcd8-4e25461be4b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:28.161232 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1108/2212] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:25:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:25:28.175527 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc26503e-f3e1-464c-aba9-d594bcdab0ea None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:28.177091 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-fc26503e-f3e1-464c-aba9-d594bcdab0ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:28.214798 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e6dd43-755b-4e1c-bcd8-4e25461be4b5 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:28.273297 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc26503e-f3e1-464c-aba9-d594bcdab0ea None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:28.277285 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d07dc04-9bf7-4f52-8a08-89450e3e8d6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:28.277923 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d07dc04-9bf7-4f52-8a08-89450e3e8d6c service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:28.278200 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d07dc04-9bf7-4f52-8a08-89450e3e8d6c service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:28.278473 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d07dc04-9bf7-4f52-8a08-89450e3e8d6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:28.296995 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d07dc04-9bf7-4f52-8a08-89450e3e8d6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:28.298540 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d07dc04-9bf7-4f52-8a08-89450e3e8d6c service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:28.301049 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2255e6b8-fdd8-4aca-b3e1-dd4e3e3fb294 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:28.301672 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2255e6b8-fdd8-4aca-b3e1-dd4e3e3fb294 service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:28.301981 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2255e6b8-fdd8-4aca-b3e1-dd4e3e3fb294 service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:28.302256 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2255e6b8-fdd8-4aca-b3e1-dd4e3e3fb294 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:28.310054 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1109/2213] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:25:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 10:25:28.318822 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2255e6b8-fdd8-4aca-b3e1-dd4e3e3fb294 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:28.320361 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2255e6b8-fdd8-4aca-b3e1-dd4e3e3fb294 service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:28.334921 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1105/2214] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:25:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 10:25:28.718662 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d07dc04-9bf7-4f52-8a08-89450e3e8d6c service neutron] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:28.721690 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-6d07dc04-9bf7-4f52-8a08-89450e3e8d6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:28.752146 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d07dc04-9bf7-4f52-8a08-89450e3e8d6c service neutron] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:28.758995 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3d8625-9fd0-4ff8-9e01-1a604ae99f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:28.759810 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d8625-9fd0-4ff8-9e01-1a604ae99f51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:28.760259 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d8625-9fd0-4ff8-9e01-1a604ae99f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:28.760701 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d8625-9fd0-4ff8-9e01-1a604ae99f51 admin admin] PATH_INFO: `/v3/projects/82a016a6907b47fab6968db4797183c5` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:28.762054 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3d8625-9fd0-4ff8-9e01-1a604ae99f51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82a016a6907b47fab6968db4797183c5)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:28.764509 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3d8625-9fd0-4ff8-9e01-1a604ae99f51 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:28.800143 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:25:28.875509 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-ae3d8625-9fd0-4ff8-9e01-1a604ae99f51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82a016a6907b47fab6968db4797183c5', 'request_id': 'req-ae3d8625-9fd0-4ff8-9e01-1a604ae99f51'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:28.882133 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-ae3d8625-9fd0-4ff8-9e01-1a604ae99f51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82a016a6907b47fab6968db4797183c5', 'request_id': 'req-ae3d8625-9fd0-4ff8-9e01-1a604ae99f51'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:28.892476 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-ae3d8625-9fd0-4ff8-9e01-1a604ae99f51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82a016a6907b47fab6968db4797183c5', 'request_id': 'req-ae3d8625-9fd0-4ff8-9e01-1a604ae99f51'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:28.906595 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-ae3d8625-9fd0-4ff8-9e01-1a604ae99f51 admin admin] The token cache is being invalidate because project 82a016a6907b47fab6968db4797183c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:25:28.907105 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-ae3d8625-9fd0-4ff8-9e01-1a604ae99f51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:28.907846 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-ae3d8625-9fd0-4ff8-9e01-1a604ae99f51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:28.909427 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1110/2215] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:25:28 2022] DELETE /identity/v3/projects/82a016a6907b47fab6968db4797183c5 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:25:28.916009 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb601b8-a6b3-4459-87bc-7d05a751dd1e None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:28.916385 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb601b8-a6b3-4459-87bc-7d05a751dd1e None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:28.916657 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb601b8-a6b3-4459-87bc-7d05a751dd1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:28.937149 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-edb601b8-a6b3-4459-87bc-7d05a751dd1e None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:25:28.938389 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-edb601b8-a6b3-4459-87bc-7d05a751dd1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:28.999783 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:25:29.013024 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1106/2216] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:25:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 10:25:29.021074 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed4a7d6-59af-45f8-ae76-42d355bf0f82 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:29.021411 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed4a7d6-59af-45f8-ae76-42d355bf0f82 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:29.021637 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed4a7d6-59af-45f8-ae76-42d355bf0f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:29.044082 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-4ed4a7d6-59af-45f8-ae76-42d355bf0f82 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:25:29.045357 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-4ed4a7d6-59af-45f8-ae76-42d355bf0f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:29.054417 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1111/2217] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:25:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:25:29.058510 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb601b8-a6b3-4459-87bc-7d05a751dd1e None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:29.073441 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb601b8-a6b3-4459-87bc-7d05a751dd1e None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:29.082456 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4ffedc-b97d-4b0e-87d4-48c56a4a0341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:29.083144 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4ffedc-b97d-4b0e-87d4-48c56a4a0341 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:29.083459 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4ffedc-b97d-4b0e-87d4-48c56a4a0341 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:29.083734 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4ffedc-b97d-4b0e-87d4-48c56a4a0341 admin admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:29.084424 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4ffedc-b97d-4b0e-87d4-48c56a4a0341 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:25:29.084737 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4ffedc-b97d-4b0e-87d4-48c56a4a0341 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:29.086942 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4ffedc-b97d-4b0e-87d4-48c56a4a0341 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:29.111596 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1107/2218] 10.222.0.36 () {58 vars in 1153 bytes} [Tue Aug 9 10:25:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:25:29.115145 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed4a7d6-59af-45f8-ae76-42d355bf0f82 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:29.136624 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed4a7d6-59af-45f8-ae76-42d355bf0f82 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:29.150708 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd73ca4e-15b5-41a7-b27c-08d3623d414a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:29.152836 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd73ca4e-15b5-41a7-b27c-08d3623d414a admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:29.154355 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd73ca4e-15b5-41a7-b27c-08d3623d414a admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:29.159196 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd73ca4e-15b5-41a7-b27c-08d3623d414a admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:29.160100 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd73ca4e-15b5-41a7-b27c-08d3623d414a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:29.162552 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd73ca4e-15b5-41a7-b27c-08d3623d414a admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:29.206740 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1112/2219] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:25:29 2022] POST /identity/v3/projects => generated 369 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:25:29.211965 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4ffedc-b97d-4b0e-87d4-48c56a4a0341 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:29.225793 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4ffedc-b97d-4b0e-87d4-48c56a4a0341 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:29.324760 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6813bbad-571e-4225-b3ad-d06828a0fe59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:29.326971 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6813bbad-571e-4225-b3ad-d06828a0fe59 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:29.327431 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6813bbad-571e-4225-b3ad-d06828a0fe59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:29.327857 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6813bbad-571e-4225-b3ad-d06828a0fe59 admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:29.329016 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6813bbad-571e-4225-b3ad-d06828a0fe59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:29.332174 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6813bbad-571e-4225-b3ad-d06828a0fe59 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:29.367156 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1108/2220] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:25:29 2022] POST /identity/v3/users => generated 285 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 10:25:29.369000 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd73ca4e-15b5-41a7-b27c-08d3623d414a admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:29.388912 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd73ca4e-15b5-41a7-b27c-08d3623d414a admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:29.415019 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6376b14a-5783-4ac7-aed8-fdad07ac7dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:29.419273 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6376b14a-5783-4ac7-aed8-fdad07ac7dfe admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:29.419410 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6376b14a-5783-4ac7-aed8-fdad07ac7dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:29.420694 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6376b14a-5783-4ac7-aed8-fdad07ac7dfe admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:29.424008 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6376b14a-5783-4ac7-aed8-fdad07ac7dfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:29.431755 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6376b14a-5783-4ac7-aed8-fdad07ac7dfe admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:29.458676 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1113/2221] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:25:29 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:25:29.465103 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6813bbad-571e-4225-b3ad-d06828a0fe59 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:29.477935 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6813bbad-571e-4225-b3ad-d06828a0fe59 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:29.495173 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f23757f-83bb-49ee-8d66-be95b51df50b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:29.495939 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f23757f-83bb-49ee-8d66-be95b51df50b admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:29.496335 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f23757f-83bb-49ee-8d66-be95b51df50b admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:29.496967 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f23757f-83bb-49ee-8d66-be95b51df50b admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:29.497722 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f23757f-83bb-49ee-8d66-be95b51df50b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:29.499676 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f23757f-83bb-49ee-8d66-be95b51df50b admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:29.515128 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1109/2222] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:25:29 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:25:29.519102 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6376b14a-5783-4ac7-aed8-fdad07ac7dfe admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:29.544940 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6376b14a-5783-4ac7-aed8-fdad07ac7dfe admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:29.558600 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab2cc56-fd5e-410f-aced-7c886df8a8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:29.558600 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab2cc56-fd5e-410f-aced-7c886df8a8d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:29.558600 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab2cc56-fd5e-410f-aced-7c886df8a8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:29.558600 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab2cc56-fd5e-410f-aced-7c886df8a8d7 admin admin] PATH_INFO: `/v3/projects/9bae32aaa65e4d0288d3187cf14bccb5/users/9ff4fa7b3dbd4642bc0f2edb60abfbc3/roles/a9895331e9694fa8b2b50908bb057bcb` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:29.587863 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab2cc56-fd5e-410f-aced-7c886df8a8d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bae32aaa65e4d0288d3187cf14bccb5, user_id=9ff4fa7b3dbd4642bc0f2edb60abfbc3, role_id=a9895331e9694fa8b2b50908bb057bcb)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:29.591916 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab2cc56-fd5e-410f-aced-7c886df8a8d7 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:29.630722 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1114/2223] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:25:29 2022] PUT /identity/v3/projects/9bae32aaa65e4d0288d3187cf14bccb5/users/9ff4fa7b3dbd4642bc0f2edb60abfbc3/roles/a9895331e9694fa8b2b50908bb057bcb => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:25:29.639292 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b4c821-8a53-4a51-96fc-cea47e155df2 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:29.639719 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b4c821-8a53-4a51-96fc-cea47e155df2 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:29.640656 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b4c821-8a53-4a51-96fc-cea47e155df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:29.700916 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-28b4c821-8a53-4a51-96fc-cea47e155df2 None None] MFA Rules not processed for user `9ff4fa7b3dbd4642bc0f2edb60abfbc3`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:25:29.702530 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-28b4c821-8a53-4a51-96fc-cea47e155df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:29.824258 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1110/2224] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:25:29 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:25:29.832437 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab2cc56-fd5e-410f-aced-7c886df8a8d7 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:29.834901 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-dab2cc56-fd5e-410f-aced-7c886df8a8d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:29.932970 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab2cc56-fd5e-410f-aced-7c886df8a8d7 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:29.962335 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be124f1-255f-4db1-8793-cf6458cb8c33 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07540b72afd34927855c41db09a7b030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:29.963138 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be124f1-255f-4db1-8793-cf6458cb8c33 service glance] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:29.966084 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be124f1-255f-4db1-8793-cf6458cb8c33 service glance] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:29.966505 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be124f1-255f-4db1-8793-cf6458cb8c33 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:29.995907 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be124f1-255f-4db1-8793-cf6458cb8c33 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:29.997371 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be124f1-255f-4db1-8793-cf6458cb8c33 service glance] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:30.017924 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1115/2225] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:25:29 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:25:32.259311 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b4c821-8a53-4a51-96fc-cea47e155df2 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:32.260959 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-28b4c821-8a53-4a51-96fc-cea47e155df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:32.319938 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:25:32.346336 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b4c821-8a53-4a51-96fc-cea47e155df2 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:32.353211 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fe6b44-0dc0-44a7-b953-ff7886e68c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:32.354305 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe6b44-0dc0-44a7-b953-ff7886e68c7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:32.354802 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe6b44-0dc0-44a7-b953-ff7886e68c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:32.355357 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe6b44-0dc0-44a7-b953-ff7886e68c7d admin admin] PATH_INFO: `/v3/users/075991ab4a1141ffb6532896b56b4ed7` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:32.356959 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fe6b44-0dc0-44a7-b953-ff7886e68c7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=075991ab4a1141ffb6532896b56b4ed7)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:32.359082 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fe6b44-0dc0-44a7-b953-ff7886e68c7d admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:32.444247 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-64fe6b44-0dc0-44a7-b953-ff7886e68c7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '075991ab4a1141ffb6532896b56b4ed7'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:32.488599 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-64fe6b44-0dc0-44a7-b953-ff7886e68c7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '075991ab4a1141ffb6532896b56b4ed7'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:32.502911 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-64fe6b44-0dc0-44a7-b953-ff7886e68c7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '075991ab4a1141ffb6532896b56b4ed7'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:32.504836 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-64fe6b44-0dc0-44a7-b953-ff7886e68c7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '075991ab4a1141ffb6532896b56b4ed7'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:32.516508 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-64fe6b44-0dc0-44a7-b953-ff7886e68c7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '075991ab4a1141ffb6532896b56b4ed7'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:32.524797 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1111/2226] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:25:32 2022] DELETE /identity/v3/users/075991ab4a1141ffb6532896b56b4ed7 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:25:32.529636 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003e229-5512-4732-a5f9-b3897f5b499f None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:32.530522 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003e229-5512-4732-a5f9-b3897f5b499f None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:32.530996 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003e229-5512-4732-a5f9-b3897f5b499f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:32.561948 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-f003e229-5512-4732-a5f9-b3897f5b499f None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:25:32.563349 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-f003e229-5512-4732-a5f9-b3897f5b499f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:32.652207 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:25:32.692449 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1116/2227] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:25:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:25:32.720974 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fe6b44-0dc0-44a7-b953-ff7886e68c7d admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:32.725886 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-64fe6b44-0dc0-44a7-b953-ff7886e68c7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:32.865213 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fe6b44-0dc0-44a7-b953-ff7886e68c7d admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:32.875886 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b17f288-fd5d-4337-8a57-3d9476bb769f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:32.875886 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b17f288-fd5d-4337-8a57-3d9476bb769f service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:32.875886 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b17f288-fd5d-4337-8a57-3d9476bb769f service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:32.875886 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b17f288-fd5d-4337-8a57-3d9476bb769f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:32.891982 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b17f288-fd5d-4337-8a57-3d9476bb769f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:32.894915 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b17f288-fd5d-4337-8a57-3d9476bb769f service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:32.912853 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1112/2228] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:25:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:25:33.526867 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f003e229-5512-4732-a5f9-b3897f5b499f None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:33.533815 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-f003e229-5512-4732-a5f9-b3897f5b499f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:33.575787 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f003e229-5512-4732-a5f9-b3897f5b499f None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:33.583920 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c850959d-e582-42f2-ae9a-ef234ae69616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:33.584576 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c850959d-e582-42f2-ae9a-ef234ae69616 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:33.584884 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c850959d-e582-42f2-ae9a-ef234ae69616 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:33.585323 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c850959d-e582-42f2-ae9a-ef234ae69616 admin admin] PATH_INFO: `/v3/projects/66f2b7f88ede4466aec2f211809e0318` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:33.586719 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c850959d-e582-42f2-ae9a-ef234ae69616 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66f2b7f88ede4466aec2f211809e0318)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:33.588901 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c850959d-e582-42f2-ae9a-ef234ae69616 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:33.731136 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-c850959d-e582-42f2-ae9a-ef234ae69616 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66f2b7f88ede4466aec2f211809e0318', 'request_id': 'req-c850959d-e582-42f2-ae9a-ef234ae69616'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:33.746585 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-c850959d-e582-42f2-ae9a-ef234ae69616 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66f2b7f88ede4466aec2f211809e0318', 'request_id': 'req-c850959d-e582-42f2-ae9a-ef234ae69616'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:33.765969 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-c850959d-e582-42f2-ae9a-ef234ae69616 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66f2b7f88ede4466aec2f211809e0318', 'request_id': 'req-c850959d-e582-42f2-ae9a-ef234ae69616'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:33.786207 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-c850959d-e582-42f2-ae9a-ef234ae69616 admin admin] The token cache is being invalidate because project 66f2b7f88ede4466aec2f211809e0318 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:25:33.788236 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-c850959d-e582-42f2-ae9a-ef234ae69616 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:33.789579 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-c850959d-e582-42f2-ae9a-ef234ae69616 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:33.792298 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1117/2229] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:25:33 2022] DELETE /identity/v3/projects/66f2b7f88ede4466aec2f211809e0318 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:25:33.796968 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222e8093-6f39-4ff0-b8e3-8cb6176e87f4 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:33.797413 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222e8093-6f39-4ff0-b8e3-8cb6176e87f4 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:33.797501 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222e8093-6f39-4ff0-b8e3-8cb6176e87f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:33.851152 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-222e8093-6f39-4ff0-b8e3-8cb6176e87f4 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:25:33.861439 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-222e8093-6f39-4ff0-b8e3-8cb6176e87f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:34.028301 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1113/2230] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:25:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:25:34.038817 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad4091d-e69c-4e77-99bd-1eb8340c5786 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:34.039325 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad4091d-e69c-4e77-99bd-1eb8340c5786 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:34.040198 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad4091d-e69c-4e77-99bd-1eb8340c5786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:34.081685 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-3ad4091d-e69c-4e77-99bd-1eb8340c5786 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:25:34.083128 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-3ad4091d-e69c-4e77-99bd-1eb8340c5786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:34.106035 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1118/2231] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:25:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:25:34.110470 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222e8093-6f39-4ff0-b8e3-8cb6176e87f4 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:34.124381 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222e8093-6f39-4ff0-b8e3-8cb6176e87f4 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:34.130137 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d3cec9-4c10-4474-b995-1feab6eb4f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:34.131460 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d3cec9-4c10-4474-b995-1feab6eb4f05 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:34.132490 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d3cec9-4c10-4474-b995-1feab6eb4f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:34.133522 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d3cec9-4c10-4474-b995-1feab6eb4f05 admin admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:34.134945 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d3cec9-4c10-4474-b995-1feab6eb4f05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:25:34.135408 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d3cec9-4c10-4474-b995-1feab6eb4f05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:34.137186 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d3cec9-4c10-4474-b995-1feab6eb4f05 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:34.150112 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:25:34.156229 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1114/2232] 10.222.0.36 () {58 vars in 1153 bytes} [Tue Aug 9 10:25:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:25:34.161120 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad4091d-e69c-4e77-99bd-1eb8340c5786 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:34.172545 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad4091d-e69c-4e77-99bd-1eb8340c5786 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:34.179069 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bb2856-95a6-4015-a1e7-3a67a8a30ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:34.180719 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb2856-95a6-4015-a1e7-3a67a8a30ab3 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:34.181254 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb2856-95a6-4015-a1e7-3a67a8a30ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:34.181681 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb2856-95a6-4015-a1e7-3a67a8a30ab3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:34.182484 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bb2856-95a6-4015-a1e7-3a67a8a30ab3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:34.184701 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bb2856-95a6-4015-a1e7-3a67a8a30ab3 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:34.262783 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1119/2233] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:25:34 2022] POST /identity/v3/projects => generated 385 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:25:34.268566 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d3cec9-4c10-4474-b995-1feab6eb4f05 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:34.282215 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d3cec9-4c10-4474-b995-1feab6eb4f05 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:34.381342 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd2fba7-a65c-4e25-b01b-216f0ef52a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:34.382121 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd2fba7-a65c-4e25-b01b-216f0ef52a38 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:34.382738 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd2fba7-a65c-4e25-b01b-216f0ef52a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:34.383445 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd2fba7-a65c-4e25-b01b-216f0ef52a38 admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:34.383715 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd2fba7-a65c-4e25-b01b-216f0ef52a38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:34.386603 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd2fba7-a65c-4e25-b01b-216f0ef52a38 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:34.433181 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1115/2234] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:25:34 2022] POST /identity/v3/users => generated 293 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:25:34.435882 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bb2856-95a6-4015-a1e7-3a67a8a30ab3 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:34.449081 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bb2856-95a6-4015-a1e7-3a67a8a30ab3 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:34.454393 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfa2b15-59e2-4801-9e08-03f3059131e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:34.455525 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa2b15-59e2-4801-9e08-03f3059131e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:34.456023 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa2b15-59e2-4801-9e08-03f3059131e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:34.456530 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa2b15-59e2-4801-9e08-03f3059131e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:34.457254 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfa2b15-59e2-4801-9e08-03f3059131e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:34.459036 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfa2b15-59e2-4801-9e08-03f3059131e8 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:34.473404 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1120/2235] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:25:34 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:25:34.478326 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd2fba7-a65c-4e25-b01b-216f0ef52a38 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:34.491561 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd2fba7-a65c-4e25-b01b-216f0ef52a38 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:34.513704 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7648e0ee-f7bc-4510-a3c0-8508efb73454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:34.514459 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7648e0ee-f7bc-4510-a3c0-8508efb73454 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:34.514825 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7648e0ee-f7bc-4510-a3c0-8508efb73454 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:34.515158 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7648e0ee-f7bc-4510-a3c0-8508efb73454 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:34.515946 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7648e0ee-f7bc-4510-a3c0-8508efb73454 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:34.525909 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7648e0ee-f7bc-4510-a3c0-8508efb73454 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:34.577309 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1116/2236] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:25:34 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:25:34.581696 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfa2b15-59e2-4801-9e08-03f3059131e8 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:34.596764 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfa2b15-59e2-4801-9e08-03f3059131e8 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:34.611413 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772c4656-3540-4ed7-a6f4-df73213ce012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:34.612086 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772c4656-3540-4ed7-a6f4-df73213ce012 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:34.612531 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772c4656-3540-4ed7-a6f4-df73213ce012 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:34.612990 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772c4656-3540-4ed7-a6f4-df73213ce012 admin admin] PATH_INFO: `/v3/projects/7aeed51ee1d740508e53be844e1ac67c/users/370e4bd84abb4f58af6a2ceae69d9ac5/roles/a9895331e9694fa8b2b50908bb057bcb` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:34.661149 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772c4656-3540-4ed7-a6f4-df73213ce012 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7aeed51ee1d740508e53be844e1ac67c, user_id=370e4bd84abb4f58af6a2ceae69d9ac5, role_id=a9895331e9694fa8b2b50908bb057bcb)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:34.666827 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772c4656-3540-4ed7-a6f4-df73213ce012 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:34.689297 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1121/2237] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:25:34 2022] PUT /identity/v3/projects/7aeed51ee1d740508e53be844e1ac67c/users/370e4bd84abb4f58af6a2ceae69d9ac5/roles/a9895331e9694fa8b2b50908bb057bcb => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:25:34.702602 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e6822-84da-47b0-936f-2f91d06c2a03 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:34.702947 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e6822-84da-47b0-936f-2f91d06c2a03 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:34.703227 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e6822-84da-47b0-936f-2f91d06c2a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:34.775448 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-f15e6822-84da-47b0-936f-2f91d06c2a03 None None] MFA Rules not processed for user `370e4bd84abb4f58af6a2ceae69d9ac5`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:25:34.776822 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-f15e6822-84da-47b0-936f-2f91d06c2a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:34.908902 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1117/2238] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:25:34 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:25:34.910069 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772c4656-3540-4ed7-a6f4-df73213ce012 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:34.936971 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15e6822-84da-47b0-936f-2f91d06c2a03 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:34.938539 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-f15e6822-84da-47b0-936f-2f91d06c2a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:35.124568 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15e6822-84da-47b0-936f-2f91d06c2a03 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:35.138897 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772c4656-3540-4ed7-a6f4-df73213ce012 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:35.147066 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d98efd-0906-4708-9f28-bc581551ff8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:35.148537 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c5beb1-f288-4917-be45-e13ef1ddadd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:35.149596 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c5beb1-f288-4917-be45-e13ef1ddadd6 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:35.149994 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c5beb1-f288-4917-be45-e13ef1ddadd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:35.150282 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c5beb1-f288-4917-be45-e13ef1ddadd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:35.150983 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c5beb1-f288-4917-be45-e13ef1ddadd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:35.152076 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d98efd-0906-4708-9f28-bc581551ff8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:35.152656 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d98efd-0906-4708-9f28-bc581551ff8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:35.152929 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d98efd-0906-4708-9f28-bc581551ff8e admin admin] PATH_INFO: `/v3/users/5a238c838354472f860707beb40e17ac` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:35.154787 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d98efd-0906-4708-9f28-bc581551ff8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a238c838354472f860707beb40e17ac)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:35.155986 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c5beb1-f288-4917-be45-e13ef1ddadd6 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:35.158240 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d98efd-0906-4708-9f28-bc581551ff8e admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:35.169061 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:25:35.193262 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:25:35.211458 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1122/2239] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:25:34 2022] POST /identity/v3/projects => generated 385 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 10:25:35.212906 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fd3691-b6f0-40d7-82e1-f5616f5213e1 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:35.213194 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fd3691-b6f0-40d7-82e1-f5616f5213e1 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:35.213592 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fd3691-b6f0-40d7-82e1-f5616f5213e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:35.254632 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-b4fd3691-b6f0-40d7-82e1-f5616f5213e1 None None] MFA Rules not processed for user `43020346e4664c41baa23fc95496b35b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:25:35.256581 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-b4fd3691-b6f0-40d7-82e1-f5616f5213e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:35.265317 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-11d98efd-0906-4708-9f28-bc581551ff8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a238c838354472f860707beb40e17ac'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:35.303090 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-11d98efd-0906-4708-9f28-bc581551ff8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a238c838354472f860707beb40e17ac'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:35.313221 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-11d98efd-0906-4708-9f28-bc581551ff8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a238c838354472f860707beb40e17ac'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:35.313927 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-11d98efd-0906-4708-9f28-bc581551ff8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a238c838354472f860707beb40e17ac'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:35.323645 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-11d98efd-0906-4708-9f28-bc581551ff8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a238c838354472f860707beb40e17ac'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:35.342051 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1118/2240] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:25:34 2022] DELETE /identity/v3/users/5a238c838354472f860707beb40e17ac => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 10:25:35.343105 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d98efd-0906-4708-9f28-bc581551ff8e admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:35.345092 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-11d98efd-0906-4708-9f28-bc581551ff8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:35.409331 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1123/2241] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:25:35 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:25:35.410765 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78d47af-7d71-43a9-aa79-38b277ca914a None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:35.411054 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78d47af-7d71-43a9-aa79-38b277ca914a None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:35.411328 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78d47af-7d71-43a9-aa79-38b277ca914a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:35.441663 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-f78d47af-7d71-43a9-aa79-38b277ca914a None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:25:35.443598 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-f78d47af-7d71-43a9-aa79-38b277ca914a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:35.497552 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d98efd-0906-4708-9f28-bc581551ff8e admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:35.511327 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b94bc97-02f6-415c-a73a-182c9e113b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:35.512094 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b94bc97-02f6-415c-a73a-182c9e113b94 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:35.512438 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b94bc97-02f6-415c-a73a-182c9e113b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:35.512909 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b94bc97-02f6-415c-a73a-182c9e113b94 admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:35.513762 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b94bc97-02f6-415c-a73a-182c9e113b94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:35.515801 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b94bc97-02f6-415c-a73a-182c9e113b94 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:35.545625 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1124/2242] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:25:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:25:35.547211 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78d47af-7d71-43a9-aa79-38b277ca914a None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:35.557239 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-f78d47af-7d71-43a9-aa79-38b277ca914a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:35.582994 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1119/2243] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:25:35 2022] POST /identity/v3/users => generated 293 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:25:35.584147 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b94bc97-02f6-415c-a73a-182c9e113b94 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:35.588046 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-4b94bc97-02f6-415c-a73a-182c9e113b94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:35.597039 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78d47af-7d71-43a9-aa79-38b277ca914a None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:35.604115 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce71b9c-ab59-41c7-9ce1-48a1dd180574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:35.604987 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce71b9c-ab59-41c7-9ce1-48a1dd180574 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:35.605276 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce71b9c-ab59-41c7-9ce1-48a1dd180574 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:35.605547 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce71b9c-ab59-41c7-9ce1-48a1dd180574 admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:35.606229 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce71b9c-ab59-41c7-9ce1-48a1dd180574 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:35.608390 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce71b9c-ab59-41c7-9ce1-48a1dd180574 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:35.646919 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1125/2244] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:25:35 2022] POST /identity/v3/projects => generated 383 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:25:35.648145 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce71b9c-ab59-41c7-9ce1-48a1dd180574 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:35.704725 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b94bc97-02f6-415c-a73a-182c9e113b94 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:35.747315 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:25:35.755796 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce71b9c-ab59-41c7-9ce1-48a1dd180574 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:35.764050 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4610d280-8127-4a4b-8c56-c9e645ce1900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:35.764731 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4610d280-8127-4a4b-8c56-c9e645ce1900 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:35.765013 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4610d280-8127-4a4b-8c56-c9e645ce1900 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:35.765463 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4610d280-8127-4a4b-8c56-c9e645ce1900 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:35.766155 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4610d280-8127-4a4b-8c56-c9e645ce1900 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:35.767811 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4610d280-8127-4a4b-8c56-c9e645ce1900 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:35.776658 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:25:35.784465 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1126/2245] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:25:35 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:25:35.784465 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4610d280-8127-4a4b-8c56-c9e645ce1900 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:35.795943 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4610d280-8127-4a4b-8c56-c9e645ce1900 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:35.813890 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689d4e85-d82c-46d9-a25b-d6b8dbd661eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:35.814579 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689d4e85-d82c-46d9-a25b-d6b8dbd661eb admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:35.814864 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689d4e85-d82c-46d9-a25b-d6b8dbd661eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:35.815115 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689d4e85-d82c-46d9-a25b-d6b8dbd661eb admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:35.815743 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689d4e85-d82c-46d9-a25b-d6b8dbd661eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:35.818026 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689d4e85-d82c-46d9-a25b-d6b8dbd661eb admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:35.844004 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3630d9d-1438-4f7e-ba7d-5b04cd0ecd60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:35.844931 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3630d9d-1438-4f7e-ba7d-5b04cd0ecd60 service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:35.845463 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3630d9d-1438-4f7e-ba7d-5b04cd0ecd60 service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:35.845906 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3630d9d-1438-4f7e-ba7d-5b04cd0ecd60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:35.847156 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1127/2246] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:25:35 2022] POST /identity/v3/users => generated 298 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:25:35.848239 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689d4e85-d82c-46d9-a25b-d6b8dbd661eb admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:35.863984 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689d4e85-d82c-46d9-a25b-d6b8dbd661eb admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:35.871193 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3630d9d-1438-4f7e-ba7d-5b04cd0ecd60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:35.873111 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3630d9d-1438-4f7e-ba7d-5b04cd0ecd60 service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:35.874778 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4c73e4-76c7-4738-a25e-07536e5e2409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:35.875666 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4c73e4-76c7-4738-a25e-07536e5e2409 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:35.876156 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4c73e4-76c7-4738-a25e-07536e5e2409 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:35.877370 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4c73e4-76c7-4738-a25e-07536e5e2409 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:35.878515 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4c73e4-76c7-4738-a25e-07536e5e2409 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:35.881943 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4c73e4-76c7-4738-a25e-07536e5e2409 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:35.885684 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1120/2247] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:25:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:25:35.886739 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3630d9d-1438-4f7e-ba7d-5b04cd0ecd60 service neutron] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:35.897433 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3630d9d-1438-4f7e-ba7d-5b04cd0ecd60 service neutron] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:35.907096 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0f0c5e-def9-45c6-8da1-fe0db244ab4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:35.907769 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f0c5e-def9-45c6-8da1-fe0db244ab4b admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:35.908087 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f0c5e-def9-45c6-8da1-fe0db244ab4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:35.908398 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f0c5e-def9-45c6-8da1-fe0db244ab4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:35.908899 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1128/2248] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:25:35 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:25:35.909074 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0f0c5e-def9-45c6-8da1-fe0db244ab4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:35.910592 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4c73e4-76c7-4738-a25e-07536e5e2409 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:35.910840 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0f0c5e-def9-45c6-8da1-fe0db244ab4b admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:35.923938 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1121/2249] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:25:35 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:25:35.928388 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4c73e4-76c7-4738-a25e-07536e5e2409 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:35.929272 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0f0c5e-def9-45c6-8da1-fe0db244ab4b admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:35.942675 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39250dd-9680-4bdb-b7f0-b6f727e36efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:35.943520 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39250dd-9680-4bdb-b7f0-b6f727e36efc admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:35.943889 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39250dd-9680-4bdb-b7f0-b6f727e36efc admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:35.944199 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39250dd-9680-4bdb-b7f0-b6f727e36efc admin admin] PATH_INFO: `/v3/projects/69c2687421ba41229f44511a4205aab6/users/a63a06a2020148048942a2933cefeeea/roles/a9895331e9694fa8b2b50908bb057bcb` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:35.956726 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0f0c5e-def9-45c6-8da1-fe0db244ab4b admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:35.976677 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da68bb8-ca0d-4de3-a319-9b49488b1a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:35.980461 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39250dd-9680-4bdb-b7f0-b6f727e36efc admin admin] RBAC: Authorizing `identity:create_grant(project_id=69c2687421ba41229f44511a4205aab6, user_id=a63a06a2020148048942a2933cefeeea, role_id=a9895331e9694fa8b2b50908bb057bcb)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:35.983685 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da68bb8-ca0d-4de3-a319-9b49488b1a57 admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:35.984027 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39250dd-9680-4bdb-b7f0-b6f727e36efc admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:35.984143 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da68bb8-ca0d-4de3-a319-9b49488b1a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:35.984306 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da68bb8-ca0d-4de3-a319-9b49488b1a57 admin admin] PATH_INFO: `/v3/projects/cc2ad68cfdd54ebeb40ce4aa7506f0b4/users/5d3eb8ee800a4ce1a32cef4f246b0764/roles/89ca30cbbb634be8a96e9921aa56626b` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:36.008786 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1129/2250] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:25:35 2022] PUT /identity/v3/projects/69c2687421ba41229f44511a4205aab6/users/a63a06a2020148048942a2933cefeeea/roles/a9895331e9694fa8b2b50908bb057bcb => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:25:36.021333 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c494a5f-955e-47dc-829f-8959e73b0bf6 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:36.021761 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c494a5f-955e-47dc-829f-8959e73b0bf6 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:36.022414 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c494a5f-955e-47dc-829f-8959e73b0bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:36.037154 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da68bb8-ca0d-4de3-a319-9b49488b1a57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc2ad68cfdd54ebeb40ce4aa7506f0b4, user_id=5d3eb8ee800a4ce1a32cef4f246b0764, role_id=89ca30cbbb634be8a96e9921aa56626b)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:36.041366 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da68bb8-ca0d-4de3-a319-9b49488b1a57 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:36.069811 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1122/2251] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:25:35 2022] PUT /identity/v3/projects/cc2ad68cfdd54ebeb40ce4aa7506f0b4/users/5d3eb8ee800a4ce1a32cef4f246b0764/roles/89ca30cbbb634be8a96e9921aa56626b => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:25:36.071187 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da68bb8-ca0d-4de3-a319-9b49488b1a57 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:36.096201 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-6c494a5f-955e-47dc-829f-8959e73b0bf6 None None] MFA Rules not processed for user `a63a06a2020148048942a2933cefeeea`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:25:36.097556 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-6c494a5f-955e-47dc-829f-8959e73b0bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:36.194924 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1130/2252] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:25:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:25:36.195237 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da68bb8-ca0d-4de3-a319-9b49488b1a57 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:36.198750 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c494a5f-955e-47dc-829f-8959e73b0bf6 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:36.201036 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36178f7-754e-47e3-a056-9893ee3511be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:36.202327 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36178f7-754e-47e3-a056-9893ee3511be admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:36.203061 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36178f7-754e-47e3-a056-9893ee3511be admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:36.203347 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36178f7-754e-47e3-a056-9893ee3511be admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:36.203998 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36178f7-754e-47e3-a056-9893ee3511be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:36.205619 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36178f7-754e-47e3-a056-9893ee3511be admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:36.220103 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c494a5f-955e-47dc-829f-8959e73b0bf6 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:36.223008 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1123/2253] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:25:36 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:25:36.225563 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36178f7-754e-47e3-a056-9893ee3511be admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:36.231329 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd2071c-af0d-4d87-8074-2c5fe39b34c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:36.232160 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2071c-af0d-4d87-8074-2c5fe39b34c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:36.232621 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2071c-af0d-4d87-8074-2c5fe39b34c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:36.233154 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2071c-af0d-4d87-8074-2c5fe39b34c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:36.234255 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd2071c-af0d-4d87-8074-2c5fe39b34c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:36.239196 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd2071c-af0d-4d87-8074-2c5fe39b34c1 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:36.253483 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36178f7-754e-47e3-a056-9893ee3511be admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:36.271225 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf13b2f6-bdad-4a74-957d-083726caedb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:36.272719 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf13b2f6-bdad-4a74-957d-083726caedb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:36.275055 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf13b2f6-bdad-4a74-957d-083726caedb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:36.275857 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf13b2f6-bdad-4a74-957d-083726caedb7 admin admin] PATH_INFO: `/v3/projects/cc2ad68cfdd54ebeb40ce4aa7506f0b4/users/5d3eb8ee800a4ce1a32cef4f246b0764/roles/89ca30cbbb634be8a96e9921aa56626b` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:36.285619 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf13b2f6-bdad-4a74-957d-083726caedb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc2ad68cfdd54ebeb40ce4aa7506f0b4, user_id=5d3eb8ee800a4ce1a32cef4f246b0764, role_id=89ca30cbbb634be8a96e9921aa56626b)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:36.295989 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf13b2f6-bdad-4a74-957d-083726caedb7 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:36.311893 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1124/2254] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:25:36 2022] PUT /identity/v3/projects/cc2ad68cfdd54ebeb40ce4aa7506f0b4/users/5d3eb8ee800a4ce1a32cef4f246b0764/roles/89ca30cbbb634be8a96e9921aa56626b => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:25:36.319208 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1131/2255] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:25:36 2022] POST /identity/v3/projects => generated 385 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:25:36.339198 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf13b2f6-bdad-4a74-957d-083726caedb7 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:36.564000 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf13b2f6-bdad-4a74-957d-083726caedb7 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:36.604762 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:25:36.640118 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19665a3-630a-4d61-82f9-05ae843f1a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:36.640344 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19665a3-630a-4d61-82f9-05ae843f1a8e admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:36.640604 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19665a3-630a-4d61-82f9-05ae843f1a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:36.640882 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19665a3-630a-4d61-82f9-05ae843f1a8e admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:36.641588 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19665a3-630a-4d61-82f9-05ae843f1a8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:36.644772 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19665a3-630a-4d61-82f9-05ae843f1a8e admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:36.671359 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1125/2256] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:25:36 2022] POST /identity/v3/users => generated 299 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:25:36.675852 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd2071c-af0d-4d87-8074-2c5fe39b34c1 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:36.693978 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd2071c-af0d-4d87-8074-2c5fe39b34c1 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:36.707194 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c611b8-e3db-4f89-839a-442c679da27c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:36.708832 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c611b8-e3db-4f89-839a-442c679da27c admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:36.709219 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c611b8-e3db-4f89-839a-442c679da27c admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:36.709777 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c611b8-e3db-4f89-839a-442c679da27c admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:36.710651 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c611b8-e3db-4f89-839a-442c679da27c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:36.715400 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c611b8-e3db-4f89-839a-442c679da27c admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:36.742353 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1132/2257] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:25:36 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:25:36.742602 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19665a3-630a-4d61-82f9-05ae843f1a8e admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:36.754813 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c611b8-e3db-4f89-839a-442c679da27c admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:36.756286 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19665a3-630a-4d61-82f9-05ae843f1a8e admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:36.756936 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-91c611b8-e3db-4f89-839a-442c679da27c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:36.763877 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd9c023-091d-4a89-8045-a07a2d367e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:36.764781 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9c023-091d-4a89-8045-a07a2d367e10 admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:36.765070 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9c023-091d-4a89-8045-a07a2d367e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:36.765396 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9c023-091d-4a89-8045-a07a2d367e10 admin admin] PATH_INFO: `/v3/projects/2ce96ade638f46759f340f9141ef6cb6/users/d9527b1bc8f04928a6feaffdac49fd44/roles/89ca30cbbb634be8a96e9921aa56626b` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:36.795991 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c611b8-e3db-4f89-839a-442c679da27c admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:36.802822 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72500a8-9dd1-4fb7-834e-2f2c66fb4375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:36.817951 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72500a8-9dd1-4fb7-834e-2f2c66fb4375 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:36.818625 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72500a8-9dd1-4fb7-834e-2f2c66fb4375 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:36.818917 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72500a8-9dd1-4fb7-834e-2f2c66fb4375 admin admin] PATH_INFO: `/v3/projects/b474e66ded874ff5a12f90df99ebf64f` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:36.820784 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd9c023-091d-4a89-8045-a07a2d367e10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ce96ade638f46759f340f9141ef6cb6, user_id=d9527b1bc8f04928a6feaffdac49fd44, role_id=89ca30cbbb634be8a96e9921aa56626b)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:36.822114 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72500a8-9dd1-4fb7-834e-2f2c66fb4375 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b474e66ded874ff5a12f90df99ebf64f)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:36.824334 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72500a8-9dd1-4fb7-834e-2f2c66fb4375 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:36.826874 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd9c023-091d-4a89-8045-a07a2d367e10 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:36.850260 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1126/2258] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:25:36 2022] PUT /identity/v3/projects/2ce96ade638f46759f340f9141ef6cb6/users/d9527b1bc8f04928a6feaffdac49fd44/roles/89ca30cbbb634be8a96e9921aa56626b => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:25:36.858185 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd9c023-091d-4a89-8045-a07a2d367e10 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:36.948082 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a72500a8-9dd1-4fb7-834e-2f2c66fb4375 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b474e66ded874ff5a12f90df99ebf64f', 'request_id': 'req-a72500a8-9dd1-4fb7-834e-2f2c66fb4375'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:36.951067 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:25:36.962501 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a72500a8-9dd1-4fb7-834e-2f2c66fb4375 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b474e66ded874ff5a12f90df99ebf64f', 'request_id': 'req-a72500a8-9dd1-4fb7-834e-2f2c66fb4375'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:36.977538 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a72500a8-9dd1-4fb7-834e-2f2c66fb4375 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b474e66ded874ff5a12f90df99ebf64f', 'request_id': 'req-a72500a8-9dd1-4fb7-834e-2f2c66fb4375'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:36.996899 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd9c023-091d-4a89-8045-a07a2d367e10 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:36.999172 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a72500a8-9dd1-4fb7-834e-2f2c66fb4375 admin admin] The token cache is being invalidate because project b474e66ded874ff5a12f90df99ebf64f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:25:36.999758 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a72500a8-9dd1-4fb7-834e-2f2c66fb4375 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:37.000746 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a72500a8-9dd1-4fb7-834e-2f2c66fb4375 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:37.003448 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1133/2259] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:25:36 2022] DELETE /identity/v3/projects/b474e66ded874ff5a12f90df99ebf64f => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:25:37.133478 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2048b7de-55f7-4965-ab26-96852f07b373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:37.134163 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2048b7de-55f7-4965-ab26-96852f07b373 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:37.134510 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2048b7de-55f7-4965-ab26-96852f07b373 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:37.135469 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2048b7de-55f7-4965-ab26-96852f07b373 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:37.136253 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2048b7de-55f7-4965-ab26-96852f07b373 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:37.145212 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2048b7de-55f7-4965-ab26-96852f07b373 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:37.170017 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1127/2260] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:25:36 2022] GET /identity/v3/roles => generated 1420 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:25:37.170992 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72500a8-9dd1-4fb7-834e-2f2c66fb4375 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:37.173406 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-a72500a8-9dd1-4fb7-834e-2f2c66fb4375 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:37.194495 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72500a8-9dd1-4fb7-834e-2f2c66fb4375 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:37.205359 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa48e3ff-9067-42f5-9805-bd415c2dcf14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:37.207986 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa48e3ff-9067-42f5-9805-bd415c2dcf14 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:37.208633 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa48e3ff-9067-42f5-9805-bd415c2dcf14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:37.209127 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa48e3ff-9067-42f5-9805-bd415c2dcf14 admin admin] PATH_INFO: `/v3/projects/2ce96ade638f46759f340f9141ef6cb6/users/d9527b1bc8f04928a6feaffdac49fd44/roles/89ca30cbbb634be8a96e9921aa56626b` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:37.215852 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa48e3ff-9067-42f5-9805-bd415c2dcf14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ce96ade638f46759f340f9141ef6cb6, user_id=d9527b1bc8f04928a6feaffdac49fd44, role_id=89ca30cbbb634be8a96e9921aa56626b)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:37.219726 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa48e3ff-9067-42f5-9805-bd415c2dcf14 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:37.244511 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1134/2261] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:25:37 2022] PUT /identity/v3/projects/2ce96ade638f46759f340f9141ef6cb6/users/d9527b1bc8f04928a6feaffdac49fd44/roles/89ca30cbbb634be8a96e9921aa56626b => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:25:37.248247 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d101e5-c5df-46e5-bee9-f00c681d2fa7 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:37.248558 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d101e5-c5df-46e5-bee9-f00c681d2fa7 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:37.248831 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d101e5-c5df-46e5-bee9-f00c681d2fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:37.318794 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-a4d101e5-c5df-46e5-bee9-f00c681d2fa7 None None] MFA Rules not processed for user `d9527b1bc8f04928a6feaffdac49fd44`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:25:37.322141 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-a4d101e5-c5df-46e5-bee9-f00c681d2fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:37.365512 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:25:37.455785 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1128/2262] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:25:37 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:25:37.471410 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa48e3ff-9067-42f5-9805-bd415c2dcf14 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:37.474577 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-aa48e3ff-9067-42f5-9805-bd415c2dcf14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:37.651996 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa48e3ff-9067-42f5-9805-bd415c2dcf14 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:37.666454 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068d3262-254b-49e3-876f-d40ba68ebf04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6c687a38524de0bf23d87ae91d3b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:37.667085 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d3262-254b-49e3-876f-d40ba68ebf04 service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:37.667837 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d3262-254b-49e3-876f-d40ba68ebf04 service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:37.668118 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d3262-254b-49e3-876f-d40ba68ebf04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:37.669994 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-068d3262-254b-49e3-876f-d40ba68ebf04 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:37.842351 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068d3262-254b-49e3-876f-d40ba68ebf04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:37.843460 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068d3262-254b-49e3-876f-d40ba68ebf04 service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:37.861226 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1135/2263] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:25:37 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:25:40.052411 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d101e5-c5df-46e5-bee9-f00c681d2fa7 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:40.059182 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-a4d101e5-c5df-46e5-bee9-f00c681d2fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:40.086299 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d101e5-c5df-46e5-bee9-f00c681d2fa7 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:40.090813 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf91430-f882-478c-94e3-052be88718de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6c687a38524de0bf23d87ae91d3b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:40.093543 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf91430-f882-478c-94e3-052be88718de service cinder] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:40.094178 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf91430-f882-478c-94e3-052be88718de service cinder] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:40.094724 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf91430-f882-478c-94e3-052be88718de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:40.103822 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-ddf91430-f882-478c-94e3-052be88718de service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:40.184383 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf91430-f882-478c-94e3-052be88718de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:40.185829 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf91430-f882-478c-94e3-052be88718de service cinder] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:40.196860 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1129/2264] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:25:40 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:25:41.254649 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068d3262-254b-49e3-876f-d40ba68ebf04 service cinder] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:41.267633 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068d3262-254b-49e3-876f-d40ba68ebf04 service cinder] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:41.275679 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d04b8a-de71-4a06-bb0b-f751b9746fa6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6c687a38524de0bf23d87ae91d3b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:41.281179 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d04b8a-de71-4a06-bb0b-f751b9746fa6 service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:41.281729 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d04b8a-de71-4a06-bb0b-f751b9746fa6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:41.282243 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d04b8a-de71-4a06-bb0b-f751b9746fa6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:41.297080 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d04b8a-de71-4a06-bb0b-f751b9746fa6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:41.299332 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d04b8a-de71-4a06-bb0b-f751b9746fa6 service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:41.327853 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1136/2265] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:25:41 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:25:43.161369 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109ee9a-99b5-43d3-ab51-8e0499e791fd None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:43.162151 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109ee9a-99b5-43d3-ab51-8e0499e791fd None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:43.162573 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109ee9a-99b5-43d3-ab51-8e0499e791fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:43.190637 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-3109ee9a-99b5-43d3-ab51-8e0499e791fd None None] MFA Rules not processed for user `83f35273053c4f728a6137a42c63a066`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:25:43.192036 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-3109ee9a-99b5-43d3-ab51-8e0499e791fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:43.257885 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1130/2266] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:25:43 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:25:45.607311 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d04b8a-de71-4a06-bb0b-f751b9746fa6 service cinder] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:45.719246 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d04b8a-de71-4a06-bb0b-f751b9746fa6 service cinder] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:45.730702 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e77f31-6e3b-4ca0-a799-2c9418681774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:45.731358 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e77f31-6e3b-4ca0-a799-2c9418681774 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:45.731641 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e77f31-6e3b-4ca0-a799-2c9418681774 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:45.731916 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e77f31-6e3b-4ca0-a799-2c9418681774 admin admin] PATH_INFO: `/v3/users/370e4bd84abb4f58af6a2ceae69d9ac5` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:45.733663 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e77f31-6e3b-4ca0-a799-2c9418681774 admin admin] RBAC: Authorizing `identity:delete_user(user_id=370e4bd84abb4f58af6a2ceae69d9ac5)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:45.738388 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e77f31-6e3b-4ca0-a799-2c9418681774 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:45.764504 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:25:45.825503 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-d9e77f31-6e3b-4ca0-a799-2c9418681774 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '370e4bd84abb4f58af6a2ceae69d9ac5'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:45.840357 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-d9e77f31-6e3b-4ca0-a799-2c9418681774 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '370e4bd84abb4f58af6a2ceae69d9ac5'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:45.847851 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-d9e77f31-6e3b-4ca0-a799-2c9418681774 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '370e4bd84abb4f58af6a2ceae69d9ac5'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:45.848842 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-d9e77f31-6e3b-4ca0-a799-2c9418681774 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '370e4bd84abb4f58af6a2ceae69d9ac5'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:45.857910 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-d9e77f31-6e3b-4ca0-a799-2c9418681774 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '370e4bd84abb4f58af6a2ceae69d9ac5'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:45.865091 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1137/2267] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:25:45 2022] DELETE /identity/v3/users/370e4bd84abb4f58af6a2ceae69d9ac5 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:25:45.870081 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3222b281-e6ad-41aa-8b34-94738ad2579a None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:45.870583 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3222b281-e6ad-41aa-8b34-94738ad2579a None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:45.870679 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3222b281-e6ad-41aa-8b34-94738ad2579a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:45.896455 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-3222b281-e6ad-41aa-8b34-94738ad2579a None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:25:45.897757 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-3222b281-e6ad-41aa-8b34-94738ad2579a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:45.987067 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1131/2268] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:25:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:25:45.996766 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e77f31-6e3b-4ca0-a799-2c9418681774 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:45.998452 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-d9e77f31-6e3b-4ca0-a799-2c9418681774 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:46.072337 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e77f31-6e3b-4ca0-a799-2c9418681774 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:46.076207 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cac34ab-3f24-4c30-8dd7-824196b38599 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:46.076923 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cac34ab-3f24-4c30-8dd7-824196b38599 service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:46.077274 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cac34ab-3f24-4c30-8dd7-824196b38599 service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:46.077615 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cac34ab-3f24-4c30-8dd7-824196b38599 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:46.087914 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cac34ab-3f24-4c30-8dd7-824196b38599 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:46.089476 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cac34ab-3f24-4c30-8dd7-824196b38599 service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:46.100109 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1138/2269] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:25:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:25:46.401993 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1978d922-9d02-4c3b-93af-c2cff1fa7f70 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:46.402277 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1978d922-9d02-4c3b-93af-c2cff1fa7f70 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:46.402547 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1978d922-9d02-4c3b-93af-c2cff1fa7f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:46.420483 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cac34ab-3f24-4c30-8dd7-824196b38599 service neutron] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:46.422524 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-4cac34ab-3f24-4c30-8dd7-824196b38599 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:46.444884 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:25:46.464829 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cac34ab-3f24-4c30-8dd7-824196b38599 service neutron] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:46.468782 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-1978d922-9d02-4c3b-93af-c2cff1fa7f70 None None] MFA Rules not processed for user `5d3eb8ee800a4ce1a32cef4f246b0764`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:25:46.470498 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-1978d922-9d02-4c3b-93af-c2cff1fa7f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:46.481655 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987f37c5-428a-43ef-9d48-036a4610b3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:46.482333 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f37c5-428a-43ef-9d48-036a4610b3fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:46.482617 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f37c5-428a-43ef-9d48-036a4610b3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:46.482889 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f37c5-428a-43ef-9d48-036a4610b3fb admin admin] PATH_INFO: `/v3/projects/7aeed51ee1d740508e53be844e1ac67c` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:46.485691 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987f37c5-428a-43ef-9d48-036a4610b3fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=7aeed51ee1d740508e53be844e1ac67c)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:46.487652 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987f37c5-428a-43ef-9d48-036a4610b3fb admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:46.546304 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-987f37c5-428a-43ef-9d48-036a4610b3fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7aeed51ee1d740508e53be844e1ac67c', 'request_id': 'req-987f37c5-428a-43ef-9d48-036a4610b3fb'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:46.552697 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-987f37c5-428a-43ef-9d48-036a4610b3fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7aeed51ee1d740508e53be844e1ac67c', 'request_id': 'req-987f37c5-428a-43ef-9d48-036a4610b3fb'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:46.559525 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-987f37c5-428a-43ef-9d48-036a4610b3fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7aeed51ee1d740508e53be844e1ac67c', 'request_id': 'req-987f37c5-428a-43ef-9d48-036a4610b3fb'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:46.562751 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1132/2270] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:25:46 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:25:46.581196 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1978d922-9d02-4c3b-93af-c2cff1fa7f70 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:46.582892 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-1978d922-9d02-4c3b-93af-c2cff1fa7f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:46.586872 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-987f37c5-428a-43ef-9d48-036a4610b3fb admin admin] The token cache is being invalidate because project 7aeed51ee1d740508e53be844e1ac67c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:25:46.587474 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-987f37c5-428a-43ef-9d48-036a4610b3fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:46.588128 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-987f37c5-428a-43ef-9d48-036a4610b3fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:46.593257 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1139/2271] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:25:46 2022] DELETE /identity/v3/projects/7aeed51ee1d740508e53be844e1ac67c => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:25:46.594775 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987f37c5-428a-43ef-9d48-036a4610b3fb admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:46.596334 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-987f37c5-428a-43ef-9d48-036a4610b3fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:46.614041 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:25:46.655787 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1978d922-9d02-4c3b-93af-c2cff1fa7f70 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:46.677054 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987f37c5-428a-43ef-9d48-036a4610b3fb admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:46.683446 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad6764d-eff6-488b-8a33-bcddfaeaab9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:46.684504 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad6764d-eff6-488b-8a33-bcddfaeaab9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:46.685088 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad6764d-eff6-488b-8a33-bcddfaeaab9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:46.685443 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad6764d-eff6-488b-8a33-bcddfaeaab9f admin admin] PATH_INFO: `/v3/users/a63a06a2020148048942a2933cefeeea` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:46.687088 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad6764d-eff6-488b-8a33-bcddfaeaab9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a63a06a2020148048942a2933cefeeea)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:46.689868 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad6764d-eff6-488b-8a33-bcddfaeaab9f admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:46.706847 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153eb35d-581f-402a-9ac1-699568fc8089 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07540b72afd34927855c41db09a7b030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:46.707454 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153eb35d-581f-402a-9ac1-699568fc8089 service glance] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:46.707736 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153eb35d-581f-402a-9ac1-699568fc8089 service glance] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:46.708009 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153eb35d-581f-402a-9ac1-699568fc8089 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:46.709756 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-153eb35d-581f-402a-9ac1-699568fc8089 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:46.740415 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-5ad6764d-eff6-488b-8a33-bcddfaeaab9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a63a06a2020148048942a2933cefeeea'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:46.754193 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-5ad6764d-eff6-488b-8a33-bcddfaeaab9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a63a06a2020148048942a2933cefeeea'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:46.762025 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-5ad6764d-eff6-488b-8a33-bcddfaeaab9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a63a06a2020148048942a2933cefeeea'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:46.762753 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-5ad6764d-eff6-488b-8a33-bcddfaeaab9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a63a06a2020148048942a2933cefeeea'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:46.770744 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-5ad6764d-eff6-488b-8a33-bcddfaeaab9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a63a06a2020148048942a2933cefeeea'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:46.771407 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153eb35d-581f-402a-9ac1-699568fc8089 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:46.772872 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153eb35d-581f-402a-9ac1-699568fc8089 service glance] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:46.777308 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1140/2272] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:25:46 2022] DELETE /identity/v3/users/a63a06a2020148048942a2933cefeeea => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 10:25:46.783874 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1133/2273] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:25:46 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 10:25:46.992519 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d12b23-927e-4cad-a7b1-4ed857e6cde6 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:46.992997 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d12b23-927e-4cad-a7b1-4ed857e6cde6 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:46.993226 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d12b23-927e-4cad-a7b1-4ed857e6cde6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:47.018723 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-63d12b23-927e-4cad-a7b1-4ed857e6cde6 None None] MFA Rules not processed for user `cedc4d6c59c44c6d8fb7179070db5e91`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:25:47.019961 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-63d12b23-927e-4cad-a7b1-4ed857e6cde6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:47.096610 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1141/2274] 10.222.0.36 () {58 vars in 1009 bytes} [Tue Aug 9 10:25:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:25:47.155960 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153eb35d-581f-402a-9ac1-699568fc8089 service glance] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:47.157510 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-153eb35d-581f-402a-9ac1-699568fc8089 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:47.165759 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:25:47.268912 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153eb35d-581f-402a-9ac1-699568fc8089 service glance] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:47.278010 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d12b23-927e-4cad-a7b1-4ed857e6cde6 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:47.280231 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-63d12b23-927e-4cad-a7b1-4ed857e6cde6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:47.390140 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:25:47.401605 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52c9890-6130-4665-b87d-6c6ad5db938f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '841c5dbaae774944b637c533ebd75b29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:47.402525 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c9890-6130-4665-b87d-6c6ad5db938f service swift] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:47.402838 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c9890-6130-4665-b87d-6c6ad5db938f service swift] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:47.403309 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c9890-6130-4665-b87d-6c6ad5db938f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:47.418851 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52c9890-6130-4665-b87d-6c6ad5db938f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:47.421229 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52c9890-6130-4665-b87d-6c6ad5db938f service swift] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:47.445553 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1134/2275] 10.222.0.36 () {60 vars in 1384 bytes} [Tue Aug 9 10:25:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 10:25:47.449670 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d12b23-927e-4cad-a7b1-4ed857e6cde6 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:47.470453 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8b6031-831e-4340-9eca-652239869c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:47.471428 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8b6031-831e-4340-9eca-652239869c6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:47.472103 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8b6031-831e-4340-9eca-652239869c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:47.472458 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8b6031-831e-4340-9eca-652239869c6a admin admin] PATH_INFO: `/v3/projects/69c2687421ba41229f44511a4205aab6` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:47.486847 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8b6031-831e-4340-9eca-652239869c6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=69c2687421ba41229f44511a4205aab6)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:47.489547 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8b6031-831e-4340-9eca-652239869c6a admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:47.556866 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-3b8b6031-831e-4340-9eca-652239869c6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69c2687421ba41229f44511a4205aab6', 'request_id': 'req-3b8b6031-831e-4340-9eca-652239869c6a'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:47.564204 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-3b8b6031-831e-4340-9eca-652239869c6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69c2687421ba41229f44511a4205aab6', 'request_id': 'req-3b8b6031-831e-4340-9eca-652239869c6a'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:47.577463 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-3b8b6031-831e-4340-9eca-652239869c6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69c2687421ba41229f44511a4205aab6', 'request_id': 'req-3b8b6031-831e-4340-9eca-652239869c6a'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:47.636793 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-3b8b6031-831e-4340-9eca-652239869c6a admin admin] The token cache is being invalidate because project 69c2687421ba41229f44511a4205aab6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:25:47.636793 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-3b8b6031-831e-4340-9eca-652239869c6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:47.639679 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-3b8b6031-831e-4340-9eca-652239869c6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:47.643487 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1142/2276] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:25:47 2022] DELETE /identity/v3/projects/69c2687421ba41229f44511a4205aab6 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 10:25:47.648823 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52c9890-6130-4665-b87d-6c6ad5db938f service swift] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:47.669469 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52c9890-6130-4665-b87d-6c6ad5db938f service swift] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:47.856899 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b99585-bba7-4e73-8022-9629bc7b92d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:47.857878 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b99585-bba7-4e73-8022-9629bc7b92d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:47.858304 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b99585-bba7-4e73-8022-9629bc7b92d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:47.858715 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b99585-bba7-4e73-8022-9629bc7b92d5 admin admin] PATH_INFO: `/v3/users/d9527b1bc8f04928a6feaffdac49fd44` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:47.860324 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b99585-bba7-4e73-8022-9629bc7b92d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9527b1bc8f04928a6feaffdac49fd44)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:47.862704 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b99585-bba7-4e73-8022-9629bc7b92d5 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:47.937776 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:25:47.953603 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-12b99585-bba7-4e73-8022-9629bc7b92d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9527b1bc8f04928a6feaffdac49fd44'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:47.996726 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-12b99585-bba7-4e73-8022-9629bc7b92d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9527b1bc8f04928a6feaffdac49fd44'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:48.008677 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-12b99585-bba7-4e73-8022-9629bc7b92d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9527b1bc8f04928a6feaffdac49fd44'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:48.013466 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-12b99585-bba7-4e73-8022-9629bc7b92d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9527b1bc8f04928a6feaffdac49fd44'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:48.031457 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-12b99585-bba7-4e73-8022-9629bc7b92d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9527b1bc8f04928a6feaffdac49fd44'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:48.043912 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1135/2277] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:25:47 2022] DELETE /identity/v3/users/d9527b1bc8f04928a6feaffdac49fd44 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 10:25:48.660171 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8b6031-831e-4340-9eca-652239869c6a admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:48.661828 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-3b8b6031-831e-4340-9eca-652239869c6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:48.692542 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8b6031-831e-4340-9eca-652239869c6a admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:48.782437 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57f0cfd-656d-4f08-b2ca-7cc4215a035a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:48.784689 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f0cfd-656d-4f08-b2ca-7cc4215a035a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:48.785035 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f0cfd-656d-4f08-b2ca-7cc4215a035a admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:48.785777 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f0cfd-656d-4f08-b2ca-7cc4215a035a admin admin] PATH_INFO: `/v3/projects/2ce96ade638f46759f340f9141ef6cb6` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:48.787472 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57f0cfd-656d-4f08-b2ca-7cc4215a035a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ce96ade638f46759f340f9141ef6cb6)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:48.790516 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57f0cfd-656d-4f08-b2ca-7cc4215a035a admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:48.877753 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-f57f0cfd-656d-4f08-b2ca-7cc4215a035a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ce96ade638f46759f340f9141ef6cb6', 'request_id': 'req-f57f0cfd-656d-4f08-b2ca-7cc4215a035a'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:48.888356 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-f57f0cfd-656d-4f08-b2ca-7cc4215a035a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ce96ade638f46759f340f9141ef6cb6', 'request_id': 'req-f57f0cfd-656d-4f08-b2ca-7cc4215a035a'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:48.900274 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-f57f0cfd-656d-4f08-b2ca-7cc4215a035a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ce96ade638f46759f340f9141ef6cb6', 'request_id': 'req-f57f0cfd-656d-4f08-b2ca-7cc4215a035a'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:48.914968 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:25:48.925148 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-f57f0cfd-656d-4f08-b2ca-7cc4215a035a admin admin] The token cache is being invalidate because project 2ce96ade638f46759f340f9141ef6cb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:25:48.925960 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-f57f0cfd-656d-4f08-b2ca-7cc4215a035a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:48.926971 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-f57f0cfd-656d-4f08-b2ca-7cc4215a035a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:48.943364 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1143/2278] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:25:48 2022] DELETE /identity/v3/projects/2ce96ade638f46759f340f9141ef6cb6 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:25:55.461774 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdcf60d-de96-4833-aa9a-4e33837157a4 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:55.462382 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdcf60d-de96-4833-aa9a-4e33837157a4 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:55.462382 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdcf60d-de96-4833-aa9a-4e33837157a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:55.494176 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-3bdcf60d-de96-4833-aa9a-4e33837157a4 None None] MFA Rules not processed for user `cedc4d6c59c44c6d8fb7179070db5e91`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:25:55.495430 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-3bdcf60d-de96-4833-aa9a-4e33837157a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:55.589203 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1136/2279] 10.222.0.36 () {58 vars in 1009 bytes} [Tue Aug 9 10:25:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:25:55.606558 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57f0cfd-656d-4f08-b2ca-7cc4215a035a admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:55.608970 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-f57f0cfd-656d-4f08-b2ca-7cc4215a035a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:55.715706 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57f0cfd-656d-4f08-b2ca-7cc4215a035a admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:55.720800 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f0cc65-ec8a-4743-9fbe-6f774d042071 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '841c5dbaae774944b637c533ebd75b29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:55.721487 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f0cc65-ec8a-4743-9fbe-6f774d042071 service swift] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:55.722015 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f0cc65-ec8a-4743-9fbe-6f774d042071 service swift] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:55.722360 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f0cc65-ec8a-4743-9fbe-6f774d042071 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:55.734362 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f0cc65-ec8a-4743-9fbe-6f774d042071 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:55.736073 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f0cc65-ec8a-4743-9fbe-6f774d042071 service swift] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:55.746885 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1144/2280] 10.222.0.36 () {60 vars in 1384 bytes} [Tue Aug 9 10:25:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 10:25:55.830271 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdcf60d-de96-4833-aa9a-4e33837157a4 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:55.831640 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-3bdcf60d-de96-4833-aa9a-4e33837157a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:55.982239 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdcf60d-de96-4833-aa9a-4e33837157a4 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:55.993121 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc603591-4325-4004-8e67-1ef79b09a523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:55.994315 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc603591-4325-4004-8e67-1ef79b09a523 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:55.995306 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc603591-4325-4004-8e67-1ef79b09a523 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:55.995804 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc603591-4325-4004-8e67-1ef79b09a523 admin admin] PATH_INFO: `/v3/users/9ff4fa7b3dbd4642bc0f2edb60abfbc3` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:55.997306 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc603591-4325-4004-8e67-1ef79b09a523 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ff4fa7b3dbd4642bc0f2edb60abfbc3)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:55.999478 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc603591-4325-4004-8e67-1ef79b09a523 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:56.075913 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-dc603591-4325-4004-8e67-1ef79b09a523 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ff4fa7b3dbd4642bc0f2edb60abfbc3'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:56.095347 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-dc603591-4325-4004-8e67-1ef79b09a523 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ff4fa7b3dbd4642bc0f2edb60abfbc3'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:56.097452 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:25:56.104491 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-dc603591-4325-4004-8e67-1ef79b09a523 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ff4fa7b3dbd4642bc0f2edb60abfbc3'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:56.105298 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-dc603591-4325-4004-8e67-1ef79b09a523 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ff4fa7b3dbd4642bc0f2edb60abfbc3'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:56.117083 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-dc603591-4325-4004-8e67-1ef79b09a523 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ff4fa7b3dbd4642bc0f2edb60abfbc3'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:56.125472 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1137/2281] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:25:55 2022] DELETE /identity/v3/users/9ff4fa7b3dbd4642bc0f2edb60abfbc3 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:25:56.129755 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a6fe10-bab2-4d07-8bb4-089b5bc06f3b None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:56.130179 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a6fe10-bab2-4d07-8bb4-089b5bc06f3b None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:56.130557 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a6fe10-bab2-4d07-8bb4-089b5bc06f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:56.165589 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-71a6fe10-bab2-4d07-8bb4-089b5bc06f3b None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:25:56.167365 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-71a6fe10-bab2-4d07-8bb4-089b5bc06f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:56.254483 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1145/2282] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:25:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:25:56.265231 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc603591-4325-4004-8e67-1ef79b09a523 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:56.267068 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-dc603591-4325-4004-8e67-1ef79b09a523 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:56.344344 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc603591-4325-4004-8e67-1ef79b09a523 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:56.348534 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527253f2-0a4a-47e9-b2de-83ee8f9c5d6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:56.349517 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527253f2-0a4a-47e9-b2de-83ee8f9c5d6a service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:56.350049 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527253f2-0a4a-47e9-b2de-83ee8f9c5d6a service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:56.351070 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527253f2-0a4a-47e9-b2de-83ee8f9c5d6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:56.363959 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527253f2-0a4a-47e9-b2de-83ee8f9c5d6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:56.366534 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527253f2-0a4a-47e9-b2de-83ee8f9c5d6a service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:56.379039 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1138/2283] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:25:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:25:57.249995 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a6fe10-bab2-4d07-8bb4-089b5bc06f3b None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:25:57.252837 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-71a6fe10-bab2-4d07-8bb4-089b5bc06f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:57.273027 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a6fe10-bab2-4d07-8bb4-089b5bc06f3b None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:25:57.288869 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2dd4d4-5b7e-4258-a019-d0de40f490b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:25:57.289629 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2dd4d4-5b7e-4258-a019-d0de40f490b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:57.289820 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2dd4d4-5b7e-4258-a019-d0de40f490b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:57.296599 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2dd4d4-5b7e-4258-a019-d0de40f490b6 admin admin] PATH_INFO: `/v3/projects/9bae32aaa65e4d0288d3187cf14bccb5` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:57.296599 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2dd4d4-5b7e-4258-a019-d0de40f490b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bae32aaa65e4d0288d3187cf14bccb5)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:25:57.296599 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2dd4d4-5b7e-4258-a019-d0de40f490b6 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:25:57.394145 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-8d2dd4d4-5b7e-4258-a019-d0de40f490b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bae32aaa65e4d0288d3187cf14bccb5', 'request_id': 'req-8d2dd4d4-5b7e-4258-a019-d0de40f490b6'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:57.403103 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-8d2dd4d4-5b7e-4258-a019-d0de40f490b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bae32aaa65e4d0288d3187cf14bccb5', 'request_id': 'req-8d2dd4d4-5b7e-4258-a019-d0de40f490b6'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:57.417993 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-8d2dd4d4-5b7e-4258-a019-d0de40f490b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bae32aaa65e4d0288d3187cf14bccb5', 'request_id': 'req-8d2dd4d4-5b7e-4258-a019-d0de40f490b6'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:57.436403 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-8d2dd4d4-5b7e-4258-a019-d0de40f490b6 admin admin] The token cache is being invalidate because project 9bae32aaa65e4d0288d3187cf14bccb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:25:57.436691 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-8d2dd4d4-5b7e-4258-a019-d0de40f490b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:57.437477 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-8d2dd4d4-5b7e-4258-a019-d0de40f490b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:25:57.439398 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1146/2284] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:25:57 2022] DELETE /identity/v3/projects/9bae32aaa65e4d0288d3187cf14bccb5 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:25:59.106064 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4da830-0f24-434b-93a1-38c326e2c153 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:25:59.106064 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4da830-0f24-434b-93a1-38c326e2c153 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:25:59.106801 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4da830-0f24-434b-93a1-38c326e2c153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:25:59.134095 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-db4da830-0f24-434b-93a1-38c326e2c153 None None] MFA Rules not processed for user `43020346e4664c41baa23fc95496b35b`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:25:59.135989 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-db4da830-0f24-434b-93a1-38c326e2c153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:25:59.238227 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1139/2285] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:25:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:26:02.264819 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e6474-5084-447c-af85-95537e5c4768 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:26:02.266992 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e6474-5084-447c-af85-95537e5c4768 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:26:02.266992 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e6474-5084-447c-af85-95537e5c4768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:26:02.308655 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-cd9e6474-5084-447c-af85-95537e5c4768 None None] MFA Rules not processed for user `cedc4d6c59c44c6d8fb7179070db5e91`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:26:02.310050 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-cd9e6474-5084-447c-af85-95537e5c4768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:26:02.326904 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:26:02.525966 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1147/2286] 10.222.0.36 () {58 vars in 1009 bytes} [Tue Aug 9 10:26:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 10:26:02.540648 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4da830-0f24-434b-93a1-38c326e2c153 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:26:02.543419 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-db4da830-0f24-434b-93a1-38c326e2c153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:26:02.655233 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4da830-0f24-434b-93a1-38c326e2c153 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:26:02.661276 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209dfb00-eca9-41d4-bd53-86afa984b91f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '841c5dbaae774944b637c533ebd75b29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:26:02.662217 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209dfb00-eca9-41d4-bd53-86afa984b91f service swift] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:26:02.663307 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209dfb00-eca9-41d4-bd53-86afa984b91f service swift] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:26:02.664108 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209dfb00-eca9-41d4-bd53-86afa984b91f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:26:02.674425 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209dfb00-eca9-41d4-bd53-86afa984b91f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:26:02.676475 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209dfb00-eca9-41d4-bd53-86afa984b91f service swift] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:26:02.687516 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1140/2287] 10.222.0.36 () {60 vars in 1384 bytes} [Tue Aug 9 10:26:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 10:26:12.492694 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=20 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:26:12.682419 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:26:19.683703 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae5fee-8b6d-4a19-9428-565533d1eb63 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:26:19.684255 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae5fee-8b6d-4a19-9428-565533d1eb63 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:26:19.684362 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae5fee-8b6d-4a19-9428-565533d1eb63 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:26:19.685882 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1148/2288] 10.222.0.36 () {54 vars in 921 bytes} [Tue Aug 9 10:26:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:26:19.693646 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd21c6-12ae-4aad-97f3-7339a91e8ca3 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:26:19.694233 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd21c6-12ae-4aad-97f3-7339a91e8ca3 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:26:19.694523 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cd21c6-12ae-4aad-97f3-7339a91e8ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:26:19.713957 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-f4cd21c6-12ae-4aad-97f3-7339a91e8ca3 None None] MFA Rules not processed for user `eb863beaaa9f495c8b64655996c061f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:26:19.715172 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-f4cd21c6-12ae-4aad-97f3-7339a91e8ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:26:19.791195 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1141/2289] 10.222.0.36 () {58 vars in 1018 bytes} [Tue Aug 9 10:26:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:26:19.804337 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ae5fee-8b6d-4a19-9428-565533d1eb63 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:26:19.806123 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-15ae5fee-8b6d-4a19-9428-565533d1eb63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:26:19.862901 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ae5fee-8b6d-4a19-9428-565533d1eb63 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:26:19.867133 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4d9dd3-4ef3-4e21-86f5-c867640419d6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07540b72afd34927855c41db09a7b030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:26:19.867733 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d9dd3-4ef3-4e21-86f5-c867640419d6 service glance] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:26:19.868006 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d9dd3-4ef3-4e21-86f5-c867640419d6 service glance] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:26:19.868296 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d9dd3-4ef3-4e21-86f5-c867640419d6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:26:19.884124 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4d9dd3-4ef3-4e21-86f5-c867640419d6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:26:19.885634 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4d9dd3-4ef3-4e21-86f5-c867640419d6 service glance] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:26:19.897721 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1149/2290] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:26:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:26:19.969477 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56fe2b1-4253-416d-a2d3-ea2674d22567 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:26:19.969774 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56fe2b1-4253-416d-a2d3-ea2674d22567 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:26:19.970205 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56fe2b1-4253-416d-a2d3-ea2674d22567 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:26:19.971817 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1142/2291] 10.222.0.36 () {54 vars in 921 bytes} [Tue Aug 9 10:26:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:26:19.979346 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234985b-f0e2-44d0-8f98-679b136c31b8 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:26:19.979636 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234985b-f0e2-44d0-8f98-679b136c31b8 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:26:19.979930 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234985b-f0e2-44d0-8f98-679b136c31b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:26:20.000955 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-a234985b-f0e2-44d0-8f98-679b136c31b8 None None] MFA Rules not processed for user `9169847a16764da3a2a1dbb5f5f56438`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:26:20.002219 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-a234985b-f0e2-44d0-8f98-679b136c31b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:26:20.056911 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1150/2292] 10.222.0.36 () {58 vars in 1018 bytes} [Tue Aug 9 10:26:19 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 10:26:20.068552 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56fe2b1-4253-416d-a2d3-ea2674d22567 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:26:20.070456 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-c56fe2b1-4253-416d-a2d3-ea2674d22567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:26:20.083270 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56fe2b1-4253-416d-a2d3-ea2674d22567 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:26:20.087067 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef415dba-12f6-41bb-873b-34a8f3cc3e11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:26:20.087650 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef415dba-12f6-41bb-873b-34a8f3cc3e11 service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:26:20.087923 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef415dba-12f6-41bb-873b-34a8f3cc3e11 service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:26:20.088189 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef415dba-12f6-41bb-873b-34a8f3cc3e11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:26:20.094967 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef415dba-12f6-41bb-873b-34a8f3cc3e11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:26:20.096360 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef415dba-12f6-41bb-873b-34a8f3cc3e11 service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:26:20.104496 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1143/2293] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:26:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:26:20.190640 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d860b8c3-50e8-4b6e-8d7c-c89f4e22dd74 None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:26:20.190929 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d860b8c3-50e8-4b6e-8d7c-c89f4e22dd74 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:26:20.191208 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d860b8c3-50e8-4b6e-8d7c-c89f4e22dd74 None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:26:20.192544 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1151/2294] 10.222.0.36 () {54 vars in 921 bytes} [Tue Aug 9 10:26:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:26:20.197427 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b575d-9bf0-46d2-8157-0759ddd128bb None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:26:20.197715 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b575d-9bf0-46d2-8157-0759ddd128bb None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:26:20.198018 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b575d-9bf0-46d2-8157-0759ddd128bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:26:20.217422 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-2d6b575d-9bf0-46d2-8157-0759ddd128bb None None] MFA Rules not processed for user `eb863beaaa9f495c8b64655996c061f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:26:20.218655 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-2d6b575d-9bf0-46d2-8157-0759ddd128bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:26:20.228516 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1144/2295] 10.222.0.36 () {58 vars in 1018 bytes} [Tue Aug 9 10:26:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 10:26:20.239012 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d860b8c3-50e8-4b6e-8d7c-c89f4e22dd74 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:26:20.250667 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d860b8c3-50e8-4b6e-8d7c-c89f4e22dd74 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:26:20.254234 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b80e6e-5f5e-4038-9850-6d9dae48958b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:26:20.254816 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b80e6e-5f5e-4038-9850-6d9dae48958b service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:26:20.255093 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b80e6e-5f5e-4038-9850-6d9dae48958b service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:26:20.255363 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b80e6e-5f5e-4038-9850-6d9dae48958b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:26:20.265289 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b80e6e-5f5e-4038-9850-6d9dae48958b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:26:20.266684 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b80e6e-5f5e-4038-9850-6d9dae48958b service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:26:20.277423 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1152/2296] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:26:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:26:23.102730 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a32d0b-968a-4c19-b4d9-68959ca28a41 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:26:23.103202 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a32d0b-968a-4c19-b4d9-68959ca28a41 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:26:23.103298 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a32d0b-968a-4c19-b4d9-68959ca28a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:26:23.121976 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-42a32d0b-968a-4c19-b4d9-68959ca28a41 None None] MFA Rules not processed for user `cedc4d6c59c44c6d8fb7179070db5e91`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:26:23.123142 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-42a32d0b-968a-4c19-b4d9-68959ca28a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:26:23.129967 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1145/2297] 10.222.0.36 () {58 vars in 1009 bytes} [Tue Aug 9 10:26:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:26:23.142351 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b80e6e-5f5e-4038-9850-6d9dae48958b service neutron] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:26:23.153880 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b80e6e-5f5e-4038-9850-6d9dae48958b service neutron] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:26:23.158698 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cff021-451c-4bf8-a1e8-739d438e704a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '841c5dbaae774944b637c533ebd75b29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:26:23.159277 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cff021-451c-4bf8-a1e8-739d438e704a service swift] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:26:23.159550 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cff021-451c-4bf8-a1e8-739d438e704a service swift] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:26:23.159819 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cff021-451c-4bf8-a1e8-739d438e704a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:26:23.168852 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cff021-451c-4bf8-a1e8-739d438e704a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:26:23.170528 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cff021-451c-4bf8-a1e8-739d438e704a service swift] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:26:23.179365 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1153/2298] 10.222.0.36 () {60 vars in 1384 bytes} [Tue Aug 9 10:26:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 10:26:33.117407 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=43 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:26:33.175242 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=61 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:26:43.467786 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a32d0b-968a-4c19-b4d9-68959ca28a41 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:26:43.470993 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-42a32d0b-968a-4c19-b4d9-68959ca28a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:26:43.589593 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a32d0b-968a-4c19-b4d9-68959ca28a41 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:26:43.595134 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f5496a-9740-44e9-9f13-98a0b942e929 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4d3b6a332394adf9e1b81ee9c171c48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:26:43.595944 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f5496a-9740-44e9-9f13-98a0b942e929 service placement] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:26:43.596378 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f5496a-9740-44e9-9f13-98a0b942e929 service placement] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:26:43.596646 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f5496a-9740-44e9-9f13-98a0b942e929 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:26:43.598558 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-e0f5496a-9740-44e9-9f13-98a0b942e929 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:26:43.614843 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f5496a-9740-44e9-9f13-98a0b942e929 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:26:43.617290 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f5496a-9740-44e9-9f13-98a0b942e929 service placement] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:26:43.628274 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1146/2299] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:26:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:26:43.937654 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cff021-451c-4bf8-a1e8-739d438e704a service swift] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:26:43.949645 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cff021-451c-4bf8-a1e8-739d438e704a service swift] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:26:43.953506 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65106411-41d8-4603-94ef-ef0ebdeb623a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:26:43.954145 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65106411-41d8-4603-94ef-ef0ebdeb623a service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:26:43.954422 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65106411-41d8-4603-94ef-ef0ebdeb623a service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:26:43.954689 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65106411-41d8-4603-94ef-ef0ebdeb623a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:26:43.961741 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-65106411-41d8-4603-94ef-ef0ebdeb623a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:26:44.030849 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65106411-41d8-4603-94ef-ef0ebdeb623a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:26:44.032428 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65106411-41d8-4603-94ef-ef0ebdeb623a service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:26:44.042909 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1154/2300] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:26:43 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:26:47.317192 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbdb50b-2819-47f2-a99e-268f718a676d None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:26:47.317192 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbdb50b-2819-47f2-a99e-268f718a676d None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:26:47.317192 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbdb50b-2819-47f2-a99e-268f718a676d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:26:47.374376 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-6fbdb50b-2819-47f2-a99e-268f718a676d None None] MFA Rules not processed for user `cedc4d6c59c44c6d8fb7179070db5e91`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:26:47.376915 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-6fbdb50b-2819-47f2-a99e-268f718a676d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:26:47.386488 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1147/2301] 10.222.0.36 () {58 vars in 967 bytes} [Tue Aug 9 10:26:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 10:26:47.415934 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65106411-41d8-4603-94ef-ef0ebdeb623a service neutron] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:26:47.428435 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65106411-41d8-4603-94ef-ef0ebdeb623a service neutron] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:26:47.433958 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31256b2a-298d-4dcf-aad0-b48fc9287432 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '841c5dbaae774944b637c533ebd75b29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:26:47.434761 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31256b2a-298d-4dcf-aad0-b48fc9287432 service swift] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:26:47.435042 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31256b2a-298d-4dcf-aad0-b48fc9287432 service swift] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:26:47.435317 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31256b2a-298d-4dcf-aad0-b48fc9287432 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:26:47.444495 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31256b2a-298d-4dcf-aad0-b48fc9287432 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:26:47.446106 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31256b2a-298d-4dcf-aad0-b48fc9287432 service swift] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:26:47.458401 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1155/2302] 10.222.0.36 () {60 vars in 1384 bytes} [Tue Aug 9 10:26:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 10:26:56.363165 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a1493-9caf-47df-9667-cb02e872918c None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:26:56.363711 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a1493-9caf-47df-9667-cb02e872918c None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:26:56.363813 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a1493-9caf-47df-9667-cb02e872918c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:26:56.383388 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-205a1493-9caf-47df-9667-cb02e872918c None None] MFA Rules not processed for user `3d39820fab6041b9b655c54ce74e7e4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:26:56.384578 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-205a1493-9caf-47df-9667-cb02e872918c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:26:56.438461 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1148/2303] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:26:56 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:26:57.452599 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=36 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:27:06.432130 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=60 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:27:12.579920 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc144148-8c6a-4834-8edc-64cd64c4950b None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:27:12.580470 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc144148-8c6a-4834-8edc-64cd64c4950b None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:27:12.580470 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc144148-8c6a-4834-8edc-64cd64c4950b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:27:12.599549 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-cc144148-8c6a-4834-8edc-64cd64c4950b None None] MFA Rules not processed for user `83f35273053c4f728a6137a42c63a066`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:27:12.601430 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-cc144148-8c6a-4834-8edc-64cd64c4950b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:27:12.663810 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1156/2304] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:27:12 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:27:22.655290 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=25 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:27:36.165837 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e011f-b728-4456-972d-6d06931d044a None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:27:36.166417 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e011f-b728-4456-972d-6d06931d044a None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:27:36.166417 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e011f-b728-4456-972d-6d06931d044a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:27:36.185457 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-098e011f-b728-4456-972d-6d06931d044a None None] MFA Rules not processed for user `74925532a3b64d21b4e861ec70bc4345`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:27:36.186648 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-098e011f-b728-4456-972d-6d06931d044a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:27:36.238372 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1149/2305] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:27:36 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:27:46.232818 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=25 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:27:46.606535 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf218015-0472-494c-b404-860bb27ceb8f None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:27:46.607088 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf218015-0472-494c-b404-860bb27ceb8f None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:27:46.607314 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf218015-0472-494c-b404-860bb27ceb8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:27:46.626971 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-cf218015-0472-494c-b404-860bb27ceb8f None None] MFA Rules not processed for user `efd69dedc75842f495bde0c20799a340`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:27:46.628564 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-cf218015-0472-494c-b404-860bb27ceb8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:27:46.685312 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1157/2306] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:27:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:27:56.678613 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=25 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:28:10.414780 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634b4cd4-7996-408b-8902-35e3decfd10f None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:28:10.415294 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634b4cd4-7996-408b-8902-35e3decfd10f None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:28:10.415485 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634b4cd4-7996-408b-8902-35e3decfd10f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:28:10.435163 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-634b4cd4-7996-408b-8902-35e3decfd10f None None] MFA Rules not processed for user `3d39820fab6041b9b655c54ce74e7e4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:28:10.436289 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-634b4cd4-7996-408b-8902-35e3decfd10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:28:10.443766 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1150/2307] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:28:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:28:20.430524 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=3 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:28:23.180827 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf218015-0472-494c-b404-860bb27ceb8f None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:28:23.182520 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-cf218015-0472-494c-b404-860bb27ceb8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:28:23.196038 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf218015-0472-494c-b404-860bb27ceb8f None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:28:23.199761 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305b1723-6342-47d1-b158-1a96e6be5746 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:28:23.200304 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b1723-6342-47d1-b158-1a96e6be5746 service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:28:23.200584 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b1723-6342-47d1-b158-1a96e6be5746 service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:28:23.200852 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b1723-6342-47d1-b158-1a96e6be5746 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:28:23.202655 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-305b1723-6342-47d1-b158-1a96e6be5746 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:28:23.218128 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305b1723-6342-47d1-b158-1a96e6be5746 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:28:23.219700 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305b1723-6342-47d1-b158-1a96e6be5746 service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:28:23.231662 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1158/2308] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:28:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:28:23.891595 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634b4cd4-7996-408b-8902-35e3decfd10f None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:28:23.904134 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634b4cd4-7996-408b-8902-35e3decfd10f None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:28:23.910924 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e843724-c4be-4de5-824b-de50f265f268 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:28:23.912339 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e843724-c4be-4de5-824b-de50f265f268 service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:28:23.912941 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e843724-c4be-4de5-824b-de50f265f268 service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:28:23.913359 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e843724-c4be-4de5-824b-de50f265f268 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:28:23.915536 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-7e843724-c4be-4de5-824b-de50f265f268 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:28:23.934898 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e843724-c4be-4de5-824b-de50f265f268 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:28:23.936901 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e843724-c4be-4de5-824b-de50f265f268 service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:28:23.959120 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1151/2309] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:28:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:28:23.991523 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305b1723-6342-47d1-b158-1a96e6be5746 service neutron] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:28:24.000200 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305b1723-6342-47d1-b158-1a96e6be5746 service neutron] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:28:24.004633 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74579f6-17ce-4909-b767-3657c3a4658c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:28:24.005236 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74579f6-17ce-4909-b767-3657c3a4658c service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:28:24.005512 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74579f6-17ce-4909-b767-3657c3a4658c service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:28:24.006359 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74579f6-17ce-4909-b767-3657c3a4658c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:28:24.008814 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-b74579f6-17ce-4909-b767-3657c3a4658c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:28:24.082466 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74579f6-17ce-4909-b767-3657c3a4658c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:28:24.083973 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74579f6-17ce-4909-b767-3657c3a4658c service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:28:24.093835 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1159/2310] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:28:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:28:25.142179 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313ecca2-1b0d-415b-92d2-039f9623b232 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:28:25.143964 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313ecca2-1b0d-415b-92d2-039f9623b232 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:28:25.144393 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313ecca2-1b0d-415b-92d2-039f9623b232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:28:25.170669 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-313ecca2-1b0d-415b-92d2-039f9623b232 None None] MFA Rules not processed for user `cedc4d6c59c44c6d8fb7179070db5e91`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:28:25.171905 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-313ecca2-1b0d-415b-92d2-039f9623b232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:28:25.187654 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1152/2311] 10.222.0.36 () {58 vars in 967 bytes} [Tue Aug 9 10:28:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:28:25.250445 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74579f6-17ce-4909-b767-3657c3a4658c service neutron] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:28:25.272364 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74579f6-17ce-4909-b767-3657c3a4658c service neutron] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:28:25.279643 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4c6bec-f321-4909-9da5-b4bd7e2e6086 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '841c5dbaae774944b637c533ebd75b29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:28:25.280547 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c6bec-f321-4909-9da5-b4bd7e2e6086 service swift] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:28:25.281021 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c6bec-f321-4909-9da5-b4bd7e2e6086 service swift] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:28:25.281483 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c6bec-f321-4909-9da5-b4bd7e2e6086 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:28:25.292528 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4c6bec-f321-4909-9da5-b4bd7e2e6086 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:28:25.294371 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4c6bec-f321-4909-9da5-b4bd7e2e6086 service swift] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:28:25.307544 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1160/2312] 10.222.0.36 () {60 vars in 1384 bytes} [Tue Aug 9 10:28:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 09 10:28:28.203655 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313ecca2-1b0d-415b-92d2-039f9623b232 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:28:28.206027 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-313ecca2-1b0d-415b-92d2-039f9623b232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:28:28.225693 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313ecca2-1b0d-415b-92d2-039f9623b232 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:28:28.231569 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29852331-4f96-4744-8bd1-57f5fab8f061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:28:28.232394 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29852331-4f96-4744-8bd1-57f5fab8f061 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:28:28.233303 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29852331-4f96-4744-8bd1-57f5fab8f061 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:28:28.233650 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29852331-4f96-4744-8bd1-57f5fab8f061 admin admin] PATH_INFO: `/v3/users/83f35273053c4f728a6137a42c63a066` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:28:28.236951 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29852331-4f96-4744-8bd1-57f5fab8f061 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83f35273053c4f728a6137a42c63a066)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:28:28.240485 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29852331-4f96-4744-8bd1-57f5fab8f061 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:28:28.314258 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-29852331-4f96-4744-8bd1-57f5fab8f061 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83f35273053c4f728a6137a42c63a066'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:28:28.330738 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-29852331-4f96-4744-8bd1-57f5fab8f061 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83f35273053c4f728a6137a42c63a066'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:28:28.346022 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-29852331-4f96-4744-8bd1-57f5fab8f061 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83f35273053c4f728a6137a42c63a066'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:28:28.346022 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-29852331-4f96-4744-8bd1-57f5fab8f061 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83f35273053c4f728a6137a42c63a066'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:28:28.351967 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-29852331-4f96-4744-8bd1-57f5fab8f061 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83f35273053c4f728a6137a42c63a066'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:28:28.364343 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1153/2313] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:28:28 2022] DELETE /identity/v3/users/83f35273053c4f728a6137a42c63a066 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:28:28.801761 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4c6bec-f321-4909-9da5-b4bd7e2e6086 service swift] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:28:28.814312 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4c6bec-f321-4909-9da5-b4bd7e2e6086 service swift] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:28:28.907384 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317ed18b-5373-4e13-808a-d7f2246002e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:28:28.908084 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317ed18b-5373-4e13-808a-d7f2246002e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:28:28.908564 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317ed18b-5373-4e13-808a-d7f2246002e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:28:28.908923 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317ed18b-5373-4e13-808a-d7f2246002e8 admin admin] PATH_INFO: `/v3/projects/0888330230c849fb847e74299fd09dbe` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:28:28.910165 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317ed18b-5373-4e13-808a-d7f2246002e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0888330230c849fb847e74299fd09dbe)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:28:28.912857 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317ed18b-5373-4e13-808a-d7f2246002e8 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:28:28.969665 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-317ed18b-5373-4e13-808a-d7f2246002e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0888330230c849fb847e74299fd09dbe', 'request_id': 'req-317ed18b-5373-4e13-808a-d7f2246002e8'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:28:28.977309 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-317ed18b-5373-4e13-808a-d7f2246002e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0888330230c849fb847e74299fd09dbe', 'request_id': 'req-317ed18b-5373-4e13-808a-d7f2246002e8'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:28:28.983638 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-317ed18b-5373-4e13-808a-d7f2246002e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0888330230c849fb847e74299fd09dbe', 'request_id': 'req-317ed18b-5373-4e13-808a-d7f2246002e8'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:28:28.995536 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:28:29.001478 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-317ed18b-5373-4e13-808a-d7f2246002e8 admin admin] The token cache is being invalidate because project 0888330230c849fb847e74299fd09dbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:28:29.001998 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-317ed18b-5373-4e13-808a-d7f2246002e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:28:29.003141 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-317ed18b-5373-4e13-808a-d7f2246002e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:28:29.008628 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1161/2314] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:28:28 2022] DELETE /identity/v3/projects/0888330230c849fb847e74299fd09dbe => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:28:29.010118 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bb9b7c-3e10-4c18-8cf2-6315df76a4ab None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:28:29.010412 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bb9b7c-3e10-4c18-8cf2-6315df76a4ab None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:28:29.010694 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bb9b7c-3e10-4c18-8cf2-6315df76a4ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:28:29.030310 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-87bb9b7c-3e10-4c18-8cf2-6315df76a4ab None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:28:29.031910 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-87bb9b7c-3e10-4c18-8cf2-6315df76a4ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:28:29.095523 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1154/2315] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:28:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:28:29.103647 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c80be-b525-4fdc-ae9c-79b318f371a0 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:28:29.104324 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c80be-b525-4fdc-ae9c-79b318f371a0 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:28:29.104324 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c80be-b525-4fdc-ae9c-79b318f371a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:28:29.128306 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-254c80be-b525-4fdc-ae9c-79b318f371a0 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:28:29.129551 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-254c80be-b525-4fdc-ae9c-79b318f371a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:28:29.142273 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1162/2316] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:28:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:28:29.143590 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bb9b7c-3e10-4c18-8cf2-6315df76a4ab None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:28:29.153941 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bb9b7c-3e10-4c18-8cf2-6315df76a4ab None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:28:29.159061 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f179b4-25e3-454e-8fc2-992169ca56b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:28:29.159661 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f179b4-25e3-454e-8fc2-992169ca56b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:28:29.159954 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f179b4-25e3-454e-8fc2-992169ca56b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:28:29.160242 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f179b4-25e3-454e-8fc2-992169ca56b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:28:29.160848 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f179b4-25e3-454e-8fc2-992169ca56b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:28:29.161150 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f179b4-25e3-454e-8fc2-992169ca56b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:28:29.163453 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f179b4-25e3-454e-8fc2-992169ca56b3 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:28:29.182200 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1155/2317] 10.222.0.36 () {58 vars in 1153 bytes} [Tue Aug 9 10:28:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:28:29.182871 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254c80be-b525-4fdc-ae9c-79b318f371a0 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:28:29.198216 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254c80be-b525-4fdc-ae9c-79b318f371a0 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:28:29.204101 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb41cb3a-a109-4a8e-8bff-a4fcbcea9fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:28:29.204868 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41cb3a-a109-4a8e-8bff-a4fcbcea9fb1 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:28:29.205242 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41cb3a-a109-4a8e-8bff-a4fcbcea9fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:28:29.205626 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41cb3a-a109-4a8e-8bff-a4fcbcea9fb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:28:29.206409 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb41cb3a-a109-4a8e-8bff-a4fcbcea9fb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:28:29.208779 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb41cb3a-a109-4a8e-8bff-a4fcbcea9fb1 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:28:29.253055 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1163/2318] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:28:29 2022] POST /identity/v3/projects => generated 401 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 10:28:29.254382 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f179b4-25e3-454e-8fc2-992169ca56b3 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:28:29.266803 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f179b4-25e3-454e-8fc2-992169ca56b3 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:28:29.327616 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:28:29.361023 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc64de9-25b8-40e9-ba5e-213b9555cc9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:28:29.361771 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc64de9-25b8-40e9-ba5e-213b9555cc9f admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:28:29.362179 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc64de9-25b8-40e9-ba5e-213b9555cc9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:28:29.362542 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc64de9-25b8-40e9-ba5e-213b9555cc9f admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:28:29.363255 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc64de9-25b8-40e9-ba5e-213b9555cc9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:28:29.365481 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc64de9-25b8-40e9-ba5e-213b9555cc9f admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:28:29.395208 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1156/2319] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:28:29 2022] POST /identity/v3/users => generated 301 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:28:29.402005 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb41cb3a-a109-4a8e-8bff-a4fcbcea9fb1 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:28:29.419853 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb41cb3a-a109-4a8e-8bff-a4fcbcea9fb1 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:28:29.429820 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16eadb7-b32d-4e6b-b976-f02eea1afeb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:28:29.430711 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16eadb7-b32d-4e6b-b976-f02eea1afeb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:28:29.431090 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16eadb7-b32d-4e6b-b976-f02eea1afeb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:28:29.431453 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16eadb7-b32d-4e6b-b976-f02eea1afeb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:28:29.432213 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16eadb7-b32d-4e6b-b976-f02eea1afeb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:28:29.434061 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16eadb7-b32d-4e6b-b976-f02eea1afeb8 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:28:29.449958 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1164/2320] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:28:29 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:28:29.451567 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc64de9-25b8-40e9-ba5e-213b9555cc9f admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:28:29.468573 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc64de9-25b8-40e9-ba5e-213b9555cc9f admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:28:29.477338 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728d3961-ad65-4806-840d-222f1a071338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:28:29.478259 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728d3961-ad65-4806-840d-222f1a071338 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:28:29.478879 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728d3961-ad65-4806-840d-222f1a071338 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:28:29.479238 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728d3961-ad65-4806-840d-222f1a071338 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:28:29.480068 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728d3961-ad65-4806-840d-222f1a071338 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:28:29.481753 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728d3961-ad65-4806-840d-222f1a071338 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:28:29.495502 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1157/2321] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:28:29 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:28:29.499563 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16eadb7-b32d-4e6b-b976-f02eea1afeb8 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:28:29.516855 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16eadb7-b32d-4e6b-b976-f02eea1afeb8 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:28:29.527594 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b8caaf-cce3-4a6d-b07c-23907df4c7ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:28:29.528421 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b8caaf-cce3-4a6d-b07c-23907df4c7ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:28:29.528827 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b8caaf-cce3-4a6d-b07c-23907df4c7ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:28:29.529224 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b8caaf-cce3-4a6d-b07c-23907df4c7ae admin admin] PATH_INFO: `/v3/projects/87680e43bf884c3fb8bf9921fa51ef14/users/1569357d26af4777b9397d4aad850f77/roles/a9895331e9694fa8b2b50908bb057bcb` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:28:29.550693 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b8caaf-cce3-4a6d-b07c-23907df4c7ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=87680e43bf884c3fb8bf9921fa51ef14, user_id=1569357d26af4777b9397d4aad850f77, role_id=a9895331e9694fa8b2b50908bb057bcb)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:28:29.555136 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b8caaf-cce3-4a6d-b07c-23907df4c7ae admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:28:29.585533 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1165/2322] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:28:29 2022] PUT /identity/v3/projects/87680e43bf884c3fb8bf9921fa51ef14/users/1569357d26af4777b9397d4aad850f77/roles/a9895331e9694fa8b2b50908bb057bcb => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:28:29.585763 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456dd06-a9dc-4e78-a55b-b6dd8df7310c None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:28:29.586161 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456dd06-a9dc-4e78-a55b-b6dd8df7310c None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:28:29.586531 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456dd06-a9dc-4e78-a55b-b6dd8df7310c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:28:29.617673 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-4456dd06-a9dc-4e78-a55b-b6dd8df7310c None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:28:29.619654 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-4456dd06-a9dc-4e78-a55b-b6dd8df7310c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:28:29.741336 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1158/2323] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:28:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:28:29.754970 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b8caaf-cce3-4a6d-b07c-23907df4c7ae admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:28:29.757771 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-25b8caaf-cce3-4a6d-b07c-23907df4c7ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:28:29.851883 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b8caaf-cce3-4a6d-b07c-23907df4c7ae admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:28:29.855906 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b308dfe3-92f7-47b6-8b27-7594999c4f6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:28:29.856791 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b308dfe3-92f7-47b6-8b27-7594999c4f6d service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:28:29.857299 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b308dfe3-92f7-47b6-8b27-7594999c4f6d service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:28:29.857797 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b308dfe3-92f7-47b6-8b27-7594999c4f6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:28:29.869113 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b308dfe3-92f7-47b6-8b27-7594999c4f6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:28:29.873444 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b308dfe3-92f7-47b6-8b27-7594999c4f6d service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:28:29.885346 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1166/2324] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:28:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:28:31.147074 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b8479-740c-4d68-8777-501f14a3008c None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:28:31.147605 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b8479-740c-4d68-8777-501f14a3008c None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:28:31.148467 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b8479-740c-4d68-8777-501f14a3008c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:28:31.195670 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-058b8479-740c-4d68-8777-501f14a3008c None None] MFA Rules not processed for user `1569357d26af4777b9397d4aad850f77`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:28:31.197504 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-058b8479-740c-4d68-8777-501f14a3008c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:28:31.291976 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1159/2325] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:28:31 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:28:31.296133 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b308dfe3-92f7-47b6-8b27-7594999c4f6d service neutron] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:28:31.306582 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b308dfe3-92f7-47b6-8b27-7594999c4f6d service neutron] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:28:31.311369 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e06c59-1a48-4e65-a147-1f8469a94795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:28:31.311974 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e06c59-1a48-4e65-a147-1f8469a94795 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:28:31.312249 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e06c59-1a48-4e65-a147-1f8469a94795 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:28:31.312542 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e06c59-1a48-4e65-a147-1f8469a94795 admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:28:31.313223 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e06c59-1a48-4e65-a147-1f8469a94795 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:28:31.315206 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e06c59-1a48-4e65-a147-1f8469a94795 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:28:31.351938 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1167/2326] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:28:31 2022] POST /identity/v3/projects => generated 405 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:28:31.356178 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b8479-740c-4d68-8777-501f14a3008c None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:28:31.369233 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b8479-740c-4d68-8777-501f14a3008c None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:28:31.416735 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:28:31.430267 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2316d0-082b-4a2c-a22f-7e183801f4e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:28:31.430985 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2316d0-082b-4a2c-a22f-7e183801f4e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:28:31.431265 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2316d0-082b-4a2c-a22f-7e183801f4e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:28:31.431648 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2316d0-082b-4a2c-a22f-7e183801f4e7 admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:28:31.432280 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2316d0-082b-4a2c-a22f-7e183801f4e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:28:31.434210 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2316d0-082b-4a2c-a22f-7e183801f4e7 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:28:31.459472 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1160/2327] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:28:31 2022] POST /identity/v3/users => generated 309 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:28:31.460950 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e06c59-1a48-4e65-a147-1f8469a94795 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:28:31.472143 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e06c59-1a48-4e65-a147-1f8469a94795 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:28:31.479678 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48995db7-9b5b-445c-b138-5b2801cdf0f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:28:31.480576 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48995db7-9b5b-445c-b138-5b2801cdf0f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:28:31.480851 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48995db7-9b5b-445c-b138-5b2801cdf0f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:28:31.481285 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48995db7-9b5b-445c-b138-5b2801cdf0f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:28:31.482123 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48995db7-9b5b-445c-b138-5b2801cdf0f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:28:31.483900 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48995db7-9b5b-445c-b138-5b2801cdf0f5 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:28:31.496068 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1168/2328] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:28:31 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:28:31.500003 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2316d0-082b-4a2c-a22f-7e183801f4e7 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:28:31.511620 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2316d0-082b-4a2c-a22f-7e183801f4e7 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:28:31.522448 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92dae61-36e7-41d9-9d95-c504871106d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:28:31.523481 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92dae61-36e7-41d9-9d95-c504871106d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:28:31.523896 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92dae61-36e7-41d9-9d95-c504871106d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:28:31.524219 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92dae61-36e7-41d9-9d95-c504871106d3 admin admin] PATH_INFO: `/v3/projects/5b61d5fb2808486eb7687bf744edab8a/users/8f3e21340d644c33a9e67b4da70cddd2/roles/89ca30cbbb634be8a96e9921aa56626b` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:28:31.542219 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92dae61-36e7-41d9-9d95-c504871106d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b61d5fb2808486eb7687bf744edab8a, user_id=8f3e21340d644c33a9e67b4da70cddd2, role_id=89ca30cbbb634be8a96e9921aa56626b)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:28:31.545759 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92dae61-36e7-41d9-9d95-c504871106d3 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:28:31.564289 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1161/2329] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:28:31 2022] PUT /identity/v3/projects/5b61d5fb2808486eb7687bf744edab8a/users/8f3e21340d644c33a9e67b4da70cddd2/roles/89ca30cbbb634be8a96e9921aa56626b => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:28:31.569274 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48995db7-9b5b-445c-b138-5b2801cdf0f5 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:28:31.579890 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48995db7-9b5b-445c-b138-5b2801cdf0f5 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:28:31.649091 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454b0854-817f-4f62-aff3-1d2f0031ddf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:28:31.649997 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454b0854-817f-4f62-aff3-1d2f0031ddf1 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:28:31.650233 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454b0854-817f-4f62-aff3-1d2f0031ddf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:28:31.650792 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454b0854-817f-4f62-aff3-1d2f0031ddf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:28:31.651686 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454b0854-817f-4f62-aff3-1d2f0031ddf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:28:31.653464 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454b0854-817f-4f62-aff3-1d2f0031ddf1 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:28:31.660242 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:28:31.671092 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1169/2330] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:28:31 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:28:31.672238 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92dae61-36e7-41d9-9d95-c504871106d3 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:28:31.685597 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92dae61-36e7-41d9-9d95-c504871106d3 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:28:31.691161 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a72781-ff07-4398-90fe-e252e3c882d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:28:31.691824 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a72781-ff07-4398-90fe-e252e3c882d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:28:31.692095 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a72781-ff07-4398-90fe-e252e3c882d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:28:31.692370 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a72781-ff07-4398-90fe-e252e3c882d4 admin admin] PATH_INFO: `/v3/projects/5b61d5fb2808486eb7687bf744edab8a/users/8f3e21340d644c33a9e67b4da70cddd2/roles/89ca30cbbb634be8a96e9921aa56626b` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:28:31.694389 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a72781-ff07-4398-90fe-e252e3c882d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b61d5fb2808486eb7687bf744edab8a, user_id=8f3e21340d644c33a9e67b4da70cddd2, role_id=89ca30cbbb634be8a96e9921aa56626b)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:28:31.697029 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a72781-ff07-4398-90fe-e252e3c882d4 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:28:31.712236 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1162/2331] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:28:31 2022] PUT /identity/v3/projects/5b61d5fb2808486eb7687bf744edab8a/users/8f3e21340d644c33a9e67b4da70cddd2/roles/89ca30cbbb634be8a96e9921aa56626b => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:28:32.901989 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ced71d-4ae7-432d-bfa0-d68dc05955ea None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:28:32.902546 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ced71d-4ae7-432d-bfa0-d68dc05955ea None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:28:32.902849 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ced71d-4ae7-432d-bfa0-d68dc05955ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:28:32.942511 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-31ced71d-4ae7-432d-bfa0-d68dc05955ea None None] MFA Rules not processed for user `8f3e21340d644c33a9e67b4da70cddd2`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:28:32.943969 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-31ced71d-4ae7-432d-bfa0-d68dc05955ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:28:33.047071 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1170/2332] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:28:32 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:28:34.339337 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a72781-ff07-4398-90fe-e252e3c882d4 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:28:34.405866 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ced71d-4ae7-432d-bfa0-d68dc05955ea None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:28:34.407488 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-31ced71d-4ae7-432d-bfa0-d68dc05955ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:28:34.432893 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a72781-ff07-4398-90fe-e252e3c882d4 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:28:34.444673 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674f28cd-214d-41cd-9382-fe181bb382b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:28:34.445202 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674f28cd-214d-41cd-9382-fe181bb382b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:28:34.445481 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674f28cd-214d-41cd-9382-fe181bb382b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:28:34.445757 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674f28cd-214d-41cd-9382-fe181bb382b4 admin admin] PATH_INFO: `/v3/users/1569357d26af4777b9397d4aad850f77` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:28:34.447517 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674f28cd-214d-41cd-9382-fe181bb382b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1569357d26af4777b9397d4aad850f77)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:28:34.449550 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674f28cd-214d-41cd-9382-fe181bb382b4 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:28:34.484816 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ced71d-4ae7-432d-bfa0-d68dc05955ea None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:28:34.490358 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c765b920-c2d5-4ca8-a1e5-7a0dbef7e895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:28:34.491107 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c765b920-c2d5-4ca8-a1e5-7a0dbef7e895 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:28:34.491386 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c765b920-c2d5-4ca8-a1e5-7a0dbef7e895 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:28:34.491681 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c765b920-c2d5-4ca8-a1e5-7a0dbef7e895 admin admin] PATH_INFO: `/v3/users/43020346e4664c41baa23fc95496b35b` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:28:34.492781 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c765b920-c2d5-4ca8-a1e5-7a0dbef7e895 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43020346e4664c41baa23fc95496b35b)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:28:34.494732 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c765b920-c2d5-4ca8-a1e5-7a0dbef7e895 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:28:34.508331 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-674f28cd-214d-41cd-9382-fe181bb382b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1569357d26af4777b9397d4aad850f77'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:28:34.523396 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-674f28cd-214d-41cd-9382-fe181bb382b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1569357d26af4777b9397d4aad850f77'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:28:34.534348 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-674f28cd-214d-41cd-9382-fe181bb382b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1569357d26af4777b9397d4aad850f77'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:28:34.535276 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-674f28cd-214d-41cd-9382-fe181bb382b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1569357d26af4777b9397d4aad850f77'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:28:34.549501 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-674f28cd-214d-41cd-9382-fe181bb382b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1569357d26af4777b9397d4aad850f77'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:28:34.551828 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-c765b920-c2d5-4ca8-a1e5-7a0dbef7e895 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43020346e4664c41baa23fc95496b35b'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:28:34.570061 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-c765b920-c2d5-4ca8-a1e5-7a0dbef7e895 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43020346e4664c41baa23fc95496b35b'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:28:34.571187 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1163/2333] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:28:34 2022] DELETE /identity/v3/users/1569357d26af4777b9397d4aad850f77 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:28:34.585823 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-c765b920-c2d5-4ca8-a1e5-7a0dbef7e895 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43020346e4664c41baa23fc95496b35b'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:28:34.586606 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-c765b920-c2d5-4ca8-a1e5-7a0dbef7e895 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43020346e4664c41baa23fc95496b35b'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:28:34.599998 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-c765b920-c2d5-4ca8-a1e5-7a0dbef7e895 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43020346e4664c41baa23fc95496b35b'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:28:34.607804 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1171/2334] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:28:34 2022] DELETE /identity/v3/users/43020346e4664c41baa23fc95496b35b => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 10:28:34.790430 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674f28cd-214d-41cd-9382-fe181bb382b4 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:28:34.793727 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-674f28cd-214d-41cd-9382-fe181bb382b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:28:34.815305 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c765b920-c2d5-4ca8-a1e5-7a0dbef7e895 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:28:34.820369 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-c765b920-c2d5-4ca8-a1e5-7a0dbef7e895 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:28:34.829682 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:28:34.832979 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:28:34.896843 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674f28cd-214d-41cd-9382-fe181bb382b4 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:28:34.901667 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6388039-5bad-45e0-a9ce-18a8f2960ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:28:34.902316 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6388039-5bad-45e0-a9ce-18a8f2960ed1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:28:34.902425 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c765b920-c2d5-4ca8-a1e5-7a0dbef7e895 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:28:34.902598 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6388039-5bad-45e0-a9ce-18a8f2960ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:28:34.902863 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6388039-5bad-45e0-a9ce-18a8f2960ed1 admin admin] PATH_INFO: `/v3/projects/87680e43bf884c3fb8bf9921fa51ef14` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:28:34.904068 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6388039-5bad-45e0-a9ce-18a8f2960ed1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87680e43bf884c3fb8bf9921fa51ef14)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:28:34.906189 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6388039-5bad-45e0-a9ce-18a8f2960ed1 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:28:34.908103 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be9bf9c-c1ca-4ba7-9bdf-f029ef6bbaab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:28:34.908748 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9bf9c-c1ca-4ba7-9bdf-f029ef6bbaab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:28:34.909024 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9bf9c-c1ca-4ba7-9bdf-f029ef6bbaab admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:28:34.909295 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9bf9c-c1ca-4ba7-9bdf-f029ef6bbaab admin admin] PATH_INFO: `/v3/projects/16fb8774ffc3411bb5444d5bb90998f6` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:28:34.910504 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be9bf9c-c1ca-4ba7-9bdf-f029ef6bbaab admin admin] RBAC: Authorizing `identity:delete_project(project_id=16fb8774ffc3411bb5444d5bb90998f6)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:28:34.913066 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be9bf9c-c1ca-4ba7-9bdf-f029ef6bbaab admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:28:34.959308 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-c6388039-5bad-45e0-a9ce-18a8f2960ed1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87680e43bf884c3fb8bf9921fa51ef14', 'request_id': 'req-c6388039-5bad-45e0-a9ce-18a8f2960ed1'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:28:34.962971 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-6be9bf9c-c1ca-4ba7-9bdf-f029ef6bbaab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16fb8774ffc3411bb5444d5bb90998f6', 'request_id': 'req-6be9bf9c-c1ca-4ba7-9bdf-f029ef6bbaab'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:28:34.965018 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-c6388039-5bad-45e0-a9ce-18a8f2960ed1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87680e43bf884c3fb8bf9921fa51ef14', 'request_id': 'req-c6388039-5bad-45e0-a9ce-18a8f2960ed1'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:28:34.968646 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-6be9bf9c-c1ca-4ba7-9bdf-f029ef6bbaab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16fb8774ffc3411bb5444d5bb90998f6', 'request_id': 'req-6be9bf9c-c1ca-4ba7-9bdf-f029ef6bbaab'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:28:34.971168 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-c6388039-5bad-45e0-a9ce-18a8f2960ed1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87680e43bf884c3fb8bf9921fa51ef14', 'request_id': 'req-c6388039-5bad-45e0-a9ce-18a8f2960ed1'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:28:34.975826 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-6be9bf9c-c1ca-4ba7-9bdf-f029ef6bbaab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16fb8774ffc3411bb5444d5bb90998f6', 'request_id': 'req-6be9bf9c-c1ca-4ba7-9bdf-f029ef6bbaab'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:28:34.985780 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-c6388039-5bad-45e0-a9ce-18a8f2960ed1 admin admin] The token cache is being invalidate because project 87680e43bf884c3fb8bf9921fa51ef14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80105) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:28:34.986101 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-c6388039-5bad-45e0-a9ce-18a8f2960ed1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:28:34.986716 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-c6388039-5bad-45e0-a9ce-18a8f2960ed1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:28:34.988173 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1164/2335] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:28:34 2022] DELETE /identity/v3/projects/87680e43bf884c3fb8bf9921fa51ef14 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:28:34.991264 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-6be9bf9c-c1ca-4ba7-9bdf-f029ef6bbaab admin admin] The token cache is being invalidate because project 16fb8774ffc3411bb5444d5bb90998f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:28:34.991264 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-6be9bf9c-c1ca-4ba7-9bdf-f029ef6bbaab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:28:34.991264 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-6be9bf9c-c1ca-4ba7-9bdf-f029ef6bbaab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:28:34.991639 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1172/2336] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:28:34 2022] DELETE /identity/v3/projects/16fb8774ffc3411bb5444d5bb90998f6 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 10:28:34.992116 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6388039-5bad-45e0-a9ce-18a8f2960ed1 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:28:34.993479 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-c6388039-5bad-45e0-a9ce-18a8f2960ed1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:28:34.995385 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be9bf9c-c1ca-4ba7-9bdf-f029ef6bbaab admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:28:34.996834 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-6be9bf9c-c1ca-4ba7-9bdf-f029ef6bbaab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:28:35.058597 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6388039-5bad-45e0-a9ce-18a8f2960ed1 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:28:35.060466 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be9bf9c-c1ca-4ba7-9bdf-f029ef6bbaab admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:28:35.063407 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2f9708-8ecf-4f1a-8633-5da26d3ca971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:28:35.064026 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2f9708-8ecf-4f1a-8633-5da26d3ca971 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:28:35.064304 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2f9708-8ecf-4f1a-8633-5da26d3ca971 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:28:35.064578 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2f9708-8ecf-4f1a-8633-5da26d3ca971 admin admin] PATH_INFO: `/v3/users/8f3e21340d644c33a9e67b4da70cddd2` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:28:35.065183 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ca86b0-a5e1-4a18-a915-8c953280f720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:28:35.065714 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2f9708-8ecf-4f1a-8633-5da26d3ca971 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f3e21340d644c33a9e67b4da70cddd2)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:28:35.065833 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca86b0-a5e1-4a18-a915-8c953280f720 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:28:35.066110 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca86b0-a5e1-4a18-a915-8c953280f720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:28:35.066388 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca86b0-a5e1-4a18-a915-8c953280f720 admin admin] PATH_INFO: `/v3/users/5d3eb8ee800a4ce1a32cef4f246b0764` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:28:35.068105 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ca86b0-a5e1-4a18-a915-8c953280f720 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d3eb8ee800a4ce1a32cef4f246b0764)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:28:35.068212 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2f9708-8ecf-4f1a-8633-5da26d3ca971 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:28:35.070426 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ca86b0-a5e1-4a18-a915-8c953280f720 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:28:35.111286 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:28:35.117275 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-cf2f9708-8ecf-4f1a-8633-5da26d3ca971 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f3e21340d644c33a9e67b4da70cddd2'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:28:35.121778 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-02ca86b0-a5e1-4a18-a915-8c953280f720 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d3eb8ee800a4ce1a32cef4f246b0764'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:28:35.122268 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:28:35.132319 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-cf2f9708-8ecf-4f1a-8633-5da26d3ca971 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f3e21340d644c33a9e67b4da70cddd2'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:28:35.136596 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-02ca86b0-a5e1-4a18-a915-8c953280f720 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d3eb8ee800a4ce1a32cef4f246b0764'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:28:35.139527 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-cf2f9708-8ecf-4f1a-8633-5da26d3ca971 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f3e21340d644c33a9e67b4da70cddd2'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:28:35.140246 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-cf2f9708-8ecf-4f1a-8633-5da26d3ca971 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f3e21340d644c33a9e67b4da70cddd2'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:28:35.143591 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-02ca86b0-a5e1-4a18-a915-8c953280f720 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d3eb8ee800a4ce1a32cef4f246b0764'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:28:35.144286 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-02ca86b0-a5e1-4a18-a915-8c953280f720 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d3eb8ee800a4ce1a32cef4f246b0764'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:28:35.149495 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-cf2f9708-8ecf-4f1a-8633-5da26d3ca971 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f3e21340d644c33a9e67b4da70cddd2'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:28:35.153730 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-02ca86b0-a5e1-4a18-a915-8c953280f720 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d3eb8ee800a4ce1a32cef4f246b0764'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:28:35.156634 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1165/2337] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:28:34 2022] DELETE /identity/v3/users/8f3e21340d644c33a9e67b4da70cddd2 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:28:35.160600 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1173/2338] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:28:34 2022] DELETE /identity/v3/users/5d3eb8ee800a4ce1a32cef4f246b0764 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 10:28:35.335726 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2f9708-8ecf-4f1a-8633-5da26d3ca971 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:28:35.337698 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-cf2f9708-8ecf-4f1a-8633-5da26d3ca971 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:28:35.343027 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ca86b0-a5e1-4a18-a915-8c953280f720 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:28:35.345527 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-02ca86b0-a5e1-4a18-a915-8c953280f720 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:28:35.415856 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2f9708-8ecf-4f1a-8633-5da26d3ca971 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:28:35.429010 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ca86b0-a5e1-4a18-a915-8c953280f720 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:28:35.433497 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d717df3e-c1bf-4e54-bfae-5b0ba81ac067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:28:35.434155 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d717df3e-c1bf-4e54-bfae-5b0ba81ac067 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:28:35.434434 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d717df3e-c1bf-4e54-bfae-5b0ba81ac067 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:28:35.434705 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d717df3e-c1bf-4e54-bfae-5b0ba81ac067 admin admin] PATH_INFO: `/v3/projects/cc2ad68cfdd54ebeb40ce4aa7506f0b4` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:28:35.435817 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d717df3e-c1bf-4e54-bfae-5b0ba81ac067 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc2ad68cfdd54ebeb40ce4aa7506f0b4)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:28:35.437811 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d717df3e-c1bf-4e54-bfae-5b0ba81ac067 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:28:35.478683 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e721cb-a778-482c-acdc-9ae90d3496ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:28:35.479656 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e721cb-a778-482c-acdc-9ae90d3496ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:28:35.479767 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e721cb-a778-482c-acdc-9ae90d3496ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:28:35.480006 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e721cb-a778-482c-acdc-9ae90d3496ae admin admin] PATH_INFO: `/v3/projects/5b61d5fb2808486eb7687bf744edab8a` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:28:35.481206 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e721cb-a778-482c-acdc-9ae90d3496ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b61d5fb2808486eb7687bf744edab8a)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:28:35.483167 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e721cb-a778-482c-acdc-9ae90d3496ae admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:28:35.490681 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-d717df3e-c1bf-4e54-bfae-5b0ba81ac067 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc2ad68cfdd54ebeb40ce4aa7506f0b4', 'request_id': 'req-d717df3e-c1bf-4e54-bfae-5b0ba81ac067'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:28:35.497035 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-d717df3e-c1bf-4e54-bfae-5b0ba81ac067 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc2ad68cfdd54ebeb40ce4aa7506f0b4', 'request_id': 'req-d717df3e-c1bf-4e54-bfae-5b0ba81ac067'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:28:35.503758 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-d717df3e-c1bf-4e54-bfae-5b0ba81ac067 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc2ad68cfdd54ebeb40ce4aa7506f0b4', 'request_id': 'req-d717df3e-c1bf-4e54-bfae-5b0ba81ac067'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:28:35.520179 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-d717df3e-c1bf-4e54-bfae-5b0ba81ac067 admin admin] The token cache is being invalidate because project cc2ad68cfdd54ebeb40ce4aa7506f0b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:28:35.521352 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-d717df3e-c1bf-4e54-bfae-5b0ba81ac067 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:28:35.522832 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-d717df3e-c1bf-4e54-bfae-5b0ba81ac067 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:28:35.530114 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1174/2339] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:28:35 2022] DELETE /identity/v3/projects/cc2ad68cfdd54ebeb40ce4aa7506f0b4 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 10:28:35.543862 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-e3e721cb-a778-482c-acdc-9ae90d3496ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b61d5fb2808486eb7687bf744edab8a', 'request_id': 'req-e3e721cb-a778-482c-acdc-9ae90d3496ae'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:28:35.550954 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-e3e721cb-a778-482c-acdc-9ae90d3496ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b61d5fb2808486eb7687bf744edab8a', 'request_id': 'req-e3e721cb-a778-482c-acdc-9ae90d3496ae'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:28:35.560013 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-e3e721cb-a778-482c-acdc-9ae90d3496ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b61d5fb2808486eb7687bf744edab8a', 'request_id': 'req-e3e721cb-a778-482c-acdc-9ae90d3496ae'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:28:35.575726 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-e3e721cb-a778-482c-acdc-9ae90d3496ae admin admin] The token cache is being invalidate because project 5b61d5fb2808486eb7687bf744edab8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80105) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:28:35.576022 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-e3e721cb-a778-482c-acdc-9ae90d3496ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:28:35.579273 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-e3e721cb-a778-482c-acdc-9ae90d3496ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:28:35.585357 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1166/2340] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:28:35 2022] DELETE /identity/v3/projects/5b61d5fb2808486eb7687bf744edab8a => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:28:35.587852 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6c21fd-670e-46f6-8c44-43cfcfa420dd None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:28:35.588251 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6c21fd-670e-46f6-8c44-43cfcfa420dd None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:28:35.588649 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6c21fd-670e-46f6-8c44-43cfcfa420dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:28:35.611628 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-be6c21fd-670e-46f6-8c44-43cfcfa420dd None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:28:35.613060 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-be6c21fd-670e-46f6-8c44-43cfcfa420dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:28:35.689397 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:28:35.723431 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1175/2341] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:28:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:28:35.728295 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d645205c-0e64-42ff-8e6c-f263ffac2cc8 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:28:35.728582 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d645205c-0e64-42ff-8e6c-f263ffac2cc8 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:28:35.728860 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d645205c-0e64-42ff-8e6c-f263ffac2cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:28:35.747328 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:28:35.755860 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-d645205c-0e64-42ff-8e6c-f263ffac2cc8 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:28:35.757949 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-d645205c-0e64-42ff-8e6c-f263ffac2cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:28:35.769065 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1167/2342] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:28:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:28:35.773639 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6c21fd-670e-46f6-8c44-43cfcfa420dd None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:28:35.784973 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6c21fd-670e-46f6-8c44-43cfcfa420dd None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:28:35.792780 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24d9191-217e-4518-bea6-b77589732792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:28:35.793522 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24d9191-217e-4518-bea6-b77589732792 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:28:35.793888 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24d9191-217e-4518-bea6-b77589732792 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:28:35.794262 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24d9191-217e-4518-bea6-b77589732792 admin admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:28:35.795497 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24d9191-217e-4518-bea6-b77589732792 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:28:35.795886 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24d9191-217e-4518-bea6-b77589732792 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:28:35.797650 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24d9191-217e-4518-bea6-b77589732792 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:28:35.813453 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1176/2343] 10.222.0.36 () {58 vars in 1153 bytes} [Tue Aug 9 10:28:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:28:35.818031 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d645205c-0e64-42ff-8e6c-f263ffac2cc8 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:28:35.827774 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d645205c-0e64-42ff-8e6c-f263ffac2cc8 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:28:35.832580 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a953790a-4dff-4efe-9add-119130b5eec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:28:35.833157 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953790a-4dff-4efe-9add-119130b5eec7 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:28:35.833428 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953790a-4dff-4efe-9add-119130b5eec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:28:35.833775 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953790a-4dff-4efe-9add-119130b5eec7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:28:35.834368 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a953790a-4dff-4efe-9add-119130b5eec7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:28:35.836287 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a953790a-4dff-4efe-9add-119130b5eec7 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:28:35.872605 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1168/2344] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:28:35 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 10:28:35.874505 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24d9191-217e-4518-bea6-b77589732792 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:28:35.885352 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24d9191-217e-4518-bea6-b77589732792 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:28:35.948008 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873faf5c-fef3-417f-a2a6-703b9a0d1068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:28:35.949128 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873faf5c-fef3-417f-a2a6-703b9a0d1068 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:28:35.949128 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873faf5c-fef3-417f-a2a6-703b9a0d1068 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:28:35.949128 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873faf5c-fef3-417f-a2a6-703b9a0d1068 admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:28:35.949749 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873faf5c-fef3-417f-a2a6-703b9a0d1068 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:28:35.951746 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873faf5c-fef3-417f-a2a6-703b9a0d1068 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:28:35.973514 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1177/2345] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:28:35 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:28:35.977611 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a953790a-4dff-4efe-9add-119130b5eec7 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:28:35.988065 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a953790a-4dff-4efe-9add-119130b5eec7 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:28:35.992876 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5337edd2-999f-4f40-b37e-73725c18f30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:28:35.993459 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5337edd2-999f-4f40-b37e-73725c18f30d admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:28:35.993730 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5337edd2-999f-4f40-b37e-73725c18f30d admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:28:35.994033 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5337edd2-999f-4f40-b37e-73725c18f30d admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:28:35.994667 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5337edd2-999f-4f40-b37e-73725c18f30d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:28:35.996276 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5337edd2-999f-4f40-b37e-73725c18f30d admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:28:36.007342 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1169/2346] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:28:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 10:28:36.011403 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873faf5c-fef3-417f-a2a6-703b9a0d1068 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:28:36.022214 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873faf5c-fef3-417f-a2a6-703b9a0d1068 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:28:36.027261 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dfc149-a4c4-4bd7-ae29-8a5ae6152765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:28:36.027887 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dfc149-a4c4-4bd7-ae29-8a5ae6152765 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:28:36.028169 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dfc149-a4c4-4bd7-ae29-8a5ae6152765 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:28:36.028467 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dfc149-a4c4-4bd7-ae29-8a5ae6152765 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:28:36.029167 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dfc149-a4c4-4bd7-ae29-8a5ae6152765 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:28:36.030849 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dfc149-a4c4-4bd7-ae29-8a5ae6152765 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:28:36.041326 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1178/2347] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:28:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:28:36.045505 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5337edd2-999f-4f40-b37e-73725c18f30d admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:28:36.057760 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5337edd2-999f-4f40-b37e-73725c18f30d admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:28:36.063174 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af318f4-9541-4f73-87eb-ebca6e66e44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:28:36.063916 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af318f4-9541-4f73-87eb-ebca6e66e44b admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:28:36.064262 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af318f4-9541-4f73-87eb-ebca6e66e44b admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:28:36.064636 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af318f4-9541-4f73-87eb-ebca6e66e44b admin admin] PATH_INFO: `/v3/projects/00cf6bea1aed4df2ac12368709a3901d/users/7a08bd80820847bba282dc1149106860/roles/a9895331e9694fa8b2b50908bb057bcb` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:28:36.084953 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af318f4-9541-4f73-87eb-ebca6e66e44b admin admin] RBAC: Authorizing `identity:create_grant(project_id=00cf6bea1aed4df2ac12368709a3901d, user_id=7a08bd80820847bba282dc1149106860, role_id=a9895331e9694fa8b2b50908bb057bcb)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:28:36.087516 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af318f4-9541-4f73-87eb-ebca6e66e44b admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:28:36.102305 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1170/2348] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:28:36 2022] PUT /identity/v3/projects/00cf6bea1aed4df2ac12368709a3901d/users/7a08bd80820847bba282dc1149106860/roles/a9895331e9694fa8b2b50908bb057bcb => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:28:36.112621 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e2278-256e-4fd1-ae09-4da57484eb5d None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:28:36.112906 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e2278-256e-4fd1-ae09-4da57484eb5d None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:28:36.113175 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e2278-256e-4fd1-ae09-4da57484eb5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:28:36.142339 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-cd5e2278-256e-4fd1-ae09-4da57484eb5d None None] MFA Rules not processed for user `7a08bd80820847bba282dc1149106860`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:28:36.143481 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-cd5e2278-256e-4fd1-ae09-4da57484eb5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:28:36.215653 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1179/2349] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:28:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:28:36.219753 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af318f4-9541-4f73-87eb-ebca6e66e44b admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:28:36.300444 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af318f4-9541-4f73-87eb-ebca6e66e44b admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:28:36.308440 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63aa351-f38e-4365-8286-f7e0c0ee6204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:28:36.309054 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63aa351-f38e-4365-8286-f7e0c0ee6204 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:28:36.309332 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63aa351-f38e-4365-8286-f7e0c0ee6204 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:28:36.309603 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63aa351-f38e-4365-8286-f7e0c0ee6204 admin admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:28:36.310254 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63aa351-f38e-4365-8286-f7e0c0ee6204 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:28:36.313782 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63aa351-f38e-4365-8286-f7e0c0ee6204 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:28:36.354276 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1171/2350] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:28:36 2022] POST /identity/v3/projects => generated 371 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 10:28:36.354801 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e2278-256e-4fd1-ae09-4da57484eb5d None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:28:36.367051 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e2278-256e-4fd1-ae09-4da57484eb5d None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:28:36.408134 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:28:36.429256 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f2c87e-966e-4d51-8e8e-9671fc492de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:28:36.429955 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f2c87e-966e-4d51-8e8e-9671fc492de7 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:28:36.430175 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f2c87e-966e-4d51-8e8e-9671fc492de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:28:36.430490 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f2c87e-966e-4d51-8e8e-9671fc492de7 admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:28:36.431105 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f2c87e-966e-4d51-8e8e-9671fc492de7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:28:36.434021 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f2c87e-966e-4d51-8e8e-9671fc492de7 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:28:36.459604 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1180/2351] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:28:36 2022] POST /identity/v3/users => generated 292 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 10:28:36.463863 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63aa351-f38e-4365-8286-f7e0c0ee6204 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:28:36.475029 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63aa351-f38e-4365-8286-f7e0c0ee6204 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:28:36.479837 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ece677f-8237-4082-80f1-17699e2297fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:28:36.480444 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ece677f-8237-4082-80f1-17699e2297fd admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:28:36.480724 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ece677f-8237-4082-80f1-17699e2297fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:28:36.480995 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ece677f-8237-4082-80f1-17699e2297fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:28:36.481671 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ece677f-8237-4082-80f1-17699e2297fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:28:36.483308 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ece677f-8237-4082-80f1-17699e2297fd admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:28:36.494449 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1172/2352] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:28:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:28:36.498671 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f2c87e-966e-4d51-8e8e-9671fc492de7 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:28:36.510280 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f2c87e-966e-4d51-8e8e-9671fc492de7 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:28:36.515107 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9719ba7a-b1df-4f22-b324-4ad5d436d92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:28:36.515804 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719ba7a-b1df-4f22-b324-4ad5d436d92b admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:28:36.516084 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719ba7a-b1df-4f22-b324-4ad5d436d92b admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:28:36.516357 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719ba7a-b1df-4f22-b324-4ad5d436d92b admin admin] PATH_INFO: `/v3/projects/22b66f31ee7c4277b1f044fbb3a423be/users/d51f7c046f5a409c9a42e611cc836298/roles/89ca30cbbb634be8a96e9921aa56626b` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:28:36.532547 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9719ba7a-b1df-4f22-b324-4ad5d436d92b admin admin] RBAC: Authorizing `identity:create_grant(project_id=22b66f31ee7c4277b1f044fbb3a423be, user_id=d51f7c046f5a409c9a42e611cc836298, role_id=89ca30cbbb634be8a96e9921aa56626b)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:28:36.535271 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9719ba7a-b1df-4f22-b324-4ad5d436d92b admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:28:36.549934 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1181/2353] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:28:36 2022] PUT /identity/v3/projects/22b66f31ee7c4277b1f044fbb3a423be/users/d51f7c046f5a409c9a42e611cc836298/roles/89ca30cbbb634be8a96e9921aa56626b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:28:36.553058 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ece677f-8237-4082-80f1-17699e2297fd admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:28:36.563028 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ece677f-8237-4082-80f1-17699e2297fd admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:28:36.620755 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1499d6-260e-491d-ada6-91708dfdb4f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:28:36.621387 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1499d6-260e-491d-ada6-91708dfdb4f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:28:36.621669 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1499d6-260e-491d-ada6-91708dfdb4f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:28:36.621964 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1499d6-260e-491d-ada6-91708dfdb4f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:28:36.622597 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1499d6-260e-491d-ada6-91708dfdb4f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:28:36.624163 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1499d6-260e-491d-ada6-91708dfdb4f9 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:28:36.634498 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1173/2354] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:28:36 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:28:36.638428 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9719ba7a-b1df-4f22-b324-4ad5d436d92b admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:28:36.649151 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9719ba7a-b1df-4f22-b324-4ad5d436d92b admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:28:36.653999 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa826dac-90c2-4614-9b08-5847ba2182ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:28:36.654649 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa826dac-90c2-4614-9b08-5847ba2182ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:28:36.654924 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa826dac-90c2-4614-9b08-5847ba2182ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:28:36.655199 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa826dac-90c2-4614-9b08-5847ba2182ca admin admin] PATH_INFO: `/v3/projects/22b66f31ee7c4277b1f044fbb3a423be/users/d51f7c046f5a409c9a42e611cc836298/roles/89ca30cbbb634be8a96e9921aa56626b` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:28:36.657081 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa826dac-90c2-4614-9b08-5847ba2182ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=22b66f31ee7c4277b1f044fbb3a423be, user_id=d51f7c046f5a409c9a42e611cc836298, role_id=89ca30cbbb634be8a96e9921aa56626b)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:28:36.659754 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa826dac-90c2-4614-9b08-5847ba2182ca admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:28:36.669893 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1182/2355] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:28:36 2022] PUT /identity/v3/projects/22b66f31ee7c4277b1f044fbb3a423be/users/d51f7c046f5a409c9a42e611cc836298/roles/89ca30cbbb634be8a96e9921aa56626b => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:28:36.681064 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4522d9-b6f7-4224-9451-1d7a09dbe918 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:28:36.681375 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4522d9-b6f7-4224-9451-1d7a09dbe918 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:28:36.681650 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4522d9-b6f7-4224-9451-1d7a09dbe918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:28:36.708746 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:28:36.712222 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-7c4522d9-b6f7-4224-9451-1d7a09dbe918 None None] MFA Rules not processed for user `d51f7c046f5a409c9a42e611cc836298`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:28:36.714128 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-7c4522d9-b6f7-4224-9451-1d7a09dbe918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:28:36.782211 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1174/2356] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:28:36 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:28:36.793664 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa826dac-90c2-4614-9b08-5847ba2182ca admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:28:36.795488 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-fa826dac-90c2-4614-9b08-5847ba2182ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:28:36.852644 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa826dac-90c2-4614-9b08-5847ba2182ca admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:28:36.856120 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c4bb6e-bc3a-4796-b18d-9b14f14a9c19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6c687a38524de0bf23d87ae91d3b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:28:36.856707 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c4bb6e-bc3a-4796-b18d-9b14f14a9c19 service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:28:36.856980 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c4bb6e-bc3a-4796-b18d-9b14f14a9c19 service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:28:36.857247 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c4bb6e-bc3a-4796-b18d-9b14f14a9c19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:28:36.866830 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c4bb6e-bc3a-4796-b18d-9b14f14a9c19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:28:36.868256 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c4bb6e-bc3a-4796-b18d-9b14f14a9c19 service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:28:36.877372 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1183/2357] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:28:36 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:28:36.953465 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4522d9-b6f7-4224-9451-1d7a09dbe918 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:28:36.963469 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4522d9-b6f7-4224-9451-1d7a09dbe918 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:28:36.967039 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a73301-d8aa-4c33-8322-8ae693072955 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6c687a38524de0bf23d87ae91d3b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:28:36.967625 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a73301-d8aa-4c33-8322-8ae693072955 service cinder] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:28:36.967903 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a73301-d8aa-4c33-8322-8ae693072955 service cinder] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:28:36.968168 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a73301-d8aa-4c33-8322-8ae693072955 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:28:37.023718 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a73301-d8aa-4c33-8322-8ae693072955 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:28:37.025134 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a73301-d8aa-4c33-8322-8ae693072955 service cinder] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:28:37.034636 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1175/2358] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:28:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:28:46.873278 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=52,keystone:INSERT=5 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:28:47.030287 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=56 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:28:48.797785 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c4bb6e-bc3a-4796-b18d-9b14f14a9c19 service cinder] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:28:48.806949 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c4bb6e-bc3a-4796-b18d-9b14f14a9c19 service cinder] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:28:48.810433 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d81b04-2934-47a1-849f-c6c86d7588dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6c687a38524de0bf23d87ae91d3b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:28:48.811013 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d81b04-2934-47a1-849f-c6c86d7588dd service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:28:48.811286 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d81b04-2934-47a1-849f-c6c86d7588dd service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:28:48.811554 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d81b04-2934-47a1-849f-c6c86d7588dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:28:48.813209 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-87d81b04-2934-47a1-849f-c6c86d7588dd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:28:48.871287 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d81b04-2934-47a1-849f-c6c86d7588dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:28:48.872723 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d81b04-2934-47a1-849f-c6c86d7588dd service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:28:48.882274 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1184/2359] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:28:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:28:53.002151 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a73301-d8aa-4c33-8322-8ae693072955 service cinder] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:28:53.003609 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-85a73301-d8aa-4c33-8322-8ae693072955 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:28:53.079854 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a73301-d8aa-4c33-8322-8ae693072955 service cinder] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:28:53.086061 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6165d9-5f13-4aa6-af24-381990cf14a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb863beaaa9f495c8b64655996c061f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:28:53.086670 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6165d9-5f13-4aa6-af24-381990cf14a9 service nova] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:28:53.086945 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6165d9-5f13-4aa6-af24-381990cf14a9 service nova] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:28:53.087215 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6165d9-5f13-4aa6-af24-381990cf14a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:28:53.088981 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-0c6165d9-5f13-4aa6-af24-381990cf14a9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:28:53.151865 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6165d9-5f13-4aa6-af24-381990cf14a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:28:53.154094 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6165d9-5f13-4aa6-af24-381990cf14a9 service nova] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:28:53.165002 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1176/2360] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:28:53 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:28:56.859388 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaedbb5-359e-4ac2-84d8-5e4bc92f83cd None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:28:56.860228 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaedbb5-359e-4ac2-84d8-5e4bc92f83cd None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:28:56.862250 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaedbb5-359e-4ac2-84d8-5e4bc92f83cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:28:56.888929 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-2eaedbb5-359e-4ac2-84d8-5e4bc92f83cd None None] MFA Rules not processed for user `cedc4d6c59c44c6d8fb7179070db5e91`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:28:56.888929 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-2eaedbb5-359e-4ac2-84d8-5e4bc92f83cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:28:56.949253 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1185/2361] 10.222.0.36 () {58 vars in 1009 bytes} [Tue Aug 9 10:28:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:28:56.957414 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6165d9-5f13-4aa6-af24-381990cf14a9 service nova] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:28:56.959658 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-0c6165d9-5f13-4aa6-af24-381990cf14a9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:28:57.039878 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6165d9-5f13-4aa6-af24-381990cf14a9 service nova] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:28:57.046089 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d3505c-2080-4736-a883-2b1aee8ec27b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '841c5dbaae774944b637c533ebd75b29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:28:57.046718 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3505c-2080-4736-a883-2b1aee8ec27b service swift] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:28:57.047464 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3505c-2080-4736-a883-2b1aee8ec27b service swift] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:28:57.047742 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3505c-2080-4736-a883-2b1aee8ec27b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:28:57.058173 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d3505c-2080-4736-a883-2b1aee8ec27b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:28:57.059767 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d3505c-2080-4736-a883-2b1aee8ec27b service swift] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:28:57.069407 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1177/2362] 10.222.0.36 () {60 vars in 1384 bytes} [Tue Aug 9 10:28:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 10:29:04.359400 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaedbb5-359e-4ac2-84d8-5e4bc92f83cd None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:04.361166 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-2eaedbb5-359e-4ac2-84d8-5e4bc92f83cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:04.431261 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaedbb5-359e-4ac2-84d8-5e4bc92f83cd None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:04.437086 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4106c67e-eabb-4b8f-bc99-ac7c31e67911 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:04.437774 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4106c67e-eabb-4b8f-bc99-ac7c31e67911 service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:04.438056 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4106c67e-eabb-4b8f-bc99-ac7c31e67911 service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:04.438502 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4106c67e-eabb-4b8f-bc99-ac7c31e67911 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:04.440396 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-4106c67e-eabb-4b8f-bc99-ac7c31e67911 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:04.507094 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:29:04.511136 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4106c67e-eabb-4b8f-bc99-ac7c31e67911 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:04.512974 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4106c67e-eabb-4b8f-bc99-ac7c31e67911 service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:04.526206 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1186/2363] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:29:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:29:05.799213 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d3505c-2080-4736-a883-2b1aee8ec27b service swift] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:05.801421 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-68d3505c-2080-4736-a883-2b1aee8ec27b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:05.838535 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d3505c-2080-4736-a883-2b1aee8ec27b service swift] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:05.851436 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d627f30-4edc-4aa5-9e46-f826fd0d9242 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb863beaaa9f495c8b64655996c061f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:05.853980 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d627f30-4edc-4aa5-9e46-f826fd0d9242 service nova] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:05.854298 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d627f30-4edc-4aa5-9e46-f826fd0d9242 service nova] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:05.854912 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d627f30-4edc-4aa5-9e46-f826fd0d9242 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:05.859526 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-7d627f30-4edc-4aa5-9e46-f826fd0d9242 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:05.928768 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:29:05.990557 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d627f30-4edc-4aa5-9e46-f826fd0d9242 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:05.995612 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d627f30-4edc-4aa5-9e46-f826fd0d9242 service nova] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:06.012287 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1178/2364] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:29:05 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:29:07.418182 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4106c67e-eabb-4b8f-bc99-ac7c31e67911 service neutron] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:07.429529 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4106c67e-eabb-4b8f-bc99-ac7c31e67911 service neutron] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:07.434418 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ca0617-b491-455a-a2a5-7c3824ec73fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:07.435061 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca0617-b491-455a-a2a5-7c3824ec73fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:07.435423 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca0617-b491-455a-a2a5-7c3824ec73fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:07.435655 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca0617-b491-455a-a2a5-7c3824ec73fb admin admin] PATH_INFO: `/v3/users/7a08bd80820847bba282dc1149106860` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:07.436782 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ca0617-b491-455a-a2a5-7c3824ec73fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a08bd80820847bba282dc1149106860)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:07.438804 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ca0617-b491-455a-a2a5-7c3824ec73fb admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:07.534565 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-95ca0617-b491-455a-a2a5-7c3824ec73fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a08bd80820847bba282dc1149106860'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:07.557131 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-95ca0617-b491-455a-a2a5-7c3824ec73fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a08bd80820847bba282dc1149106860'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:07.567036 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-95ca0617-b491-455a-a2a5-7c3824ec73fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a08bd80820847bba282dc1149106860'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:07.569262 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-95ca0617-b491-455a-a2a5-7c3824ec73fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a08bd80820847bba282dc1149106860'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:07.583675 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-95ca0617-b491-455a-a2a5-7c3824ec73fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a08bd80820847bba282dc1149106860'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:07.597337 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1187/2365] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:29:07 2022] DELETE /identity/v3/users/7a08bd80820847bba282dc1149106860 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:29:07.602374 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67892131-8ac0-498e-85cc-6877cb0c0ab2 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:07.602855 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67892131-8ac0-498e-85cc-6877cb0c0ab2 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:07.603029 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67892131-8ac0-498e-85cc-6877cb0c0ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:07.629497 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-67892131-8ac0-498e-85cc-6877cb0c0ab2 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:29:07.631848 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-67892131-8ac0-498e-85cc-6877cb0c0ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:07.706281 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1179/2366] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:29:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:29:07.715954 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ca0617-b491-455a-a2a5-7c3824ec73fb admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:07.717371 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-95ca0617-b491-455a-a2a5-7c3824ec73fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:07.779430 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ca0617-b491-455a-a2a5-7c3824ec73fb admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:07.785766 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645e0ebd-9fdf-4242-b6c9-0b0621a01d99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:07.785766 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e0ebd-9fdf-4242-b6c9-0b0621a01d99 service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:07.785766 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e0ebd-9fdf-4242-b6c9-0b0621a01d99 service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:07.785766 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e0ebd-9fdf-4242-b6c9-0b0621a01d99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:07.811131 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67892131-8ac0-498e-85cc-6877cb0c0ab2 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:07.813438 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645e0ebd-9fdf-4242-b6c9-0b0621a01d99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:07.815016 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645e0ebd-9fdf-4242-b6c9-0b0621a01d99 service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:07.824869 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67892131-8ac0-498e-85cc-6877cb0c0ab2 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:07.829187 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42646d57-b2be-4ff8-b434-d3a60138bb97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:07.829994 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42646d57-b2be-4ff8-b434-d3a60138bb97 service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:07.830383 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42646d57-b2be-4ff8-b434-d3a60138bb97 service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:07.830785 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42646d57-b2be-4ff8-b434-d3a60138bb97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:07.832750 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-42646d57-b2be-4ff8-b434-d3a60138bb97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:07.846074 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42646d57-b2be-4ff8-b434-d3a60138bb97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:07.848101 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42646d57-b2be-4ff8-b434-d3a60138bb97 service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:07.852021 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1188/2367] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:29:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:29:07.861737 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1180/2368] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:29:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 10:29:08.620487 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645e0ebd-9fdf-4242-b6c9-0b0621a01d99 service neutron] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:08.625148 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-645e0ebd-9fdf-4242-b6c9-0b0621a01d99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:08.640645 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645e0ebd-9fdf-4242-b6c9-0b0621a01d99 service neutron] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:08.646587 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312e98e3-045a-4a9e-8640-b385a6f389ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:08.647209 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312e98e3-045a-4a9e-8640-b385a6f389ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:08.647487 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312e98e3-045a-4a9e-8640-b385a6f389ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:08.647759 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312e98e3-045a-4a9e-8640-b385a6f389ba admin admin] PATH_INFO: `/v3/users/efd69dedc75842f495bde0c20799a340` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:08.648872 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312e98e3-045a-4a9e-8640-b385a6f389ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=efd69dedc75842f495bde0c20799a340)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:08.651069 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312e98e3-045a-4a9e-8640-b385a6f389ba admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:08.699917 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-312e98e3-045a-4a9e-8640-b385a6f389ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efd69dedc75842f495bde0c20799a340'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:08.716854 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:29:08.718698 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-312e98e3-045a-4a9e-8640-b385a6f389ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efd69dedc75842f495bde0c20799a340'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:08.731285 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-312e98e3-045a-4a9e-8640-b385a6f389ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efd69dedc75842f495bde0c20799a340'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:08.732536 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-312e98e3-045a-4a9e-8640-b385a6f389ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efd69dedc75842f495bde0c20799a340'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:08.741226 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-312e98e3-045a-4a9e-8640-b385a6f389ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efd69dedc75842f495bde0c20799a340'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:08.748346 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1189/2369] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:29:08 2022] DELETE /identity/v3/users/efd69dedc75842f495bde0c20799a340 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:29:08.865023 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42646d57-b2be-4ff8-b434-d3a60138bb97 service neutron] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:08.874448 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-42646d57-b2be-4ff8-b434-d3a60138bb97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:08.897093 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42646d57-b2be-4ff8-b434-d3a60138bb97 service neutron] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:08.936776 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312e98e3-045a-4a9e-8640-b385a6f389ba admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:08.938471 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-312e98e3-045a-4a9e-8640-b385a6f389ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:08.972778 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218de647-525e-42ac-a044-a2bd12ca0f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:08.974193 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218de647-525e-42ac-a044-a2bd12ca0f3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:08.974634 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218de647-525e-42ac-a044-a2bd12ca0f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:08.974912 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218de647-525e-42ac-a044-a2bd12ca0f3d admin admin] PATH_INFO: `/v3/projects/00cf6bea1aed4df2ac12368709a3901d` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:08.976056 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218de647-525e-42ac-a044-a2bd12ca0f3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=00cf6bea1aed4df2ac12368709a3901d)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:08.977986 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218de647-525e-42ac-a044-a2bd12ca0f3d admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:09.006774 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312e98e3-045a-4a9e-8640-b385a6f389ba admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:09.011794 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0753b83d-7554-448d-a2d0-f6da2b8edd2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:09.012448 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753b83d-7554-448d-a2d0-f6da2b8edd2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:09.012722 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753b83d-7554-448d-a2d0-f6da2b8edd2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:09.012993 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753b83d-7554-448d-a2d0-f6da2b8edd2e admin admin] PATH_INFO: `/v3/projects/20b19bd1345f4d169902c867aca01f47` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:09.014128 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0753b83d-7554-448d-a2d0-f6da2b8edd2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=20b19bd1345f4d169902c867aca01f47)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:09.016036 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0753b83d-7554-448d-a2d0-f6da2b8edd2e admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:09.028300 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-218de647-525e-42ac-a044-a2bd12ca0f3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00cf6bea1aed4df2ac12368709a3901d', 'request_id': 'req-218de647-525e-42ac-a044-a2bd12ca0f3d'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:09.035229 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:29:09.039941 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-218de647-525e-42ac-a044-a2bd12ca0f3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00cf6bea1aed4df2ac12368709a3901d', 'request_id': 'req-218de647-525e-42ac-a044-a2bd12ca0f3d'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:09.047218 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-218de647-525e-42ac-a044-a2bd12ca0f3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00cf6bea1aed4df2ac12368709a3901d', 'request_id': 'req-218de647-525e-42ac-a044-a2bd12ca0f3d'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:09.060912 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-218de647-525e-42ac-a044-a2bd12ca0f3d admin admin] The token cache is being invalidate because project 00cf6bea1aed4df2ac12368709a3901d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80105) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:29:09.061203 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-218de647-525e-42ac-a044-a2bd12ca0f3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:09.061823 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-218de647-525e-42ac-a044-a2bd12ca0f3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:09.063477 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1181/2370] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:29:08 2022] DELETE /identity/v3/projects/00cf6bea1aed4df2ac12368709a3901d => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:29:09.067271 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218de647-525e-42ac-a044-a2bd12ca0f3d admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:09.068597 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-218de647-525e-42ac-a044-a2bd12ca0f3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:09.076491 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-0753b83d-7554-448d-a2d0-f6da2b8edd2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20b19bd1345f4d169902c867aca01f47', 'request_id': 'req-0753b83d-7554-448d-a2d0-f6da2b8edd2e'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:09.081914 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-0753b83d-7554-448d-a2d0-f6da2b8edd2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20b19bd1345f4d169902c867aca01f47', 'request_id': 'req-0753b83d-7554-448d-a2d0-f6da2b8edd2e'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:09.088768 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-0753b83d-7554-448d-a2d0-f6da2b8edd2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20b19bd1345f4d169902c867aca01f47', 'request_id': 'req-0753b83d-7554-448d-a2d0-f6da2b8edd2e'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:09.102197 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-0753b83d-7554-448d-a2d0-f6da2b8edd2e admin admin] The token cache is being invalidate because project 20b19bd1345f4d169902c867aca01f47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:29:09.102483 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-0753b83d-7554-448d-a2d0-f6da2b8edd2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:09.103117 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-0753b83d-7554-448d-a2d0-f6da2b8edd2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:09.104841 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1190/2371] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:29:08 2022] DELETE /identity/v3/projects/20b19bd1345f4d169902c867aca01f47 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 10:29:09.109601 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aed0889-b2de-4fc2-8795-ba02ab7fc69a None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:09.110063 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aed0889-b2de-4fc2-8795-ba02ab7fc69a None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:09.110439 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aed0889-b2de-4fc2-8795-ba02ab7fc69a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:09.131200 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-8aed0889-b2de-4fc2-8795-ba02ab7fc69a None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:29:09.132401 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-8aed0889-b2de-4fc2-8795-ba02ab7fc69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:09.144764 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218de647-525e-42ac-a044-a2bd12ca0f3d admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:09.197790 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1191/2372] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:29:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 10:29:09.205363 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405635a6-1e2e-4cea-b081-01646e685401 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:09.205657 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405635a6-1e2e-4cea-b081-01646e685401 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:09.205968 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405635a6-1e2e-4cea-b081-01646e685401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:09.214251 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc2503c-6bd9-4780-8bc8-a45b4494a346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:09.214962 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc2503c-6bd9-4780-8bc8-a45b4494a346 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:09.215243 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc2503c-6bd9-4780-8bc8-a45b4494a346 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:09.215515 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc2503c-6bd9-4780-8bc8-a45b4494a346 admin admin] PATH_INFO: `/v3/users/d51f7c046f5a409c9a42e611cc836298` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:09.216665 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc2503c-6bd9-4780-8bc8-a45b4494a346 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d51f7c046f5a409c9a42e611cc836298)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:09.218690 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc2503c-6bd9-4780-8bc8-a45b4494a346 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:09.227430 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-405635a6-1e2e-4cea-b081-01646e685401 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:29:09.228631 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-405635a6-1e2e-4cea-b081-01646e685401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:09.236418 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1192/2373] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:29:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 10:29:09.240794 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405635a6-1e2e-4cea-b081-01646e685401 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:09.246106 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:29:09.250139 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405635a6-1e2e-4cea-b081-01646e685401 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:09.256859 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1049ecaa-f73b-4cf1-82f6-66012dce4681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:09.257437 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1049ecaa-f73b-4cf1-82f6-66012dce4681 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:09.258056 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1049ecaa-f73b-4cf1-82f6-66012dce4681 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:09.258382 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1049ecaa-f73b-4cf1-82f6-66012dce4681 admin admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:09.259209 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1049ecaa-f73b-4cf1-82f6-66012dce4681 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:29:09.259595 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1049ecaa-f73b-4cf1-82f6-66012dce4681 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:09.261461 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1049ecaa-f73b-4cf1-82f6-66012dce4681 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:09.272155 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-ebc2503c-6bd9-4780-8bc8-a45b4494a346 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd51f7c046f5a409c9a42e611cc836298'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:09.273482 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1193/2374] 10.222.0.36 () {58 vars in 1153 bytes} [Tue Aug 9 10:29:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:29:09.278053 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1049ecaa-f73b-4cf1-82f6-66012dce4681 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:09.287827 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1049ecaa-f73b-4cf1-82f6-66012dce4681 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:09.288817 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-ebc2503c-6bd9-4780-8bc8-a45b4494a346 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd51f7c046f5a409c9a42e611cc836298'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:09.292963 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c58d49-11ce-4b02-b0c1-fbc94e78d07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:09.293527 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c58d49-11ce-4b02-b0c1-fbc94e78d07b admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:09.293802 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c58d49-11ce-4b02-b0c1-fbc94e78d07b admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:09.294191 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c58d49-11ce-4b02-b0c1-fbc94e78d07b admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:09.294824 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c58d49-11ce-4b02-b0c1-fbc94e78d07b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:09.295837 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-ebc2503c-6bd9-4780-8bc8-a45b4494a346 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd51f7c046f5a409c9a42e611cc836298'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:09.296550 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-ebc2503c-6bd9-4780-8bc8-a45b4494a346 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd51f7c046f5a409c9a42e611cc836298'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:09.296703 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c58d49-11ce-4b02-b0c1-fbc94e78d07b admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:09.304684 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-ebc2503c-6bd9-4780-8bc8-a45b4494a346 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd51f7c046f5a409c9a42e611cc836298'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:09.311367 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1182/2375] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:29:09 2022] DELETE /identity/v3/users/d51f7c046f5a409c9a42e611cc836298 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 10:29:09.328282 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1194/2376] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:29:09 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:29:09.329352 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc2503c-6bd9-4780-8bc8-a45b4494a346 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:09.330950 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-ebc2503c-6bd9-4780-8bc8-a45b4494a346 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:09.342291 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:29:09.403564 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc2503c-6bd9-4780-8bc8-a45b4494a346 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:09.462124 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffe4ee9-70c9-44d4-9a1e-693bdc31d7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:09.465225 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffe4ee9-70c9-44d4-9a1e-693bdc31d7fd admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:09.465225 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffe4ee9-70c9-44d4-9a1e-693bdc31d7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:09.465225 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffe4ee9-70c9-44d4-9a1e-693bdc31d7fd admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:09.465225 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffe4ee9-70c9-44d4-9a1e-693bdc31d7fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:09.466546 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffe4ee9-70c9-44d4-9a1e-693bdc31d7fd admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:09.493652 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1183/2377] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:29:09 2022] POST /identity/v3/users => generated 293 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 10:29:09.495049 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c58d49-11ce-4b02-b0c1-fbc94e78d07b admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:09.506509 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c58d49-11ce-4b02-b0c1-fbc94e78d07b admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:09.519819 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c3762d-9b61-47bf-87aa-e730b461788f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:09.521012 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c3762d-9b61-47bf-87aa-e730b461788f admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:09.521470 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c3762d-9b61-47bf-87aa-e730b461788f admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:09.521745 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c3762d-9b61-47bf-87aa-e730b461788f admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:09.522582 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c3762d-9b61-47bf-87aa-e730b461788f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:09.524202 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c3762d-9b61-47bf-87aa-e730b461788f admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:09.535828 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1195/2378] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:29:09 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 10:29:09.539922 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffe4ee9-70c9-44d4-9a1e-693bdc31d7fd admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:09.551445 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffe4ee9-70c9-44d4-9a1e-693bdc31d7fd admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:09.557346 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2b3b2e-1e6c-495a-8062-2e6b9d9df87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:09.558247 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2b3b2e-1e6c-495a-8062-2e6b9d9df87f admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:09.558600 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2b3b2e-1e6c-495a-8062-2e6b9d9df87f admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:09.559606 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2b3b2e-1e6c-495a-8062-2e6b9d9df87f admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:09.559606 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2b3b2e-1e6c-495a-8062-2e6b9d9df87f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:09.561392 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2b3b2e-1e6c-495a-8062-2e6b9d9df87f admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:09.573428 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1184/2379] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:29:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:29:09.577687 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c3762d-9b61-47bf-87aa-e730b461788f admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:09.594179 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c3762d-9b61-47bf-87aa-e730b461788f admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:09.601793 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddc8f91-38cb-4254-89e3-243678c41a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:09.602663 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc8f91-38cb-4254-89e3-243678c41a9b admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:09.603044 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc8f91-38cb-4254-89e3-243678c41a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:09.603390 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc8f91-38cb-4254-89e3-243678c41a9b admin admin] PATH_INFO: `/v3/projects/8d500e509fc24b0bb7c41dd0e870ff12/users/49a131c5e9734abb991fabd7058c2d8a/roles/a9895331e9694fa8b2b50908bb057bcb` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:09.609499 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2b3b2e-1e6c-495a-8062-2e6b9d9df87f admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:09.613465 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-7e2b3b2e-1e6c-495a-8062-2e6b9d9df87f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:09.634052 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddc8f91-38cb-4254-89e3-243678c41a9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d500e509fc24b0bb7c41dd0e870ff12, user_id=49a131c5e9734abb991fabd7058c2d8a, role_id=a9895331e9694fa8b2b50908bb057bcb)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:09.636891 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2b3b2e-1e6c-495a-8062-2e6b9d9df87f admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:09.638855 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddc8f91-38cb-4254-89e3-243678c41a9b admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:09.643790 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bb2abd-2d7d-4dd7-9248-8d4fea15205f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:09.644575 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb2abd-2d7d-4dd7-9248-8d4fea15205f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:09.645067 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb2abd-2d7d-4dd7-9248-8d4fea15205f admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:09.645524 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb2abd-2d7d-4dd7-9248-8d4fea15205f admin admin] PATH_INFO: `/v3/projects/22b66f31ee7c4277b1f044fbb3a423be` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:09.647223 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bb2abd-2d7d-4dd7-9248-8d4fea15205f admin admin] RBAC: Authorizing `identity:delete_project(project_id=22b66f31ee7c4277b1f044fbb3a423be)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:09.650430 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bb2abd-2d7d-4dd7-9248-8d4fea15205f admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:09.655703 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1196/2380] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:29:09 2022] PUT /identity/v3/projects/8d500e509fc24b0bb7c41dd0e870ff12/users/49a131c5e9734abb991fabd7058c2d8a/roles/a9895331e9694fa8b2b50908bb057bcb => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:29:09.667145 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888578e-900c-47aa-9823-38b6d7a6cb92 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:09.667440 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888578e-900c-47aa-9823-38b6d7a6cb92 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:09.667714 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888578e-900c-47aa-9823-38b6d7a6cb92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:09.696573 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-c888578e-900c-47aa-9823-38b6d7a6cb92 None None] MFA Rules not processed for user `49a131c5e9734abb991fabd7058c2d8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:29:09.697791 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-c888578e-900c-47aa-9823-38b6d7a6cb92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:09.703019 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-45bb2abd-2d7d-4dd7-9248-8d4fea15205f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22b66f31ee7c4277b1f044fbb3a423be', 'request_id': 'req-45bb2abd-2d7d-4dd7-9248-8d4fea15205f'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:09.711071 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-45bb2abd-2d7d-4dd7-9248-8d4fea15205f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22b66f31ee7c4277b1f044fbb3a423be', 'request_id': 'req-45bb2abd-2d7d-4dd7-9248-8d4fea15205f'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:09.718269 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-45bb2abd-2d7d-4dd7-9248-8d4fea15205f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22b66f31ee7c4277b1f044fbb3a423be', 'request_id': 'req-45bb2abd-2d7d-4dd7-9248-8d4fea15205f'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:09.732000 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-45bb2abd-2d7d-4dd7-9248-8d4fea15205f admin admin] The token cache is being invalidate because project 22b66f31ee7c4277b1f044fbb3a423be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80105) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:29:09.732290 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-45bb2abd-2d7d-4dd7-9248-8d4fea15205f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:09.733045 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-45bb2abd-2d7d-4dd7-9248-8d4fea15205f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:09.735776 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1185/2381] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:29:09 2022] DELETE /identity/v3/projects/22b66f31ee7c4277b1f044fbb3a423be => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:29:09.741038 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef757cc-2587-4c65-ae86-7ae5f9ee69ff None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:09.741399 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef757cc-2587-4c65-ae86-7ae5f9ee69ff None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:09.741740 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef757cc-2587-4c65-ae86-7ae5f9ee69ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:09.763608 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-fef757cc-2587-4c65-ae86-7ae5f9ee69ff None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:29:09.764895 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-fef757cc-2587-4c65-ae86-7ae5f9ee69ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:09.769538 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1197/2382] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:29:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 10:29:09.778128 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:29:09.782123 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c888578e-900c-47aa-9823-38b6d7a6cb92 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:09.783476 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-c888578e-900c-47aa-9823-38b6d7a6cb92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:09.828490 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1186/2383] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:29:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 10:29:09.838458 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5713662-a13b-4c10-8c12-9bb3aaf60827 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:09.838765 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5713662-a13b-4c10-8c12-9bb3aaf60827 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:09.839037 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5713662-a13b-4c10-8c12-9bb3aaf60827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:09.857757 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c888578e-900c-47aa-9823-38b6d7a6cb92 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:09.858569 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-a5713662-a13b-4c10-8c12-9bb3aaf60827 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:29:09.859740 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-a5713662-a13b-4c10-8c12-9bb3aaf60827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:09.863544 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c74f84-655b-4598-959e-12ae9ccc8df8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb863beaaa9f495c8b64655996c061f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:09.864274 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c74f84-655b-4598-959e-12ae9ccc8df8 service nova] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:09.864647 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c74f84-655b-4598-959e-12ae9ccc8df8 service nova] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:09.865011 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c74f84-655b-4598-959e-12ae9ccc8df8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:09.867494 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1187/2384] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:29:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 10:29:09.871556 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5713662-a13b-4c10-8c12-9bb3aaf60827 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:09.874221 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c74f84-655b-4598-959e-12ae9ccc8df8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:09.881037 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5713662-a13b-4c10-8c12-9bb3aaf60827 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:09.882050 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c74f84-655b-4598-959e-12ae9ccc8df8 service nova] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:09.885721 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab05ff30-e8ef-4a24-b347-7391a989a124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:09.886394 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab05ff30-e8ef-4a24-b347-7391a989a124 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:09.886672 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab05ff30-e8ef-4a24-b347-7391a989a124 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:09.886946 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab05ff30-e8ef-4a24-b347-7391a989a124 admin admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:09.887725 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab05ff30-e8ef-4a24-b347-7391a989a124 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:29:09.888055 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab05ff30-e8ef-4a24-b347-7391a989a124 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:09.889613 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab05ff30-e8ef-4a24-b347-7391a989a124 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:09.893409 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1198/2385] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:29:09 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 10:29:09.905805 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1188/2386] 10.222.0.36 () {58 vars in 1153 bytes} [Tue Aug 9 10:29:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:29:09.907002 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c74f84-655b-4598-959e-12ae9ccc8df8 service nova] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:09.918483 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c74f84-655b-4598-959e-12ae9ccc8df8 service nova] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:09.923396 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03faf57-35f0-4ecb-84a9-969876784379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:09.924091 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03faf57-35f0-4ecb-84a9-969876784379 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:09.924466 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03faf57-35f0-4ecb-84a9-969876784379 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:09.924826 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03faf57-35f0-4ecb-84a9-969876784379 admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:09.925713 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03faf57-35f0-4ecb-84a9-969876784379 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:09.927947 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03faf57-35f0-4ecb-84a9-969876784379 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:09.933527 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:29:09.966755 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1199/2387] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:29:09 2022] POST /identity/v3/projects => generated 365 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:29:09.971183 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab05ff30-e8ef-4a24-b347-7391a989a124 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:09.982389 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab05ff30-e8ef-4a24-b347-7391a989a124 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:10.049189 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2746b215-921f-484a-a4c8-99e13f367958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:10.049970 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2746b215-921f-484a-a4c8-99e13f367958 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:10.050328 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2746b215-921f-484a-a4c8-99e13f367958 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:10.050672 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2746b215-921f-484a-a4c8-99e13f367958 admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:10.051379 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2746b215-921f-484a-a4c8-99e13f367958 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:10.053614 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2746b215-921f-484a-a4c8-99e13f367958 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:10.077764 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1189/2388] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:29:09 2022] POST /identity/v3/users => generated 283 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 10:29:10.085565 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03faf57-35f0-4ecb-84a9-969876784379 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:10.096065 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03faf57-35f0-4ecb-84a9-969876784379 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:10.101649 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff355e4-16d1-4903-af1c-1ae37f8937e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:10.102287 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff355e4-16d1-4903-af1c-1ae37f8937e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:10.102568 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff355e4-16d1-4903-af1c-1ae37f8937e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:10.102910 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff355e4-16d1-4903-af1c-1ae37f8937e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:10.103549 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff355e4-16d1-4903-af1c-1ae37f8937e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:10.105138 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff355e4-16d1-4903-af1c-1ae37f8937e6 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:10.119359 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1200/2389] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:29:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:29:10.121493 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2746b215-921f-484a-a4c8-99e13f367958 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:10.133405 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2746b215-921f-484a-a4c8-99e13f367958 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:10.138044 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2db2a4-0b96-42a1-a93f-cddbf3044b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:10.138633 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2db2a4-0b96-42a1-a93f-cddbf3044b02 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:10.138908 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2db2a4-0b96-42a1-a93f-cddbf3044b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:10.139173 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2db2a4-0b96-42a1-a93f-cddbf3044b02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:10.139804 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2db2a4-0b96-42a1-a93f-cddbf3044b02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:10.141378 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2db2a4-0b96-42a1-a93f-cddbf3044b02 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:10.156591 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1190/2390] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:29:10 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:29:10.161194 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff355e4-16d1-4903-af1c-1ae37f8937e6 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:10.172393 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff355e4-16d1-4903-af1c-1ae37f8937e6 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:10.178458 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb5732c-1534-4530-bac2-1e3c47ca261e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:10.179111 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb5732c-1534-4530-bac2-1e3c47ca261e admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:10.179386 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb5732c-1534-4530-bac2-1e3c47ca261e admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:10.179655 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb5732c-1534-4530-bac2-1e3c47ca261e admin admin] PATH_INFO: `/v3/projects/daf8c6977c0b45f4b8c8b39159fc5bc8/users/0c1f5ecbdbcc43b4b3988dfcdea6b063/roles/a9895331e9694fa8b2b50908bb057bcb` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:10.207651 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb5732c-1534-4530-bac2-1e3c47ca261e admin admin] RBAC: Authorizing `identity:create_grant(project_id=daf8c6977c0b45f4b8c8b39159fc5bc8, user_id=0c1f5ecbdbcc43b4b3988dfcdea6b063, role_id=a9895331e9694fa8b2b50908bb057bcb)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:10.212136 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb5732c-1534-4530-bac2-1e3c47ca261e admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:10.229087 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1201/2391] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:29:10 2022] PUT /identity/v3/projects/daf8c6977c0b45f4b8c8b39159fc5bc8/users/0c1f5ecbdbcc43b4b3988dfcdea6b063/roles/a9895331e9694fa8b2b50908bb057bcb => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:29:10.239413 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d6f9e-e8f8-40d0-9640-aa04cc02803b None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:10.239699 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d6f9e-e8f8-40d0-9640-aa04cc02803b None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:10.240009 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d6f9e-e8f8-40d0-9640-aa04cc02803b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:10.271927 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-035d6f9e-e8f8-40d0-9640-aa04cc02803b None None] MFA Rules not processed for user `0c1f5ecbdbcc43b4b3988dfcdea6b063`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:29:10.272771 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-035d6f9e-e8f8-40d0-9640-aa04cc02803b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:10.353339 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1191/2392] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:29:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 10:29:10.357903 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb5732c-1534-4530-bac2-1e3c47ca261e admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:10.429591 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb5732c-1534-4530-bac2-1e3c47ca261e admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:10.435354 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9503ba-4aae-4a72-acd3-32530856bb8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:10.435980 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9503ba-4aae-4a72-acd3-32530856bb8d admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:10.436259 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9503ba-4aae-4a72-acd3-32530856bb8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:10.436590 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9503ba-4aae-4a72-acd3-32530856bb8d admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:10.437173 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9503ba-4aae-4a72-acd3-32530856bb8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:10.439331 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9503ba-4aae-4a72-acd3-32530856bb8d admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:10.474565 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1202/2393] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:29:10 2022] POST /identity/v3/projects => generated 363 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:29:10.479376 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035d6f9e-e8f8-40d0-9640-aa04cc02803b None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:10.492175 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035d6f9e-e8f8-40d0-9640-aa04cc02803b None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:10.496443 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:29:10.564746 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6a09eb-d2d7-4788-896f-2e11c14e380e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:10.565259 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a09eb-d2d7-4788-896f-2e11c14e380e admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:10.565555 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a09eb-d2d7-4788-896f-2e11c14e380e admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:10.565835 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a09eb-d2d7-4788-896f-2e11c14e380e admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:10.566507 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6a09eb-d2d7-4788-896f-2e11c14e380e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:10.568702 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6a09eb-d2d7-4788-896f-2e11c14e380e admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:10.594202 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1192/2394] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:29:10 2022] POST /identity/v3/users => generated 288 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 10:29:10.595466 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9503ba-4aae-4a72-acd3-32530856bb8d admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:10.607194 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9503ba-4aae-4a72-acd3-32530856bb8d admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:10.613336 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b427e3-3a36-4b0a-bd57-6a259d54e733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:10.613997 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b427e3-3a36-4b0a-bd57-6a259d54e733 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:10.614545 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b427e3-3a36-4b0a-bd57-6a259d54e733 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:10.614545 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b427e3-3a36-4b0a-bd57-6a259d54e733 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:10.615219 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b427e3-3a36-4b0a-bd57-6a259d54e733 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:10.616801 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b427e3-3a36-4b0a-bd57-6a259d54e733 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:10.627889 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1203/2395] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:29:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:29:10.632438 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6a09eb-d2d7-4788-896f-2e11c14e380e admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:10.642555 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6a09eb-d2d7-4788-896f-2e11c14e380e admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:10.647803 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aeaee4-dd15-4f4b-87d9-04d634e2ecae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:10.648445 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aeaee4-dd15-4f4b-87d9-04d634e2ecae admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:10.648722 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aeaee4-dd15-4f4b-87d9-04d634e2ecae admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:10.648994 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aeaee4-dd15-4f4b-87d9-04d634e2ecae admin admin] PATH_INFO: `/v3/projects/4ce2b1e854e54400af45f8afc4ac9c53/users/83de95ec3d764594801afa785f1f1491/roles/89ca30cbbb634be8a96e9921aa56626b` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:10.665074 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aeaee4-dd15-4f4b-87d9-04d634e2ecae admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ce2b1e854e54400af45f8afc4ac9c53, user_id=83de95ec3d764594801afa785f1f1491, role_id=89ca30cbbb634be8a96e9921aa56626b)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:10.667746 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aeaee4-dd15-4f4b-87d9-04d634e2ecae admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:10.686210 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1193/2396] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:29:10 2022] PUT /identity/v3/projects/4ce2b1e854e54400af45f8afc4ac9c53/users/83de95ec3d764594801afa785f1f1491/roles/89ca30cbbb634be8a96e9921aa56626b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:29:10.690399 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b427e3-3a36-4b0a-bd57-6a259d54e733 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:10.701048 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b427e3-3a36-4b0a-bd57-6a259d54e733 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:10.766387 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c9ffd8-734b-4f95-85d1-661751387f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:10.766994 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c9ffd8-734b-4f95-85d1-661751387f7f admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:10.767272 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c9ffd8-734b-4f95-85d1-661751387f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:10.767542 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c9ffd8-734b-4f95-85d1-661751387f7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:10.768183 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c9ffd8-734b-4f95-85d1-661751387f7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:10.769771 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c9ffd8-734b-4f95-85d1-661751387f7f admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:10.780775 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1204/2397] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:29:10 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:29:10.784979 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aeaee4-dd15-4f4b-87d9-04d634e2ecae admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:10.795795 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aeaee4-dd15-4f4b-87d9-04d634e2ecae admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:10.800365 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684fb159-4109-425a-b8cf-6c136ed29692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:10.801001 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684fb159-4109-425a-b8cf-6c136ed29692 admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:10.801272 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684fb159-4109-425a-b8cf-6c136ed29692 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:10.801542 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684fb159-4109-425a-b8cf-6c136ed29692 admin admin] PATH_INFO: `/v3/projects/4ce2b1e854e54400af45f8afc4ac9c53/users/83de95ec3d764594801afa785f1f1491/roles/89ca30cbbb634be8a96e9921aa56626b` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:10.803434 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684fb159-4109-425a-b8cf-6c136ed29692 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ce2b1e854e54400af45f8afc4ac9c53, user_id=83de95ec3d764594801afa785f1f1491, role_id=89ca30cbbb634be8a96e9921aa56626b)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:10.807303 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684fb159-4109-425a-b8cf-6c136ed29692 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:10.819711 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1194/2398] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:29:10 2022] PUT /identity/v3/projects/4ce2b1e854e54400af45f8afc4ac9c53/users/83de95ec3d764594801afa785f1f1491/roles/89ca30cbbb634be8a96e9921aa56626b => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:29:10.830309 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e654cb-c031-45a9-9814-f7c43becd9a5 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:10.830714 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e654cb-c031-45a9-9814-f7c43becd9a5 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:10.831137 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e654cb-c031-45a9-9814-f7c43becd9a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:10.865135 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-75e654cb-c031-45a9-9814-f7c43becd9a5 None None] MFA Rules not processed for user `83de95ec3d764594801afa785f1f1491`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:29:10.866383 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-75e654cb-c031-45a9-9814-f7c43becd9a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:10.877235 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:29:10.950949 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1205/2399] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:29:10 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:29:10.965343 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684fb159-4109-425a-b8cf-6c136ed29692 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:10.967324 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-684fb159-4109-425a-b8cf-6c136ed29692 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:11.027139 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684fb159-4109-425a-b8cf-6c136ed29692 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:11.030848 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1d0cf7-f796-46f7-9747-50ed77a38269 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6c687a38524de0bf23d87ae91d3b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:11.031453 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d0cf7-f796-46f7-9747-50ed77a38269 service cinder] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:11.031728 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d0cf7-f796-46f7-9747-50ed77a38269 service cinder] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:11.031996 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d0cf7-f796-46f7-9747-50ed77a38269 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:11.041938 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1d0cf7-f796-46f7-9747-50ed77a38269 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:11.043497 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1d0cf7-f796-46f7-9747-50ed77a38269 service cinder] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:11.054214 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1195/2400] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:29:10 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:29:11.484945 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e654cb-c031-45a9-9814-f7c43becd9a5 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:11.567240 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e654cb-c031-45a9-9814-f7c43becd9a5 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:11.583754 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02541793-32f1-4acd-897c-28eef61137e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb863beaaa9f495c8b64655996c061f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:11.586314 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02541793-32f1-4acd-897c-28eef61137e0 service nova] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:11.586586 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02541793-32f1-4acd-897c-28eef61137e0 service nova] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:11.586891 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02541793-32f1-4acd-897c-28eef61137e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:11.589157 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-02541793-32f1-4acd-897c-28eef61137e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:11.607132 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02541793-32f1-4acd-897c-28eef61137e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:11.608814 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02541793-32f1-4acd-897c-28eef61137e0 service nova] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:11.626087 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1206/2401] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:29:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:29:11.664715 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1d0cf7-f796-46f7-9747-50ed77a38269 service cinder] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:11.748623 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1d0cf7-f796-46f7-9747-50ed77a38269 service cinder] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:11.756683 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feffc96-e557-4488-8f63-0533c78ab64f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:11.758222 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feffc96-e557-4488-8f63-0533c78ab64f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:11.758499 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feffc96-e557-4488-8f63-0533c78ab64f admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:11.758885 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feffc96-e557-4488-8f63-0533c78ab64f admin admin] PATH_INFO: `/v3/users/0c1f5ecbdbcc43b4b3988dfcdea6b063` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:11.760536 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feffc96-e557-4488-8f63-0533c78ab64f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c1f5ecbdbcc43b4b3988dfcdea6b063)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:11.763009 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feffc96-e557-4488-8f63-0533c78ab64f admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:11.766463 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:29:11.828618 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-8feffc96-e557-4488-8f63-0533c78ab64f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c1f5ecbdbcc43b4b3988dfcdea6b063'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:11.872629 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-8feffc96-e557-4488-8f63-0533c78ab64f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c1f5ecbdbcc43b4b3988dfcdea6b063'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:11.885449 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-8feffc96-e557-4488-8f63-0533c78ab64f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c1f5ecbdbcc43b4b3988dfcdea6b063'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:11.886273 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-8feffc96-e557-4488-8f63-0533c78ab64f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c1f5ecbdbcc43b4b3988dfcdea6b063'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:11.901046 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-8feffc96-e557-4488-8f63-0533c78ab64f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c1f5ecbdbcc43b4b3988dfcdea6b063'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:11.910788 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1196/2402] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:29:11 2022] DELETE /identity/v3/users/0c1f5ecbdbcc43b4b3988dfcdea6b063 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 10:29:11.915882 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5fd21d-5410-4aba-b0ce-50f3f6a956c1 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:11.916348 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5fd21d-5410-4aba-b0ce-50f3f6a956c1 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:11.916464 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5fd21d-5410-4aba-b0ce-50f3f6a956c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:11.938178 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-fa5fd21d-5410-4aba-b0ce-50f3f6a956c1 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:29:11.939381 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-fa5fd21d-5410-4aba-b0ce-50f3f6a956c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:12.014712 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1207/2403] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:29:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:29:12.026302 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feffc96-e557-4488-8f63-0533c78ab64f admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:12.028698 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-8feffc96-e557-4488-8f63-0533c78ab64f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:12.127836 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feffc96-e557-4488-8f63-0533c78ab64f admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:12.132189 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f830c6c-dc0b-4ff4-8fa9-ade81efc5d19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:12.132790 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f830c6c-dc0b-4ff4-8fa9-ade81efc5d19 service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:12.133063 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f830c6c-dc0b-4ff4-8fa9-ade81efc5d19 service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:12.133600 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f830c6c-dc0b-4ff4-8fa9-ade81efc5d19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:12.143240 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f830c6c-dc0b-4ff4-8fa9-ade81efc5d19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:12.145044 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f830c6c-dc0b-4ff4-8fa9-ade81efc5d19 service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:12.157424 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1197/2404] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:29:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 10:29:12.412298 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5fd21d-5410-4aba-b0ce-50f3f6a956c1 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:12.413738 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-fa5fd21d-5410-4aba-b0ce-50f3f6a956c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:12.427688 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5fd21d-5410-4aba-b0ce-50f3f6a956c1 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:12.432339 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d1afab-2059-40db-91e6-f1eaef2e6918 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:12.432956 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d1afab-2059-40db-91e6-f1eaef2e6918 service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:12.433256 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d1afab-2059-40db-91e6-f1eaef2e6918 service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:12.433582 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d1afab-2059-40db-91e6-f1eaef2e6918 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:12.435874 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-d0d1afab-2059-40db-91e6-f1eaef2e6918 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:12.448440 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d1afab-2059-40db-91e6-f1eaef2e6918 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:12.450144 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d1afab-2059-40db-91e6-f1eaef2e6918 service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:12.463092 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1208/2405] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:29:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:29:12.467142 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f830c6c-dc0b-4ff4-8fa9-ade81efc5d19 service neutron] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:12.468834 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-0f830c6c-dc0b-4ff4-8fa9-ade81efc5d19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:12.483243 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f830c6c-dc0b-4ff4-8fa9-ade81efc5d19 service neutron] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:12.488836 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2676fcc-00cb-4034-a8f4-91cdbce9ca48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:12.489975 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2676fcc-00cb-4034-a8f4-91cdbce9ca48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:12.490409 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2676fcc-00cb-4034-a8f4-91cdbce9ca48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:12.490831 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2676fcc-00cb-4034-a8f4-91cdbce9ca48 admin admin] PATH_INFO: `/v3/projects/daf8c6977c0b45f4b8c8b39159fc5bc8` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:12.492144 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2676fcc-00cb-4034-a8f4-91cdbce9ca48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=daf8c6977c0b45f4b8c8b39159fc5bc8)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:12.494428 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2676fcc-00cb-4034-a8f4-91cdbce9ca48 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:12.555537 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-f2676fcc-00cb-4034-a8f4-91cdbce9ca48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'daf8c6977c0b45f4b8c8b39159fc5bc8', 'request_id': 'req-f2676fcc-00cb-4034-a8f4-91cdbce9ca48'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:12.561473 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-f2676fcc-00cb-4034-a8f4-91cdbce9ca48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'daf8c6977c0b45f4b8c8b39159fc5bc8', 'request_id': 'req-f2676fcc-00cb-4034-a8f4-91cdbce9ca48'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:12.568621 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-f2676fcc-00cb-4034-a8f4-91cdbce9ca48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'daf8c6977c0b45f4b8c8b39159fc5bc8', 'request_id': 'req-f2676fcc-00cb-4034-a8f4-91cdbce9ca48'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:12.581276 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-f2676fcc-00cb-4034-a8f4-91cdbce9ca48 admin admin] The token cache is being invalidate because project daf8c6977c0b45f4b8c8b39159fc5bc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80105) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:29:12.581570 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-f2676fcc-00cb-4034-a8f4-91cdbce9ca48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:12.582456 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-f2676fcc-00cb-4034-a8f4-91cdbce9ca48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:12.585139 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1198/2406] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:29:12 2022] DELETE /identity/v3/projects/daf8c6977c0b45f4b8c8b39159fc5bc8 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:29:12.590440 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d1afab-2059-40db-91e6-f1eaef2e6918 service neutron] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:12.603188 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d1afab-2059-40db-91e6-f1eaef2e6918 service neutron] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:12.621513 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:29:12.644578 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd312582-144a-4863-b0ad-e8a73f6f52a8 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:12.645054 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd312582-144a-4863-b0ad-e8a73f6f52a8 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:12.646197 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd312582-144a-4863-b0ad-e8a73f6f52a8 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:12.648831 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1199/2407] 10.222.0.36 () {54 vars in 921 bytes} [Tue Aug 9 10:29:12 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 09 10:29:12.658587 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe2eff-347b-42c5-91ff-c51b1025797d None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:12.658872 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe2eff-347b-42c5-91ff-c51b1025797d None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:12.659291 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe2eff-347b-42c5-91ff-c51b1025797d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:12.668938 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f9d4a6-948e-4818-af9e-18ef6e62527d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:12.669877 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f9d4a6-948e-4818-af9e-18ef6e62527d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:12.670242 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f9d4a6-948e-4818-af9e-18ef6e62527d admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:12.671363 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f9d4a6-948e-4818-af9e-18ef6e62527d admin admin] PATH_INFO: `/v3/users/83de95ec3d764594801afa785f1f1491` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:12.672553 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f9d4a6-948e-4818-af9e-18ef6e62527d admin admin] RBAC: Authorizing `identity:delete_user(user_id=83de95ec3d764594801afa785f1f1491)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:12.674567 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f9d4a6-948e-4818-af9e-18ef6e62527d admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:12.676961 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:29:12.684840 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-92fe2eff-347b-42c5-91ff-c51b1025797d None None] MFA Rules not processed for user `eb863beaaa9f495c8b64655996c061f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:29:12.686946 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-92fe2eff-347b-42c5-91ff-c51b1025797d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:12.732400 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-39f9d4a6-948e-4818-af9e-18ef6e62527d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83de95ec3d764594801afa785f1f1491'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:12.746256 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-39f9d4a6-948e-4818-af9e-18ef6e62527d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83de95ec3d764594801afa785f1f1491'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:12.753357 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-39f9d4a6-948e-4818-af9e-18ef6e62527d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83de95ec3d764594801afa785f1f1491'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:12.754114 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-39f9d4a6-948e-4818-af9e-18ef6e62527d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83de95ec3d764594801afa785f1f1491'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:12.763869 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-39f9d4a6-948e-4818-af9e-18ef6e62527d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83de95ec3d764594801afa785f1f1491'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:12.767187 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1200/2408] 10.222.0.36 () {58 vars in 1018 bytes} [Tue Aug 9 10:29:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:29:12.771331 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1209/2409] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:29:12 2022] DELETE /identity/v3/users/83de95ec3d764594801afa785f1f1491 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:29:12.783976 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fe2eff-347b-42c5-91ff-c51b1025797d None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:12.788270 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-92fe2eff-347b-42c5-91ff-c51b1025797d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:12.851989 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fe2eff-347b-42c5-91ff-c51b1025797d None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:12.903314 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e84b0e6-24c0-4780-b716-c2be13b579b7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07540b72afd34927855c41db09a7b030', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:12.903913 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e84b0e6-24c0-4780-b716-c2be13b579b7 service glance] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:12.904189 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e84b0e6-24c0-4780-b716-c2be13b579b7 service glance] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:12.904454 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e84b0e6-24c0-4780-b716-c2be13b579b7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:12.906256 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-3e84b0e6-24c0-4780-b716-c2be13b579b7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:12.987253 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:29:12.991238 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e84b0e6-24c0-4780-b716-c2be13b579b7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:12.993158 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e84b0e6-24c0-4780-b716-c2be13b579b7 service glance] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:13.004235 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1201/2410] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:29:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:29:13.046066 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f9d4a6-948e-4818-af9e-18ef6e62527d admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:13.047990 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-39f9d4a6-948e-4818-af9e-18ef6e62527d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:13.081378 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081de475-97fe-4271-abed-22f19c35e617 None None] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:13.081928 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081de475-97fe-4271-abed-22f19c35e617 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:13.082093 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081de475-97fe-4271-abed-22f19c35e617 None None] PATH_INFO: `/` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:13.083804 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1202/2411] 10.222.0.36 () {54 vars in 921 bytes} [Tue Aug 9 10:29:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:29:13.088662 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8843497-095d-4b69-a777-cbee16bc0f35 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:13.088940 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8843497-095d-4b69-a777-cbee16bc0f35 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:13.089210 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8843497-095d-4b69-a777-cbee16bc0f35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:13.114610 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-b8843497-095d-4b69-a777-cbee16bc0f35 None None] MFA Rules not processed for user `9169847a16764da3a2a1dbb5f5f56438`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:29:13.116089 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-b8843497-095d-4b69-a777-cbee16bc0f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:13.125701 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f9d4a6-948e-4818-af9e-18ef6e62527d admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:13.131397 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9093df69-c201-4e71-94ed-bddceec49210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:13.132030 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9093df69-c201-4e71-94ed-bddceec49210 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:13.132324 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9093df69-c201-4e71-94ed-bddceec49210 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:13.132596 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9093df69-c201-4e71-94ed-bddceec49210 admin admin] PATH_INFO: `/v3/projects/4ce2b1e854e54400af45f8afc4ac9c53` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:13.133730 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9093df69-c201-4e71-94ed-bddceec49210 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ce2b1e854e54400af45f8afc4ac9c53)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:13.136094 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9093df69-c201-4e71-94ed-bddceec49210 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:13.173802 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1203/2412] 10.222.0.36 () {58 vars in 1018 bytes} [Tue Aug 9 10:29:13 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 10:29:13.187613 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:29:13.188290 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8843497-095d-4b69-a777-cbee16bc0f35 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:13.189921 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-b8843497-095d-4b69-a777-cbee16bc0f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:13.196430 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-9093df69-c201-4e71-94ed-bddceec49210 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ce2b1e854e54400af45f8afc4ac9c53', 'request_id': 'req-9093df69-c201-4e71-94ed-bddceec49210'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:13.210074 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8843497-095d-4b69-a777-cbee16bc0f35 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:13.210312 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-9093df69-c201-4e71-94ed-bddceec49210 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ce2b1e854e54400af45f8afc4ac9c53', 'request_id': 'req-9093df69-c201-4e71-94ed-bddceec49210'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:13.211234 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-9093df69-c201-4e71-94ed-bddceec49210 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ce2b1e854e54400af45f8afc4ac9c53', 'request_id': 'req-9093df69-c201-4e71-94ed-bddceec49210'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:13.225617 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-9093df69-c201-4e71-94ed-bddceec49210 admin admin] The token cache is being invalidate because project 4ce2b1e854e54400af45f8afc4ac9c53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:29:13.225983 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-9093df69-c201-4e71-94ed-bddceec49210 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:13.226606 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-9093df69-c201-4e71-94ed-bddceec49210 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:13.228059 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1210/2413] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:29:13 2022] DELETE /identity/v3/projects/4ce2b1e854e54400af45f8afc4ac9c53 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:29:13.232756 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d17cdd-ef51-41c4-bbde-ed678c6989e3 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:13.233036 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d17cdd-ef51-41c4-bbde-ed678c6989e3 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:13.233311 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d17cdd-ef51-41c4-bbde-ed678c6989e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:13.254134 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-e1d17cdd-ef51-41c4-bbde-ed678c6989e3 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:29:13.256255 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-e1d17cdd-ef51-41c4-bbde-ed678c6989e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:13.266304 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2699166f-12a9-42c2-9029-515a2138b13f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:13.266915 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2699166f-12a9-42c2-9029-515a2138b13f service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:13.267293 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2699166f-12a9-42c2-9029-515a2138b13f service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:13.267454 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2699166f-12a9-42c2-9029-515a2138b13f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:13.269235 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-2699166f-12a9-42c2-9029-515a2138b13f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:13.280586 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2699166f-12a9-42c2-9029-515a2138b13f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:13.282095 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2699166f-12a9-42c2-9029-515a2138b13f service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:13.290920 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1204/2414] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:29:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:29:13.354839 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1211/2415] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:29:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 10:29:13.363796 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cffcdf-062b-4a57-85fa-32ee7357e164 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:13.364200 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cffcdf-062b-4a57-85fa-32ee7357e164 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:13.364607 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cffcdf-062b-4a57-85fa-32ee7357e164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:13.394265 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-78cffcdf-062b-4a57-85fa-32ee7357e164 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:29:13.397517 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-78cffcdf-062b-4a57-85fa-32ee7357e164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:13.410028 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1205/2416] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:29:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:29:13.417016 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cffcdf-062b-4a57-85fa-32ee7357e164 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:13.417124 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a86f4-58e5-4521-b1fd-7b12f0545aae None None] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:13.417124 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a86f4-58e5-4521-b1fd-7b12f0545aae None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:13.417124 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a86f4-58e5-4521-b1fd-7b12f0545aae None None] PATH_INFO: `/` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:13.418130 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1212/2417] 10.222.0.36 () {54 vars in 921 bytes} [Tue Aug 9 10:29:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 09 10:29:13.425456 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c09d71-604a-4369-b74f-c3479c3d6311 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:13.425941 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c09d71-604a-4369-b74f-c3479c3d6311 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:13.426307 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c09d71-604a-4369-b74f-c3479c3d6311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:13.428324 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cffcdf-062b-4a57-85fa-32ee7357e164 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:13.436095 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20888ac1-2ad5-47a3-986c-02cfa231b1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:13.437548 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20888ac1-2ad5-47a3-986c-02cfa231b1de admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:13.437878 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20888ac1-2ad5-47a3-986c-02cfa231b1de admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:13.438222 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20888ac1-2ad5-47a3-986c-02cfa231b1de admin admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:13.438962 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20888ac1-2ad5-47a3-986c-02cfa231b1de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:29:13.439337 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20888ac1-2ad5-47a3-986c-02cfa231b1de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:13.440997 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20888ac1-2ad5-47a3-986c-02cfa231b1de admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:13.460554 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1206/2418] 10.222.0.36 () {58 vars in 1153 bytes} [Tue Aug 9 10:29:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:29:13.465076 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20888ac1-2ad5-47a3-986c-02cfa231b1de admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:13.476926 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20888ac1-2ad5-47a3-986c-02cfa231b1de admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:13.480424 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-99c09d71-604a-4369-b74f-c3479c3d6311 None None] MFA Rules not processed for user `eb863beaaa9f495c8b64655996c061f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:29:13.481718 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-99c09d71-604a-4369-b74f-c3479c3d6311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:13.482966 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929a9c9e-0a91-4f10-954b-4a5801f4de1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:13.483822 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a9c9e-0a91-4f10-954b-4a5801f4de1b admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:13.484351 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a9c9e-0a91-4f10-954b-4a5801f4de1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:13.484687 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a9c9e-0a91-4f10-954b-4a5801f4de1b admin admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:13.485480 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929a9c9e-0a91-4f10-954b-4a5801f4de1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:13.487769 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929a9c9e-0a91-4f10-954b-4a5801f4de1b admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:13.535859 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1207/2419] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:29:13 2022] POST /identity/v3/projects => generated 379 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 10:29:13.540730 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929a9c9e-0a91-4f10-954b-4a5801f4de1b admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:13.574437 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1213/2420] 10.222.0.36 () {58 vars in 1018 bytes} [Tue Aug 9 10:29:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 10:29:13.595331 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c09d71-604a-4369-b74f-c3479c3d6311 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:13.596858 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-99c09d71-604a-4369-b74f-c3479c3d6311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:13.615014 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c09d71-604a-4369-b74f-c3479c3d6311 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:13.617206 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929a9c9e-0a91-4f10-954b-4a5801f4de1b admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:13.622788 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c6aef6-5316-453c-b671-2d9739183af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:13.623312 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c6aef6-5316-453c-b671-2d9739183af2 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:13.623587 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c6aef6-5316-453c-b671-2d9739183af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:13.623857 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c6aef6-5316-453c-b671-2d9739183af2 admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:13.624473 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c6aef6-5316-453c-b671-2d9739183af2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:13.626430 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c6aef6-5316-453c-b671-2d9739183af2 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:13.637556 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:29:13.651429 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1208/2421] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:29:13 2022] POST /identity/v3/users => generated 290 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 10:29:13.655572 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c6aef6-5316-453c-b671-2d9739183af2 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:13.666238 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c6aef6-5316-453c-b671-2d9739183af2 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:13.669965 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9153c9-9c86-40ea-b7f3-4cf49d27c4f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:13.670578 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9153c9-9c86-40ea-b7f3-4cf49d27c4f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:13.670856 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9153c9-9c86-40ea-b7f3-4cf49d27c4f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:13.671126 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9153c9-9c86-40ea-b7f3-4cf49d27c4f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:13.671276 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2a2be5-cd62-45ad-8f9f-6cfe77be2c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:13.671862 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a2be5-cd62-45ad-8f9f-6cfe77be2c39 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:13.672137 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a2be5-cd62-45ad-8f9f-6cfe77be2c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:13.672445 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a2be5-cd62-45ad-8f9f-6cfe77be2c39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:13.673060 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2a2be5-cd62-45ad-8f9f-6cfe77be2c39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:13.674743 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2a2be5-cd62-45ad-8f9f-6cfe77be2c39 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:13.685238 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:29:13.685704 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1209/2422] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:29:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 10:29:13.689960 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2a2be5-cd62-45ad-8f9f-6cfe77be2c39 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:13.700388 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2a2be5-cd62-45ad-8f9f-6cfe77be2c39 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:13.705267 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263d8b99-b3f1-40c8-82fc-c56e4aa9d166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:13.705902 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d8b99-b3f1-40c8-82fc-c56e4aa9d166 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:13.706202 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d8b99-b3f1-40c8-82fc-c56e4aa9d166 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:13.706895 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d8b99-b3f1-40c8-82fc-c56e4aa9d166 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:13.707050 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263d8b99-b3f1-40c8-82fc-c56e4aa9d166 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:13.709504 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263d8b99-b3f1-40c8-82fc-c56e4aa9d166 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:13.721593 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1210/2423] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:29:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 10:29:13.726644 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263d8b99-b3f1-40c8-82fc-c56e4aa9d166 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:13.736298 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263d8b99-b3f1-40c8-82fc-c56e4aa9d166 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:13.741025 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02cd57d-5349-4083-ba00-56bae8cbbb63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:13.741652 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02cd57d-5349-4083-ba00-56bae8cbbb63 admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:13.741960 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02cd57d-5349-4083-ba00-56bae8cbbb63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:13.742248 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02cd57d-5349-4083-ba00-56bae8cbbb63 admin admin] PATH_INFO: `/v3/projects/d4aa5ca5989649628b3d2eea913b316d/users/c9f46d135eaa45049a8865a308ad0778/roles/a9895331e9694fa8b2b50908bb057bcb` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:13.746136 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9153c9-9c86-40ea-b7f3-4cf49d27c4f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:13.747575 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9153c9-9c86-40ea-b7f3-4cf49d27c4f4 service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:13.757067 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02cd57d-5349-4083-ba00-56bae8cbbb63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4aa5ca5989649628b3d2eea913b316d, user_id=c9f46d135eaa45049a8865a308ad0778, role_id=a9895331e9694fa8b2b50908bb057bcb)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:13.759274 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1214/2424] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:29:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:29:13.759819 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02cd57d-5349-4083-ba00-56bae8cbbb63 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:13.773265 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1211/2425] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:29:13 2022] PUT /identity/v3/projects/d4aa5ca5989649628b3d2eea913b316d/users/c9f46d135eaa45049a8865a308ad0778/roles/a9895331e9694fa8b2b50908bb057bcb => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 10:29:13.783739 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be085594-60e9-4cc7-aa40-36e69981f9bb None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:13.784111 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be085594-60e9-4cc7-aa40-36e69981f9bb None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:13.784471 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be085594-60e9-4cc7-aa40-36e69981f9bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:13.822740 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-be085594-60e9-4cc7-aa40-36e69981f9bb None None] MFA Rules not processed for user `c9f46d135eaa45049a8865a308ad0778`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:29:13.823827 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02cd57d-5349-4083-ba00-56bae8cbbb63 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:13.825297 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-be085594-60e9-4cc7-aa40-36e69981f9bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:13.825938 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-c02cd57d-5349-4083-ba00-56bae8cbbb63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:13.901420 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1215/2426] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:29:13 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:29:13.902534 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be085594-60e9-4cc7-aa40-36e69981f9bb None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:13.911716 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02cd57d-5349-4083-ba00-56bae8cbbb63 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:13.916979 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed16c011-d444-4eb7-9a12-d7077a6fee45 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4d3b6a332394adf9e1b81ee9c171c48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:13.917598 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed16c011-d444-4eb7-9a12-d7077a6fee45 service placement] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:13.917906 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed16c011-d444-4eb7-9a12-d7077a6fee45 service placement] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:13.918187 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed16c011-d444-4eb7-9a12-d7077a6fee45 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:13.920436 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-ed16c011-d444-4eb7-9a12-d7077a6fee45 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:13.933128 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed16c011-d444-4eb7-9a12-d7077a6fee45 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:13.934747 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed16c011-d444-4eb7-9a12-d7077a6fee45 service placement] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:13.949930 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1212/2427] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:29:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 10:29:13.986686 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be085594-60e9-4cc7-aa40-36e69981f9bb None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:13.991292 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cf5458-9c29-4b1d-8a66-c993ad6611ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:13.991887 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf5458-9c29-4b1d-8a66-c993ad6611ba admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:13.992156 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf5458-9c29-4b1d-8a66-c993ad6611ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:13.992422 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf5458-9c29-4b1d-8a66-c993ad6611ba admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:13.993036 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cf5458-9c29-4b1d-8a66-c993ad6611ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:13.994966 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cf5458-9c29-4b1d-8a66-c993ad6611ba admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:14.027179 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1216/2428] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:29:13 2022] POST /identity/v3/projects => generated 377 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:29:14.028358 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed16c011-d444-4eb7-9a12-d7077a6fee45 service placement] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:14.039219 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed16c011-d444-4eb7-9a12-d7077a6fee45 service placement] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:14.097208 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b64535-9354-4bd1-a4bd-ee62d7b3fa36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:14.097865 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b64535-9354-4bd1-a4bd-ee62d7b3fa36 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:14.098124 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b64535-9354-4bd1-a4bd-ee62d7b3fa36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:14.098534 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b64535-9354-4bd1-a4bd-ee62d7b3fa36 admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:14.099230 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b64535-9354-4bd1-a4bd-ee62d7b3fa36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:14.101147 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b64535-9354-4bd1-a4bd-ee62d7b3fa36 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:14.122558 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1213/2429] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:29:14 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:29:14.126593 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cf5458-9c29-4b1d-8a66-c993ad6611ba admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:14.137723 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cf5458-9c29-4b1d-8a66-c993ad6611ba admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:14.143170 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b461cc02-f136-445d-9919-fce18be553f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:14.144034 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b461cc02-f136-445d-9919-fce18be553f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:14.144893 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b461cc02-f136-445d-9919-fce18be553f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:14.145747 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b461cc02-f136-445d-9919-fce18be553f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:14.146572 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b461cc02-f136-445d-9919-fce18be553f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:14.148163 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b461cc02-f136-445d-9919-fce18be553f7 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:14.160962 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1217/2430] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:29:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:29:14.164906 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b64535-9354-4bd1-a4bd-ee62d7b3fa36 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:14.174707 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b64535-9354-4bd1-a4bd-ee62d7b3fa36 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:14.179455 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0034b14-faf5-474c-ae0d-0f4d9d0e0d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:14.180044 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0034b14-faf5-474c-ae0d-0f4d9d0e0d16 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:14.180321 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0034b14-faf5-474c-ae0d-0f4d9d0e0d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:14.180588 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0034b14-faf5-474c-ae0d-0f4d9d0e0d16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:14.181218 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0034b14-faf5-474c-ae0d-0f4d9d0e0d16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:14.182833 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0034b14-faf5-474c-ae0d-0f4d9d0e0d16 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:14.193958 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1214/2431] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:29:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 10:29:14.198374 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b461cc02-f136-445d-9919-fce18be553f7 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:14.208862 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b461cc02-f136-445d-9919-fce18be553f7 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:14.213537 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d23405-acfd-4ad3-935c-ec2d338c7e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:14.214205 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d23405-acfd-4ad3-935c-ec2d338c7e43 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:14.214478 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d23405-acfd-4ad3-935c-ec2d338c7e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:14.214816 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d23405-acfd-4ad3-935c-ec2d338c7e43 admin admin] PATH_INFO: `/v3/projects/62d427e24e364fcb90d6f484a14bc405/users/9cb68bbfc20a45ed85b7d330f13d793e/roles/a9895331e9694fa8b2b50908bb057bcb` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:14.216974 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:29:14.233632 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d23405-acfd-4ad3-935c-ec2d338c7e43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62d427e24e364fcb90d6f484a14bc405, user_id=9cb68bbfc20a45ed85b7d330f13d793e, role_id=a9895331e9694fa8b2b50908bb057bcb)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:14.236315 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d23405-acfd-4ad3-935c-ec2d338c7e43 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:14.250224 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1218/2432] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:29:14 2022] PUT /identity/v3/projects/62d427e24e364fcb90d6f484a14bc405/users/9cb68bbfc20a45ed85b7d330f13d793e/roles/a9895331e9694fa8b2b50908bb057bcb => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:29:14.262002 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff629e-eecf-4f50-9f11-ade6b57ae2eb None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:14.262294 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff629e-eecf-4f50-9f11-ade6b57ae2eb None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:14.262573 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff629e-eecf-4f50-9f11-ade6b57ae2eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:14.290077 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-0cff629e-eecf-4f50-9f11-ade6b57ae2eb None None] MFA Rules not processed for user `9cb68bbfc20a45ed85b7d330f13d793e`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:29:14.291269 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-0cff629e-eecf-4f50-9f11-ade6b57ae2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:14.296240 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:29:14.358310 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1215/2433] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:29:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:29:14.362812 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d23405-acfd-4ad3-935c-ec2d338c7e43 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:14.423300 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d23405-acfd-4ad3-935c-ec2d338c7e43 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:14.428242 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef37634-4730-490c-b57a-9da4b0602dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:14.428833 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef37634-4730-490c-b57a-9da4b0602dd2 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:14.429109 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef37634-4730-490c-b57a-9da4b0602dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:14.429379 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef37634-4730-490c-b57a-9da4b0602dd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:14.430013 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef37634-4730-490c-b57a-9da4b0602dd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:14.431887 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef37634-4730-490c-b57a-9da4b0602dd2 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:14.457512 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1219/2434] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:29:14 2022] POST /identity/v3/projects => generated 377 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:29:14.461713 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cff629e-eecf-4f50-9f11-ade6b57ae2eb None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:14.472204 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cff629e-eecf-4f50-9f11-ade6b57ae2eb None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:14.532424 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fef2dce-9adf-4857-935e-528fcf1111cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:14.533023 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fef2dce-9adf-4857-935e-528fcf1111cb admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:14.533297 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fef2dce-9adf-4857-935e-528fcf1111cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:14.533564 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fef2dce-9adf-4857-935e-528fcf1111cb admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:14.534228 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fef2dce-9adf-4857-935e-528fcf1111cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:14.536319 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fef2dce-9adf-4857-935e-528fcf1111cb admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:14.561487 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1216/2435] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:29:14 2022] POST /identity/v3/users => generated 295 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:29:14.562802 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef37634-4730-490c-b57a-9da4b0602dd2 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:14.575006 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef37634-4730-490c-b57a-9da4b0602dd2 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:14.579719 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd34702-3989-4800-b6c1-43e38f6fda27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:14.580375 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd34702-3989-4800-b6c1-43e38f6fda27 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:14.580597 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd34702-3989-4800-b6c1-43e38f6fda27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:14.580875 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd34702-3989-4800-b6c1-43e38f6fda27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:14.581516 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd34702-3989-4800-b6c1-43e38f6fda27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:14.583150 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd34702-3989-4800-b6c1-43e38f6fda27 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:14.597672 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1220/2436] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:29:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:29:14.602410 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fef2dce-9adf-4857-935e-528fcf1111cb admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:14.614969 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fef2dce-9adf-4857-935e-528fcf1111cb admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:14.623215 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01bd76e-004b-4a0a-a23c-6b710f563632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:14.623959 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01bd76e-004b-4a0a-a23c-6b710f563632 admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:14.624302 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01bd76e-004b-4a0a-a23c-6b710f563632 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:14.624656 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01bd76e-004b-4a0a-a23c-6b710f563632 admin admin] PATH_INFO: `/v3/projects/9ebfe1df881e4f4bb07255e93fc4cd14/users/1698e957440944149b0a5f13f84141e2/roles/89ca30cbbb634be8a96e9921aa56626b` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:14.641500 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01bd76e-004b-4a0a-a23c-6b710f563632 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ebfe1df881e4f4bb07255e93fc4cd14, user_id=1698e957440944149b0a5f13f84141e2, role_id=89ca30cbbb634be8a96e9921aa56626b)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:14.644689 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01bd76e-004b-4a0a-a23c-6b710f563632 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:14.666949 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd34702-3989-4800-b6c1-43e38f6fda27 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:14.668631 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-abd34702-3989-4800-b6c1-43e38f6fda27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:14.671526 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1217/2437] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:29:14 2022] PUT /identity/v3/projects/9ebfe1df881e4f4bb07255e93fc4cd14/users/1698e957440944149b0a5f13f84141e2/roles/89ca30cbbb634be8a96e9921aa56626b => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:29:14.675501 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01bd76e-004b-4a0a-a23c-6b710f563632 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:14.687435 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd34702-3989-4800-b6c1-43e38f6fda27 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:14.761864 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01bd76e-004b-4a0a-a23c-6b710f563632 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:14.763645 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87850aa-48ed-4318-b329-ed2ead0e9a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:14.764309 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87850aa-48ed-4318-b329-ed2ead0e9a82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:14.764569 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87850aa-48ed-4318-b329-ed2ead0e9a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:14.764843 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87850aa-48ed-4318-b329-ed2ead0e9a82 admin admin] PATH_INFO: `/v3/users/49a131c5e9734abb991fabd7058c2d8a` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:14.766118 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87850aa-48ed-4318-b329-ed2ead0e9a82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49a131c5e9734abb991fabd7058c2d8a)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:14.768026 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87850aa-48ed-4318-b329-ed2ead0e9a82 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:14.768133 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d4d705-1bf1-4be4-81ff-a5ccaf945a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:14.768810 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d4d705-1bf1-4be4-81ff-a5ccaf945a3c admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:14.769562 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d4d705-1bf1-4be4-81ff-a5ccaf945a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:14.770081 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d4d705-1bf1-4be4-81ff-a5ccaf945a3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:14.771329 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d4d705-1bf1-4be4-81ff-a5ccaf945a3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:14.773646 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d4d705-1bf1-4be4-81ff-a5ccaf945a3c admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:14.788224 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1218/2438] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:29:14 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:29:14.792437 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d4d705-1bf1-4be4-81ff-a5ccaf945a3c admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:14.805219 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d4d705-1bf1-4be4-81ff-a5ccaf945a3c admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:14.812113 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc57d3d2-4a49-4185-9195-589a4a41d653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:14.813414 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc57d3d2-4a49-4185-9195-589a4a41d653 admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:14.813900 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc57d3d2-4a49-4185-9195-589a4a41d653 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:14.814264 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc57d3d2-4a49-4185-9195-589a4a41d653 admin admin] PATH_INFO: `/v3/projects/9ebfe1df881e4f4bb07255e93fc4cd14/users/1698e957440944149b0a5f13f84141e2/roles/89ca30cbbb634be8a96e9921aa56626b` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:14.817670 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc57d3d2-4a49-4185-9195-589a4a41d653 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ebfe1df881e4f4bb07255e93fc4cd14, user_id=1698e957440944149b0a5f13f84141e2, role_id=89ca30cbbb634be8a96e9921aa56626b)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:14.821882 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc57d3d2-4a49-4185-9195-589a4a41d653 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:14.823142 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-c87850aa-48ed-4318-b329-ed2ead0e9a82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49a131c5e9734abb991fabd7058c2d8a'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:14.825686 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:29:14.834923 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:29:14.836178 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1219/2439] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:29:14 2022] PUT /identity/v3/projects/9ebfe1df881e4f4bb07255e93fc4cd14/users/1698e957440944149b0a5f13f84141e2/roles/89ca30cbbb634be8a96e9921aa56626b => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 10:29:14.841461 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-c87850aa-48ed-4318-b329-ed2ead0e9a82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49a131c5e9734abb991fabd7058c2d8a'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:14.846707 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb3c8a3-55b1-474b-860a-c3ca05a00f0a None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:14.847399 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb3c8a3-55b1-474b-860a-c3ca05a00f0a None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:14.847399 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb3c8a3-55b1-474b-860a-c3ca05a00f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:14.852098 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-c87850aa-48ed-4318-b329-ed2ead0e9a82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49a131c5e9734abb991fabd7058c2d8a'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:14.852951 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-c87850aa-48ed-4318-b329-ed2ead0e9a82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49a131c5e9734abb991fabd7058c2d8a'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:14.861733 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-c87850aa-48ed-4318-b329-ed2ead0e9a82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49a131c5e9734abb991fabd7058c2d8a'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:14.869191 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1221/2440] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:29:14 2022] DELETE /identity/v3/users/49a131c5e9734abb991fabd7058c2d8a => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:29:14.875342 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0142110-f25f-4f17-a8d6-ade8f65e858a None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:14.875627 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0142110-f25f-4f17-a8d6-ade8f65e858a None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:14.875904 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0142110-f25f-4f17-a8d6-ade8f65e858a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:14.876128 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-0bb3c8a3-55b1-474b-860a-c3ca05a00f0a None None] MFA Rules not processed for user `1698e957440944149b0a5f13f84141e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:29:14.877231 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-0bb3c8a3-55b1-474b-860a-c3ca05a00f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:14.898451 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-a0142110-f25f-4f17-a8d6-ade8f65e858a None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:29:14.900005 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-a0142110-f25f-4f17-a8d6-ade8f65e858a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:14.970378 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1220/2441] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:29:14 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 10:29:14.983367 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1222/2442] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:29:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:29:14.985796 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb3c8a3-55b1-474b-860a-c3ca05a00f0a None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:14.987087 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-0bb3c8a3-55b1-474b-860a-c3ca05a00f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:14.999024 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0142110-f25f-4f17-a8d6-ade8f65e858a None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:15.000579 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-a0142110-f25f-4f17-a8d6-ade8f65e858a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:15.052198 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb3c8a3-55b1-474b-860a-c3ca05a00f0a None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:15.056619 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcf1d3f-ff73-4e2c-b7e8-4e99e2025087 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6c687a38524de0bf23d87ae91d3b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:15.057277 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcf1d3f-ff73-4e2c-b7e8-4e99e2025087 service cinder] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:15.057506 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcf1d3f-ff73-4e2c-b7e8-4e99e2025087 service cinder] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:15.057773 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcf1d3f-ff73-4e2c-b7e8-4e99e2025087 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:15.067743 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0142110-f25f-4f17-a8d6-ade8f65e858a None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:15.068820 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcf1d3f-ff73-4e2c-b7e8-4e99e2025087 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:15.070487 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcf1d3f-ff73-4e2c-b7e8-4e99e2025087 service cinder] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:15.071758 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b032c66-f3c9-4767-80b0-70f0fa5f64e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:15.072363 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b032c66-f3c9-4767-80b0-70f0fa5f64e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:15.072641 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b032c66-f3c9-4767-80b0-70f0fa5f64e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:15.072937 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b032c66-f3c9-4767-80b0-70f0fa5f64e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:15.082179 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1221/2443] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:29:14 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:29:15.087022 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b032c66-f3c9-4767-80b0-70f0fa5f64e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:15.088473 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b032c66-f3c9-4767-80b0-70f0fa5f64e6 service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:15.099582 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1223/2444] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:29:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 10:29:15.132438 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcf1d3f-ff73-4e2c-b7e8-4e99e2025087 service cinder] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:15.133503 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-5dcf1d3f-ff73-4e2c-b7e8-4e99e2025087 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:15.147167 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcf1d3f-ff73-4e2c-b7e8-4e99e2025087 service cinder] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:15.151588 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a019fe-ea49-4e33-84d6-b91b2f505c2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6c687a38524de0bf23d87ae91d3b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:15.152190 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a019fe-ea49-4e33-84d6-b91b2f505c2f service cinder] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:15.152470 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a019fe-ea49-4e33-84d6-b91b2f505c2f service cinder] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:15.152739 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a019fe-ea49-4e33-84d6-b91b2f505c2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:15.155378 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-f7a019fe-ea49-4e33-84d6-b91b2f505c2f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:15.236842 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a019fe-ea49-4e33-84d6-b91b2f505c2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:15.238447 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a019fe-ea49-4e33-84d6-b91b2f505c2f service cinder] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:15.251753 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1222/2445] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:29:15 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:29:15.430305 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b032c66-f3c9-4767-80b0-70f0fa5f64e6 service neutron] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:15.431993 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-9b032c66-f3c9-4767-80b0-70f0fa5f64e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:15.445194 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b032c66-f3c9-4767-80b0-70f0fa5f64e6 service neutron] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:15.452471 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30389396-8709-45b0-8bd5-c66b726640b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:15.453208 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30389396-8709-45b0-8bd5-c66b726640b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:15.453488 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30389396-8709-45b0-8bd5-c66b726640b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:15.453759 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30389396-8709-45b0-8bd5-c66b726640b7 admin admin] PATH_INFO: `/v3/projects/8d500e509fc24b0bb7c41dd0e870ff12` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:15.455629 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30389396-8709-45b0-8bd5-c66b726640b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d500e509fc24b0bb7c41dd0e870ff12)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:15.458318 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30389396-8709-45b0-8bd5-c66b726640b7 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:15.525839 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-30389396-8709-45b0-8bd5-c66b726640b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d500e509fc24b0bb7c41dd0e870ff12', 'request_id': 'req-30389396-8709-45b0-8bd5-c66b726640b7'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:15.533742 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-30389396-8709-45b0-8bd5-c66b726640b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d500e509fc24b0bb7c41dd0e870ff12', 'request_id': 'req-30389396-8709-45b0-8bd5-c66b726640b7'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:15.541177 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-30389396-8709-45b0-8bd5-c66b726640b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d500e509fc24b0bb7c41dd0e870ff12', 'request_id': 'req-30389396-8709-45b0-8bd5-c66b726640b7'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:15.558605 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-30389396-8709-45b0-8bd5-c66b726640b7 admin admin] The token cache is being invalidate because project 8d500e509fc24b0bb7c41dd0e870ff12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:29:15.558898 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-30389396-8709-45b0-8bd5-c66b726640b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:15.559621 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-30389396-8709-45b0-8bd5-c66b726640b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:15.561482 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1224/2446] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:29:15 2022] DELETE /identity/v3/projects/8d500e509fc24b0bb7c41dd0e870ff12 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:29:15.566383 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd913e-8f89-44f5-aa9c-c04f29f6a2a8 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:15.566676 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd913e-8f89-44f5-aa9c-c04f29f6a2a8 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:15.567537 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd913e-8f89-44f5-aa9c-c04f29f6a2a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:15.590969 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-c2cd913e-8f89-44f5-aa9c-c04f29f6a2a8 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:29:15.592529 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-c2cd913e-8f89-44f5-aa9c-c04f29f6a2a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:15.613273 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:29:15.688089 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1223/2447] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:29:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 10:29:15.698032 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b146e-6d6e-46db-8d01-fb35a68a5be3 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:15.698389 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b146e-6d6e-46db-8d01-fb35a68a5be3 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:15.698733 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b146e-6d6e-46db-8d01-fb35a68a5be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:15.707341 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:29:15.722215 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-090b146e-6d6e-46db-8d01-fb35a68a5be3 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:29:15.724400 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-090b146e-6d6e-46db-8d01-fb35a68a5be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:15.735502 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1225/2448] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:29:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:29:15.740295 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cd913e-8f89-44f5-aa9c-c04f29f6a2a8 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:15.750654 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cd913e-8f89-44f5-aa9c-c04f29f6a2a8 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:15.756814 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48ecd6a-e5ee-475e-9546-ac775eef5615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:15.757767 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48ecd6a-e5ee-475e-9546-ac775eef5615 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:15.758224 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48ecd6a-e5ee-475e-9546-ac775eef5615 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:15.758649 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48ecd6a-e5ee-475e-9546-ac775eef5615 admin admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:15.759404 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48ecd6a-e5ee-475e-9546-ac775eef5615 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:29:15.759704 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48ecd6a-e5ee-475e-9546-ac775eef5615 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:15.761346 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48ecd6a-e5ee-475e-9546-ac775eef5615 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:15.775903 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1224/2449] 10.222.0.36 () {58 vars in 1153 bytes} [Tue Aug 9 10:29:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:29:15.780875 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090b146e-6d6e-46db-8d01-fb35a68a5be3 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:15.791230 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090b146e-6d6e-46db-8d01-fb35a68a5be3 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:15.795996 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92151990-3ee9-4968-9f99-a6dd86c3dc8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:15.796771 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92151990-3ee9-4968-9f99-a6dd86c3dc8c admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:15.797120 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92151990-3ee9-4968-9f99-a6dd86c3dc8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:15.797482 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92151990-3ee9-4968-9f99-a6dd86c3dc8c admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:15.798258 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92151990-3ee9-4968-9f99-a6dd86c3dc8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:15.800260 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92151990-3ee9-4968-9f99-a6dd86c3dc8c admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:15.833725 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1226/2450] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:29:15 2022] POST /identity/v3/projects => generated 357 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:29:15.838134 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48ecd6a-e5ee-475e-9546-ac775eef5615 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:15.849809 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48ecd6a-e5ee-475e-9546-ac775eef5615 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:15.914419 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e6ddfc-3d8c-4959-8de4-7c5ff2c8558f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:15.915028 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e6ddfc-3d8c-4959-8de4-7c5ff2c8558f admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:15.915303 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e6ddfc-3d8c-4959-8de4-7c5ff2c8558f admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:15.915567 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e6ddfc-3d8c-4959-8de4-7c5ff2c8558f admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:15.916253 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e6ddfc-3d8c-4959-8de4-7c5ff2c8558f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:15.918226 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e6ddfc-3d8c-4959-8de4-7c5ff2c8558f admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:15.941742 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1225/2451] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:29:15 2022] POST /identity/v3/users => generated 279 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 10:29:15.945758 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92151990-3ee9-4968-9f99-a6dd86c3dc8c admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:15.956387 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92151990-3ee9-4968-9f99-a6dd86c3dc8c admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:15.961712 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba860adf-2b65-4f80-b35f-553b5b14dc44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:15.962363 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba860adf-2b65-4f80-b35f-553b5b14dc44 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:15.962639 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba860adf-2b65-4f80-b35f-553b5b14dc44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:15.962907 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba860adf-2b65-4f80-b35f-553b5b14dc44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:15.963554 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba860adf-2b65-4f80-b35f-553b5b14dc44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:15.965193 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba860adf-2b65-4f80-b35f-553b5b14dc44 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:15.976429 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1227/2452] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:29:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 10:29:15.980602 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e6ddfc-3d8c-4959-8de4-7c5ff2c8558f admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:15.991768 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e6ddfc-3d8c-4959-8de4-7c5ff2c8558f admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:15.996514 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f79cb20-2b8a-45f3-ba1e-b8b5122bc0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:15.997197 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f79cb20-2b8a-45f3-ba1e-b8b5122bc0d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:15.997478 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f79cb20-2b8a-45f3-ba1e-b8b5122bc0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:15.997750 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f79cb20-2b8a-45f3-ba1e-b8b5122bc0d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:15.998433 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f79cb20-2b8a-45f3-ba1e-b8b5122bc0d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:16.000027 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f79cb20-2b8a-45f3-ba1e-b8b5122bc0d3 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:16.011055 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1226/2453] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:29:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 10:29:16.015310 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba860adf-2b65-4f80-b35f-553b5b14dc44 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:16.026006 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba860adf-2b65-4f80-b35f-553b5b14dc44 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:16.032152 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2d1a80-6779-4dd0-b079-bd5ec2bc2185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:16.032828 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d1a80-6779-4dd0-b079-bd5ec2bc2185 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:16.033100 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d1a80-6779-4dd0-b079-bd5ec2bc2185 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:16.033494 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d1a80-6779-4dd0-b079-bd5ec2bc2185 admin admin] PATH_INFO: `/v3/projects/e13117e64f844a2aae98927662eb3dd0/users/84247bc4be744cf68759c4070e84a141/roles/a9895331e9694fa8b2b50908bb057bcb` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:16.048995 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2d1a80-6779-4dd0-b079-bd5ec2bc2185 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e13117e64f844a2aae98927662eb3dd0, user_id=84247bc4be744cf68759c4070e84a141, role_id=a9895331e9694fa8b2b50908bb057bcb)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:16.052187 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2d1a80-6779-4dd0-b079-bd5ec2bc2185 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:16.067778 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1228/2454] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:29:16 2022] PUT /identity/v3/projects/e13117e64f844a2aae98927662eb3dd0/users/84247bc4be744cf68759c4070e84a141/roles/a9895331e9694fa8b2b50908bb057bcb => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:29:16.078481 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aac60de-bba5-4530-b050-adf98d314d91 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:16.078764 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aac60de-bba5-4530-b050-adf98d314d91 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:16.079041 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aac60de-bba5-4530-b050-adf98d314d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:16.109416 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-2aac60de-bba5-4530-b050-adf98d314d91 None None] MFA Rules not processed for user `84247bc4be744cf68759c4070e84a141`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:29:16.110655 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-2aac60de-bba5-4530-b050-adf98d314d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:16.180798 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1227/2455] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:29:16 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:29:16.185097 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2d1a80-6779-4dd0-b079-bd5ec2bc2185 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:16.255603 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2d1a80-6779-4dd0-b079-bd5ec2bc2185 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:16.260794 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5b9d96-abf4-4370-84fc-9186a7b3b032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:16.261406 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b9d96-abf4-4370-84fc-9186a7b3b032 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:16.261698 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b9d96-abf4-4370-84fc-9186a7b3b032 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:16.262003 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b9d96-abf4-4370-84fc-9186a7b3b032 admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:16.262663 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5b9d96-abf4-4370-84fc-9186a7b3b032 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:16.264562 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5b9d96-abf4-4370-84fc-9186a7b3b032 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:16.296088 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1229/2456] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:29:16 2022] POST /identity/v3/projects => generated 357 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:29:16.297268 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aac60de-bba5-4530-b050-adf98d314d91 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:16.309142 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aac60de-bba5-4530-b050-adf98d314d91 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:16.323851 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:29:16.372298 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f95211f-3db4-4593-aa3c-976cdfa77be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:16.372911 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f95211f-3db4-4593-aa3c-976cdfa77be2 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:16.373193 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f95211f-3db4-4593-aa3c-976cdfa77be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:16.373464 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f95211f-3db4-4593-aa3c-976cdfa77be2 admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:16.374124 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f95211f-3db4-4593-aa3c-976cdfa77be2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:16.376062 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f95211f-3db4-4593-aa3c-976cdfa77be2 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:16.404396 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1228/2457] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:29:16 2022] POST /identity/v3/users => generated 285 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:29:16.408461 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5b9d96-abf4-4370-84fc-9186a7b3b032 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:16.419489 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5b9d96-abf4-4370-84fc-9186a7b3b032 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:16.424740 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032ae88c-d96f-436f-9ff2-5ed1071e432a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:16.425355 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032ae88c-d96f-436f-9ff2-5ed1071e432a admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:16.425634 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032ae88c-d96f-436f-9ff2-5ed1071e432a admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:16.425942 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032ae88c-d96f-436f-9ff2-5ed1071e432a admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:16.426615 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032ae88c-d96f-436f-9ff2-5ed1071e432a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:16.428316 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032ae88c-d96f-436f-9ff2-5ed1071e432a admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:16.439660 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1230/2458] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:29:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:29:16.444486 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f95211f-3db4-4593-aa3c-976cdfa77be2 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:16.455191 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f95211f-3db4-4593-aa3c-976cdfa77be2 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:16.460680 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70487af0-08b0-4f06-8d41-a0676464364f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:16.461375 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70487af0-08b0-4f06-8d41-a0676464364f admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:16.461654 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70487af0-08b0-4f06-8d41-a0676464364f admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:16.461945 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70487af0-08b0-4f06-8d41-a0676464364f admin admin] PATH_INFO: `/v3/projects/73ba5401ce6f4888b10550863e5edae7/users/ea889fdd12254855915e9174882999fc/roles/89ca30cbbb634be8a96e9921aa56626b` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:16.477120 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70487af0-08b0-4f06-8d41-a0676464364f admin admin] RBAC: Authorizing `identity:create_grant(project_id=73ba5401ce6f4888b10550863e5edae7, user_id=ea889fdd12254855915e9174882999fc, role_id=89ca30cbbb634be8a96e9921aa56626b)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:16.479970 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70487af0-08b0-4f06-8d41-a0676464364f admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:16.494904 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1229/2459] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:29:16 2022] PUT /identity/v3/projects/73ba5401ce6f4888b10550863e5edae7/users/ea889fdd12254855915e9174882999fc/roles/89ca30cbbb634be8a96e9921aa56626b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:29:16.499420 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032ae88c-d96f-436f-9ff2-5ed1071e432a admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:16.510218 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032ae88c-d96f-436f-9ff2-5ed1071e432a admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:16.568705 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b4a24b-4cf4-4f16-924c-edd802f0d0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:16.569304 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4a24b-4cf4-4f16-924c-edd802f0d0c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:16.569579 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4a24b-4cf4-4f16-924c-edd802f0d0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:16.569874 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4a24b-4cf4-4f16-924c-edd802f0d0c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:16.570520 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b4a24b-4cf4-4f16-924c-edd802f0d0c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:16.572102 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b4a24b-4cf4-4f16-924c-edd802f0d0c3 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:16.585249 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1231/2460] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:29:16 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:29:16.586889 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70487af0-08b0-4f06-8d41-a0676464364f admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:16.598140 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70487af0-08b0-4f06-8d41-a0676464364f admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:16.602943 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb43318-45d7-4935-bfed-8d919ebd89c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:16.603625 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb43318-45d7-4935-bfed-8d919ebd89c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:16.603909 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb43318-45d7-4935-bfed-8d919ebd89c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:16.604160 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb43318-45d7-4935-bfed-8d919ebd89c4 admin admin] PATH_INFO: `/v3/projects/73ba5401ce6f4888b10550863e5edae7/users/ea889fdd12254855915e9174882999fc/roles/89ca30cbbb634be8a96e9921aa56626b` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:16.606069 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb43318-45d7-4935-bfed-8d919ebd89c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73ba5401ce6f4888b10550863e5edae7, user_id=ea889fdd12254855915e9174882999fc, role_id=89ca30cbbb634be8a96e9921aa56626b)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:16.608720 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb43318-45d7-4935-bfed-8d919ebd89c4 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:16.620555 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1230/2461] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:29:16 2022] PUT /identity/v3/projects/73ba5401ce6f4888b10550863e5edae7/users/ea889fdd12254855915e9174882999fc/roles/89ca30cbbb634be8a96e9921aa56626b => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:29:16.631651 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100ea2dc-ee6f-4ff2-8c97-5b10dcea431c None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:16.631899 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100ea2dc-ee6f-4ff2-8c97-5b10dcea431c None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:16.632192 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100ea2dc-ee6f-4ff2-8c97-5b10dcea431c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:16.652833 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:29:16.664547 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-100ea2dc-ee6f-4ff2-8c97-5b10dcea431c None None] MFA Rules not processed for user `ea889fdd12254855915e9174882999fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:29:16.665753 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-100ea2dc-ee6f-4ff2-8c97-5b10dcea431c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:16.758069 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1232/2462] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:29:16 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:29:16.768900 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb43318-45d7-4935-bfed-8d919ebd89c4 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:16.771404 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-cdb43318-45d7-4935-bfed-8d919ebd89c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:16.859463 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb43318-45d7-4935-bfed-8d919ebd89c4 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:16.864165 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae31b341-7578-45a1-8754-0741a8cb7e5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6c687a38524de0bf23d87ae91d3b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:16.864890 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae31b341-7578-45a1-8754-0741a8cb7e5c service cinder] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:16.865368 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae31b341-7578-45a1-8754-0741a8cb7e5c service cinder] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:16.865735 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae31b341-7578-45a1-8754-0741a8cb7e5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:16.884534 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae31b341-7578-45a1-8754-0741a8cb7e5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:16.886042 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae31b341-7578-45a1-8754-0741a8cb7e5c service cinder] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:16.897797 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1231/2463] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:29:16 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:29:17.014451 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100ea2dc-ee6f-4ff2-8c97-5b10dcea431c None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:17.016561 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-100ea2dc-ee6f-4ff2-8c97-5b10dcea431c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:17.042155 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100ea2dc-ee6f-4ff2-8c97-5b10dcea431c None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:17.046720 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a25bf1-b6c0-4493-9b46-a57443f39754 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6c687a38524de0bf23d87ae91d3b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:17.047399 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a25bf1-b6c0-4493-9b46-a57443f39754 service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:17.047679 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a25bf1-b6c0-4493-9b46-a57443f39754 service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:17.047979 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a25bf1-b6c0-4493-9b46-a57443f39754 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:17.050161 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d760fbf-e03e-496d-bc55-cae9da631868 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:17.050453 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d760fbf-e03e-496d-bc55-cae9da631868 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:17.050729 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d760fbf-e03e-496d-bc55-cae9da631868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:17.093562 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-3d760fbf-e03e-496d-bc55-cae9da631868 None None] MFA Rules not processed for user `cedc4d6c59c44c6d8fb7179070db5e91`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:29:17.095235 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-3d760fbf-e03e-496d-bc55-cae9da631868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:17.189882 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a25bf1-b6c0-4493-9b46-a57443f39754 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:17.191792 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a25bf1-b6c0-4493-9b46-a57443f39754 service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:17.206396 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1233/2464] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:29:17 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:29:17.207368 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a25bf1-b6c0-4493-9b46-a57443f39754 service cinder] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:17.209521 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-90a25bf1-b6c0-4493-9b46-a57443f39754 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:17.222783 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1232/2465] 10.222.0.36 () {58 vars in 1009 bytes} [Tue Aug 9 10:29:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 10:29:17.239735 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d760fbf-e03e-496d-bc55-cae9da631868 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:17.241200 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-3d760fbf-e03e-496d-bc55-cae9da631868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:17.275099 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:29:17.402611 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d760fbf-e03e-496d-bc55-cae9da631868 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:17.413683 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22d522f-d9dd-47b7-b909-7b07a0d70da9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '841c5dbaae774944b637c533ebd75b29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:17.414352 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d522f-d9dd-47b7-b909-7b07a0d70da9 service swift] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:17.414593 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d522f-d9dd-47b7-b909-7b07a0d70da9 service swift] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:17.414870 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d522f-d9dd-47b7-b909-7b07a0d70da9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:17.418470 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a25bf1-b6c0-4493-9b46-a57443f39754 service cinder] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:17.434132 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22d522f-d9dd-47b7-b909-7b07a0d70da9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:17.443468 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3531b238-38eb-4783-b75e-e6f24449cdb9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb863beaaa9f495c8b64655996c061f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:17.444245 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22d522f-d9dd-47b7-b909-7b07a0d70da9 service swift] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:17.444462 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3531b238-38eb-4783-b75e-e6f24449cdb9 service nova] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:17.444922 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3531b238-38eb-4783-b75e-e6f24449cdb9 service nova] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:17.445374 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3531b238-38eb-4783-b75e-e6f24449cdb9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:17.455824 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-3531b238-38eb-4783-b75e-e6f24449cdb9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:17.464146 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1233/2466] 10.222.0.36 () {60 vars in 1384 bytes} [Tue Aug 9 10:29:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 10:29:17.512281 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3531b238-38eb-4783-b75e-e6f24449cdb9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:17.518717 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3531b238-38eb-4783-b75e-e6f24449cdb9 service nova] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:17.583120 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1234/2467] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:29:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:29:18.577136 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22d522f-d9dd-47b7-b909-7b07a0d70da9 service swift] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:18.578595 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-f22d522f-d9dd-47b7-b909-7b07a0d70da9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:18.724126 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22d522f-d9dd-47b7-b909-7b07a0d70da9 service swift] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:18.741146 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c06bcd-d60b-4278-8d80-f6ec1100496e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:18.741146 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c06bcd-d60b-4278-8d80-f6ec1100496e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:18.741146 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c06bcd-d60b-4278-8d80-f6ec1100496e admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:18.741146 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c06bcd-d60b-4278-8d80-f6ec1100496e admin admin] PATH_INFO: `/v3/users/c9f46d135eaa45049a8865a308ad0778` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:18.742725 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c06bcd-d60b-4278-8d80-f6ec1100496e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9f46d135eaa45049a8865a308ad0778)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:18.745203 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c06bcd-d60b-4278-8d80-f6ec1100496e admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:18.815331 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-e5c06bcd-d60b-4278-8d80-f6ec1100496e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9f46d135eaa45049a8865a308ad0778'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:18.836807 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-e5c06bcd-d60b-4278-8d80-f6ec1100496e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9f46d135eaa45049a8865a308ad0778'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:18.849124 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-e5c06bcd-d60b-4278-8d80-f6ec1100496e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9f46d135eaa45049a8865a308ad0778'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:18.850152 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-e5c06bcd-d60b-4278-8d80-f6ec1100496e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9f46d135eaa45049a8865a308ad0778'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:18.879101 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-e5c06bcd-d60b-4278-8d80-f6ec1100496e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9f46d135eaa45049a8865a308ad0778'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:18.897106 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1234/2468] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:29:18 2022] DELETE /identity/v3/users/c9f46d135eaa45049a8865a308ad0778 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 10:29:18.901953 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82410961-4ab6-4c48-bc66-11f18e6ce5a8 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:18.902495 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82410961-4ab6-4c48-bc66-11f18e6ce5a8 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:18.902622 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82410961-4ab6-4c48-bc66-11f18e6ce5a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:18.930198 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-82410961-4ab6-4c48-bc66-11f18e6ce5a8 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:29:18.931910 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-82410961-4ab6-4c48-bc66-11f18e6ce5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:18.946786 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:29:19.012053 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1235/2469] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:29:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:29:19.026715 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c06bcd-d60b-4278-8d80-f6ec1100496e admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:19.028802 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-e5c06bcd-d60b-4278-8d80-f6ec1100496e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:19.077260 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:29:19.151903 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c06bcd-d60b-4278-8d80-f6ec1100496e admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:19.161811 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e53a893-a5e8-419f-9ccb-b17a801e2e94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:19.162596 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e53a893-a5e8-419f-9ccb-b17a801e2e94 service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:19.162887 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e53a893-a5e8-419f-9ccb-b17a801e2e94 service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:19.163158 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e53a893-a5e8-419f-9ccb-b17a801e2e94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:19.186221 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e53a893-a5e8-419f-9ccb-b17a801e2e94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:19.187701 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e53a893-a5e8-419f-9ccb-b17a801e2e94 service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:19.204591 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1235/2470] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:29:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:29:19.784508 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82410961-4ab6-4c48-bc66-11f18e6ce5a8 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:19.787121 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-82410961-4ab6-4c48-bc66-11f18e6ce5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:19.801441 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82410961-4ab6-4c48-bc66-11f18e6ce5a8 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:19.807820 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267aecd0-0e99-4abc-b242-a0b44a06020e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:19.808559 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267aecd0-0e99-4abc-b242-a0b44a06020e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:19.808915 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267aecd0-0e99-4abc-b242-a0b44a06020e admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:19.809258 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267aecd0-0e99-4abc-b242-a0b44a06020e admin admin] PATH_INFO: `/v3/projects/d4aa5ca5989649628b3d2eea913b316d` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:19.810746 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267aecd0-0e99-4abc-b242-a0b44a06020e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4aa5ca5989649628b3d2eea913b316d)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:19.812900 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267aecd0-0e99-4abc-b242-a0b44a06020e admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:19.920800 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-267aecd0-0e99-4abc-b242-a0b44a06020e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4aa5ca5989649628b3d2eea913b316d', 'request_id': 'req-267aecd0-0e99-4abc-b242-a0b44a06020e'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:19.929704 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-267aecd0-0e99-4abc-b242-a0b44a06020e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4aa5ca5989649628b3d2eea913b316d', 'request_id': 'req-267aecd0-0e99-4abc-b242-a0b44a06020e'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:19.938548 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-267aecd0-0e99-4abc-b242-a0b44a06020e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4aa5ca5989649628b3d2eea913b316d', 'request_id': 'req-267aecd0-0e99-4abc-b242-a0b44a06020e'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:19.990328 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-267aecd0-0e99-4abc-b242-a0b44a06020e admin admin] The token cache is being invalidate because project d4aa5ca5989649628b3d2eea913b316d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:29:19.990627 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-267aecd0-0e99-4abc-b242-a0b44a06020e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:19.993998 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-267aecd0-0e99-4abc-b242-a0b44a06020e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:19.999070 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1236/2471] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:29:19 2022] DELETE /identity/v3/projects/d4aa5ca5989649628b3d2eea913b316d => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:29:20.002552 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e53a893-a5e8-419f-9ccb-b17a801e2e94 service neutron] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:20.013741 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e53a893-a5e8-419f-9ccb-b17a801e2e94 service neutron] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:20.113036 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db64161-0918-4783-86c6-4c5b0821a458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:20.114638 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db64161-0918-4783-86c6-4c5b0821a458 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:20.114967 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db64161-0918-4783-86c6-4c5b0821a458 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:20.115308 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db64161-0918-4783-86c6-4c5b0821a458 admin admin] PATH_INFO: `/v3/users/9cb68bbfc20a45ed85b7d330f13d793e` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:20.118653 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db64161-0918-4783-86c6-4c5b0821a458 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cb68bbfc20a45ed85b7d330f13d793e)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:20.121508 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db64161-0918-4783-86c6-4c5b0821a458 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:20.201907 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-7db64161-0918-4783-86c6-4c5b0821a458 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cb68bbfc20a45ed85b7d330f13d793e'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:20.220640 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-7db64161-0918-4783-86c6-4c5b0821a458 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cb68bbfc20a45ed85b7d330f13d793e'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:20.233129 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-7db64161-0918-4783-86c6-4c5b0821a458 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cb68bbfc20a45ed85b7d330f13d793e'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:20.238066 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-7db64161-0918-4783-86c6-4c5b0821a458 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cb68bbfc20a45ed85b7d330f13d793e'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:20.256701 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-7db64161-0918-4783-86c6-4c5b0821a458 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cb68bbfc20a45ed85b7d330f13d793e'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:20.272761 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1236/2472] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:29:20 2022] DELETE /identity/v3/users/9cb68bbfc20a45ed85b7d330f13d793e => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:29:20.786386 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267aecd0-0e99-4abc-b242-a0b44a06020e admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:20.788010 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-267aecd0-0e99-4abc-b242-a0b44a06020e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:20.804487 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267aecd0-0e99-4abc-b242-a0b44a06020e admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:20.881098 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed00357-efa2-44ed-84a0-1763204336a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:20.881754 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed00357-efa2-44ed-84a0-1763204336a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:20.882082 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed00357-efa2-44ed-84a0-1763204336a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:20.882498 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed00357-efa2-44ed-84a0-1763204336a8 admin admin] PATH_INFO: `/v3/projects/62d427e24e364fcb90d6f484a14bc405` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:20.883540 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed00357-efa2-44ed-84a0-1763204336a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62d427e24e364fcb90d6f484a14bc405)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:20.885489 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed00357-efa2-44ed-84a0-1763204336a8 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:20.933799 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:29:20.938082 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-5ed00357-efa2-44ed-84a0-1763204336a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62d427e24e364fcb90d6f484a14bc405', 'request_id': 'req-5ed00357-efa2-44ed-84a0-1763204336a8'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:20.945669 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-5ed00357-efa2-44ed-84a0-1763204336a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62d427e24e364fcb90d6f484a14bc405', 'request_id': 'req-5ed00357-efa2-44ed-84a0-1763204336a8'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:20.952837 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-5ed00357-efa2-44ed-84a0-1763204336a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62d427e24e364fcb90d6f484a14bc405', 'request_id': 'req-5ed00357-efa2-44ed-84a0-1763204336a8'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:20.973757 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-5ed00357-efa2-44ed-84a0-1763204336a8 admin admin] The token cache is being invalidate because project 62d427e24e364fcb90d6f484a14bc405 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:29:20.974441 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-5ed00357-efa2-44ed-84a0-1763204336a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:20.975330 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-5ed00357-efa2-44ed-84a0-1763204336a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:20.976960 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1237/2473] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:29:20 2022] DELETE /identity/v3/projects/62d427e24e364fcb90d6f484a14bc405 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:29:20.980942 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db64161-0918-4783-86c6-4c5b0821a458 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:20.982378 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-7db64161-0918-4783-86c6-4c5b0821a458 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:20.995192 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db64161-0918-4783-86c6-4c5b0821a458 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:21.047818 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:29:21.066288 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522c6fe4-56e7-4e10-a8cc-7a32413eaab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:21.072168 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522c6fe4-56e7-4e10-a8cc-7a32413eaab3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:21.072168 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522c6fe4-56e7-4e10-a8cc-7a32413eaab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:21.072168 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522c6fe4-56e7-4e10-a8cc-7a32413eaab3 admin admin] PATH_INFO: `/v3/users/1698e957440944149b0a5f13f84141e2` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:21.072168 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522c6fe4-56e7-4e10-a8cc-7a32413eaab3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1698e957440944149b0a5f13f84141e2)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:21.072168 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522c6fe4-56e7-4e10-a8cc-7a32413eaab3 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:21.171295 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-522c6fe4-56e7-4e10-a8cc-7a32413eaab3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1698e957440944149b0a5f13f84141e2'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:21.186973 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-522c6fe4-56e7-4e10-a8cc-7a32413eaab3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1698e957440944149b0a5f13f84141e2'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:21.196945 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-522c6fe4-56e7-4e10-a8cc-7a32413eaab3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1698e957440944149b0a5f13f84141e2'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:21.197616 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-522c6fe4-56e7-4e10-a8cc-7a32413eaab3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1698e957440944149b0a5f13f84141e2'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:21.208029 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-522c6fe4-56e7-4e10-a8cc-7a32413eaab3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1698e957440944149b0a5f13f84141e2'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:21.217128 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1237/2474] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:29:20 2022] DELETE /identity/v3/users/1698e957440944149b0a5f13f84141e2 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:29:21.587967 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed00357-efa2-44ed-84a0-1763204336a8 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:21.589479 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-5ed00357-efa2-44ed-84a0-1763204336a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:21.608115 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed00357-efa2-44ed-84a0-1763204336a8 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:21.708907 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133252b8-fd76-4bb6-935b-e416fb86a4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:21.710784 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133252b8-fd76-4bb6-935b-e416fb86a4c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:21.711078 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133252b8-fd76-4bb6-935b-e416fb86a4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:21.711320 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133252b8-fd76-4bb6-935b-e416fb86a4c8 admin admin] PATH_INFO: `/v3/projects/9ebfe1df881e4f4bb07255e93fc4cd14` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:21.712645 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133252b8-fd76-4bb6-935b-e416fb86a4c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ebfe1df881e4f4bb07255e93fc4cd14)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:21.717041 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133252b8-fd76-4bb6-935b-e416fb86a4c8 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:21.846849 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-133252b8-fd76-4bb6-935b-e416fb86a4c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ebfe1df881e4f4bb07255e93fc4cd14', 'request_id': 'req-133252b8-fd76-4bb6-935b-e416fb86a4c8'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:21.857500 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-133252b8-fd76-4bb6-935b-e416fb86a4c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ebfe1df881e4f4bb07255e93fc4cd14', 'request_id': 'req-133252b8-fd76-4bb6-935b-e416fb86a4c8'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:21.868814 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-133252b8-fd76-4bb6-935b-e416fb86a4c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ebfe1df881e4f4bb07255e93fc4cd14', 'request_id': 'req-133252b8-fd76-4bb6-935b-e416fb86a4c8'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:21.934356 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-133252b8-fd76-4bb6-935b-e416fb86a4c8 admin admin] The token cache is being invalidate because project 9ebfe1df881e4f4bb07255e93fc4cd14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:29:21.934356 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-133252b8-fd76-4bb6-935b-e416fb86a4c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:21.934356 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-133252b8-fd76-4bb6-935b-e416fb86a4c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:21.938417 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1238/2475] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:29:21 2022] DELETE /identity/v3/projects/9ebfe1df881e4f4bb07255e93fc4cd14 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:29:21.941840 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea624c96-d94c-4c9e-b22d-04a18dc4a8f3 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:21.942412 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea624c96-d94c-4c9e-b22d-04a18dc4a8f3 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:21.942910 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea624c96-d94c-4c9e-b22d-04a18dc4a8f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:21.972272 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-ea624c96-d94c-4c9e-b22d-04a18dc4a8f3 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:29:21.974590 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-ea624c96-d94c-4c9e-b22d-04a18dc4a8f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:22.060697 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1238/2476] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:29:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:29:22.070209 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bda96d-bc36-4aae-b325-0f37719b763a None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:22.070626 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bda96d-bc36-4aae-b325-0f37719b763a None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:22.070970 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bda96d-bc36-4aae-b325-0f37719b763a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:22.097716 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-b6bda96d-bc36-4aae-b325-0f37719b763a None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:29:22.099830 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-b6bda96d-bc36-4aae-b325-0f37719b763a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:22.107939 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1239/2477] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:29:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:29:22.112318 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea624c96-d94c-4c9e-b22d-04a18dc4a8f3 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:22.124747 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea624c96-d94c-4c9e-b22d-04a18dc4a8f3 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:22.130724 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8826ffda-94fc-4a29-bba7-d290150e0039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:22.131344 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8826ffda-94fc-4a29-bba7-d290150e0039 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:22.131738 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8826ffda-94fc-4a29-bba7-d290150e0039 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:22.131887 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8826ffda-94fc-4a29-bba7-d290150e0039 admin admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:22.132546 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8826ffda-94fc-4a29-bba7-d290150e0039 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:29:22.132852 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8826ffda-94fc-4a29-bba7-d290150e0039 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:22.134718 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8826ffda-94fc-4a29-bba7-d290150e0039 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:22.150871 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1239/2478] 10.222.0.36 () {58 vars in 1153 bytes} [Tue Aug 9 10:29:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:29:22.155534 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bda96d-bc36-4aae-b325-0f37719b763a None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:22.165647 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bda96d-bc36-4aae-b325-0f37719b763a None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:22.175980 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b34b115-0c30-4496-9b45-b87a81425334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:22.178571 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b34b115-0c30-4496-9b45-b87a81425334 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:22.179207 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b34b115-0c30-4496-9b45-b87a81425334 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:22.179488 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b34b115-0c30-4496-9b45-b87a81425334 admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:22.180153 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b34b115-0c30-4496-9b45-b87a81425334 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:22.182351 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b34b115-0c30-4496-9b45-b87a81425334 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:22.226626 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8826ffda-94fc-4a29-bba7-d290150e0039 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:22.226821 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1240/2479] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:29:22 2022] POST /identity/v3/projects => generated 373 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:29:22.237186 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8826ffda-94fc-4a29-bba7-d290150e0039 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:22.329208 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:29:22.342279 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334c1b2d-f0de-40d0-ac78-3da84d847cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:22.343339 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334c1b2d-f0de-40d0-ac78-3da84d847cec admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:22.343644 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334c1b2d-f0de-40d0-ac78-3da84d847cec admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:22.343934 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334c1b2d-f0de-40d0-ac78-3da84d847cec admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:22.344930 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334c1b2d-f0de-40d0-ac78-3da84d847cec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:22.347771 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334c1b2d-f0de-40d0-ac78-3da84d847cec admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:22.383031 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1240/2480] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:29:22 2022] POST /identity/v3/users => generated 287 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 10:29:22.386640 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b34b115-0c30-4496-9b45-b87a81425334 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:22.414774 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b34b115-0c30-4496-9b45-b87a81425334 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:22.447954 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4fe739-8842-4eee-ad66-2e2f945c47cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:22.448760 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4fe739-8842-4eee-ad66-2e2f945c47cb admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:22.449190 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4fe739-8842-4eee-ad66-2e2f945c47cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:22.449624 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4fe739-8842-4eee-ad66-2e2f945c47cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:22.450455 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4fe739-8842-4eee-ad66-2e2f945c47cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:22.453040 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4fe739-8842-4eee-ad66-2e2f945c47cb admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:22.481641 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1241/2481] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:29:22 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:29:22.484213 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334c1b2d-f0de-40d0-ac78-3da84d847cec admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:22.500730 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334c1b2d-f0de-40d0-ac78-3da84d847cec admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:22.522062 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0246b280-3ab0-4205-bded-73bab466438d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:22.522704 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0246b280-3ab0-4205-bded-73bab466438d admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:22.522998 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0246b280-3ab0-4205-bded-73bab466438d admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:22.523265 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0246b280-3ab0-4205-bded-73bab466438d admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:22.523919 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0246b280-3ab0-4205-bded-73bab466438d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:22.525802 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0246b280-3ab0-4205-bded-73bab466438d admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:22.539540 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1241/2482] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:29:22 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:29:22.543826 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4fe739-8842-4eee-ad66-2e2f945c47cb admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:22.572183 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4fe739-8842-4eee-ad66-2e2f945c47cb admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:22.581306 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851d0d0c-be43-4e34-82bc-de812e3e89cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:22.582185 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d0d0c-be43-4e34-82bc-de812e3e89cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:22.582599 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d0d0c-be43-4e34-82bc-de812e3e89cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:22.582599 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d0d0c-be43-4e34-82bc-de812e3e89cf admin admin] PATH_INFO: `/v3/projects/77bff747bf344927b1bc5a89717e8db5/users/1c614d238a1b404a80737229573c8018/roles/a9895331e9694fa8b2b50908bb057bcb` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:22.602597 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851d0d0c-be43-4e34-82bc-de812e3e89cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=77bff747bf344927b1bc5a89717e8db5, user_id=1c614d238a1b404a80737229573c8018, role_id=a9895331e9694fa8b2b50908bb057bcb)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:22.606299 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851d0d0c-be43-4e34-82bc-de812e3e89cf admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:22.623689 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:29:22.633956 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1242/2483] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:29:22 2022] PUT /identity/v3/projects/77bff747bf344927b1bc5a89717e8db5/users/1c614d238a1b404a80737229573c8018/roles/a9895331e9694fa8b2b50908bb057bcb => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:29:22.708659 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7388a429-7020-4127-8fbb-43ff01672d57 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:22.708988 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7388a429-7020-4127-8fbb-43ff01672d57 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:22.709284 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7388a429-7020-4127-8fbb-43ff01672d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:22.798131 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-7388a429-7020-4127-8fbb-43ff01672d57 None None] MFA Rules not processed for user `1c614d238a1b404a80737229573c8018`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:29:22.799608 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-7388a429-7020-4127-8fbb-43ff01672d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:22.905813 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1242/2484] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:29:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:29:22.914203 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851d0d0c-be43-4e34-82bc-de812e3e89cf admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:22.915903 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-851d0d0c-be43-4e34-82bc-de812e3e89cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:22.998440 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851d0d0c-be43-4e34-82bc-de812e3e89cf admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:23.002187 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95035dbd-7521-4038-bbff-f2783dcbe6c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6c687a38524de0bf23d87ae91d3b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:23.002916 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95035dbd-7521-4038-bbff-f2783dcbe6c7 service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:23.003201 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95035dbd-7521-4038-bbff-f2783dcbe6c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:23.003467 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95035dbd-7521-4038-bbff-f2783dcbe6c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:23.040251 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95035dbd-7521-4038-bbff-f2783dcbe6c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:23.041884 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95035dbd-7521-4038-bbff-f2783dcbe6c7 service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:23.052063 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1243/2485] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:29:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:29:23.915837 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7388a429-7020-4127-8fbb-43ff01672d57 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:23.918079 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-7388a429-7020-4127-8fbb-43ff01672d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:23.989928 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7388a429-7020-4127-8fbb-43ff01672d57 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:23.993442 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc93d646-45fb-4e3e-9425-53ba095bf73c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:23.994147 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc93d646-45fb-4e3e-9425-53ba095bf73c service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:23.994486 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc93d646-45fb-4e3e-9425-53ba095bf73c service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:23.994824 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc93d646-45fb-4e3e-9425-53ba095bf73c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:23.996588 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-bc93d646-45fb-4e3e-9425-53ba095bf73c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:24.076898 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc93d646-45fb-4e3e-9425-53ba095bf73c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:24.078360 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc93d646-45fb-4e3e-9425-53ba095bf73c service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:24.089511 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1243/2486] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:29:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:29:24.484316 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a2b51-ce77-4f6c-a116-711b636ae4c8 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:24.485239 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a2b51-ce77-4f6c-a116-711b636ae4c8 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:24.485687 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a2b51-ce77-4f6c-a116-711b636ae4c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:24.520739 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-8f9a2b51-ce77-4f6c-a116-711b636ae4c8 None None] MFA Rules not processed for user `1c614d238a1b404a80737229573c8018`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:29:24.522008 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-8f9a2b51-ce77-4f6c-a116-711b636ae4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:24.530823 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1244/2487] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:29:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:29:28.464591 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc93d646-45fb-4e3e-9425-53ba095bf73c service neutron] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:28.468580 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-bc93d646-45fb-4e3e-9425-53ba095bf73c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:28.498908 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc93d646-45fb-4e3e-9425-53ba095bf73c service neutron] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:28.507158 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f09303-a2f2-46f1-8a81-5e63b0625a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:28.508005 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f09303-a2f2-46f1-8a81-5e63b0625a37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:28.508437 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f09303-a2f2-46f1-8a81-5e63b0625a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:28.508878 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f09303-a2f2-46f1-8a81-5e63b0625a37 admin admin] PATH_INFO: `/v3/users/3d39820fab6041b9b655c54ce74e7e4d` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:28.511007 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f09303-a2f2-46f1-8a81-5e63b0625a37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d39820fab6041b9b655c54ce74e7e4d)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:28.512912 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f09303-a2f2-46f1-8a81-5e63b0625a37 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:28.532829 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:29:28.599090 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-01f09303-a2f2-46f1-8a81-5e63b0625a37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d39820fab6041b9b655c54ce74e7e4d'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:28.612183 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-01f09303-a2f2-46f1-8a81-5e63b0625a37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d39820fab6041b9b655c54ce74e7e4d'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:28.620787 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-01f09303-a2f2-46f1-8a81-5e63b0625a37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d39820fab6041b9b655c54ce74e7e4d'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:28.621531 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-01f09303-a2f2-46f1-8a81-5e63b0625a37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d39820fab6041b9b655c54ce74e7e4d'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:28.632708 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-01f09303-a2f2-46f1-8a81-5e63b0625a37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d39820fab6041b9b655c54ce74e7e4d'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:28.639983 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1244/2488] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:29:28 2022] DELETE /identity/v3/users/3d39820fab6041b9b655c54ce74e7e4d => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:29:28.852189 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9a2b51-ce77-4f6c-a116-711b636ae4c8 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:28.864634 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9a2b51-ce77-4f6c-a116-711b636ae4c8 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:28.927574 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3186b99-f97f-4efc-aa6f-f7d5983f4e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:28.928292 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3186b99-f97f-4efc-aa6f-f7d5983f4e9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:28.928636 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3186b99-f97f-4efc-aa6f-f7d5983f4e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:28.928978 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3186b99-f97f-4efc-aa6f-f7d5983f4e9d admin admin] PATH_INFO: `/v3/projects/4de32e41dd4845fbba0547e9c53a4cf2` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:28.930367 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3186b99-f97f-4efc-aa6f-f7d5983f4e9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4de32e41dd4845fbba0547e9c53a4cf2)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:28.932299 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3186b99-f97f-4efc-aa6f-f7d5983f4e9d admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:28.990859 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a3186b99-f97f-4efc-aa6f-f7d5983f4e9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4de32e41dd4845fbba0547e9c53a4cf2', 'request_id': 'req-a3186b99-f97f-4efc-aa6f-f7d5983f4e9d'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:28.996210 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a3186b99-f97f-4efc-aa6f-f7d5983f4e9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4de32e41dd4845fbba0547e9c53a4cf2', 'request_id': 'req-a3186b99-f97f-4efc-aa6f-f7d5983f4e9d'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:29.002198 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a3186b99-f97f-4efc-aa6f-f7d5983f4e9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4de32e41dd4845fbba0547e9c53a4cf2', 'request_id': 'req-a3186b99-f97f-4efc-aa6f-f7d5983f4e9d'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:29.016550 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a3186b99-f97f-4efc-aa6f-f7d5983f4e9d admin admin] The token cache is being invalidate because project 4de32e41dd4845fbba0547e9c53a4cf2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:29:29.016959 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a3186b99-f97f-4efc-aa6f-f7d5983f4e9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:29.017625 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a3186b99-f97f-4efc-aa6f-f7d5983f4e9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:29.019130 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1245/2489] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:29:28 2022] DELETE /identity/v3/projects/4de32e41dd4845fbba0547e9c53a4cf2 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:29:29.024064 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a65ef80-731f-4724-b070-6eec2dea7045 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:29.024605 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a65ef80-731f-4724-b070-6eec2dea7045 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:29.024878 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a65ef80-731f-4724-b070-6eec2dea7045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:29.045742 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-2a65ef80-731f-4724-b070-6eec2dea7045 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:29:29.046987 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-2a65ef80-731f-4724-b070-6eec2dea7045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:29.108900 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1245/2490] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:29:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 10:29:29.117704 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0dcdd-6b6b-49b0-819d-2148c5d37486 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:29.118081 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0dcdd-6b6b-49b0-819d-2148c5d37486 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:29.118414 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0dcdd-6b6b-49b0-819d-2148c5d37486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:29.141196 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-8bf0dcdd-6b6b-49b0-819d-2148c5d37486 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:29:29.142445 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-8bf0dcdd-6b6b-49b0-819d-2148c5d37486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:29.155230 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1246/2491] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:29:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:29:29.159614 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a65ef80-731f-4724-b070-6eec2dea7045 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:29.170136 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a65ef80-731f-4724-b070-6eec2dea7045 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:29.174832 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6988dfc7-535e-4a7e-a2e4-e137d2f9efc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:29.175396 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6988dfc7-535e-4a7e-a2e4-e137d2f9efc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:29.175702 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6988dfc7-535e-4a7e-a2e4-e137d2f9efc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:29.176132 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6988dfc7-535e-4a7e-a2e4-e137d2f9efc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:29.177030 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6988dfc7-535e-4a7e-a2e4-e137d2f9efc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:29:29.177332 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6988dfc7-535e-4a7e-a2e4-e137d2f9efc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:29.178960 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6988dfc7-535e-4a7e-a2e4-e137d2f9efc2 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:29.190765 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1246/2492] 10.222.0.36 () {58 vars in 1153 bytes} [Tue Aug 9 10:29:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:29:29.195970 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf0dcdd-6b6b-49b0-819d-2148c5d37486 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:29.205145 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf0dcdd-6b6b-49b0-819d-2148c5d37486 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:29.210742 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0643e7fb-fe19-4a2b-a3c4-39f3dd19e83d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:29.211467 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0643e7fb-fe19-4a2b-a3c4-39f3dd19e83d admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:29.211748 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0643e7fb-fe19-4a2b-a3c4-39f3dd19e83d admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:29.212015 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0643e7fb-fe19-4a2b-a3c4-39f3dd19e83d admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:29.212671 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0643e7fb-fe19-4a2b-a3c4-39f3dd19e83d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:29.214621 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0643e7fb-fe19-4a2b-a3c4-39f3dd19e83d admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:29.232586 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:29:29.247008 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1247/2493] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:29:29 2022] POST /identity/v3/projects => generated 379 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:29:29.251308 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6988dfc7-535e-4a7e-a2e4-e137d2f9efc2 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:29.263410 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6988dfc7-535e-4a7e-a2e4-e137d2f9efc2 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:29.340896 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5912ef-01bf-4385-9a7c-127ca55a8fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:29.341525 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5912ef-01bf-4385-9a7c-127ca55a8fde admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:29.341803 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5912ef-01bf-4385-9a7c-127ca55a8fde admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:29.342102 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5912ef-01bf-4385-9a7c-127ca55a8fde admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:29.342727 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5912ef-01bf-4385-9a7c-127ca55a8fde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:29.344616 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5912ef-01bf-4385-9a7c-127ca55a8fde admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:29.368787 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1247/2494] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:29:29 2022] POST /identity/v3/users => generated 290 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:29:29.373216 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0643e7fb-fe19-4a2b-a3c4-39f3dd19e83d admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:29.384544 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0643e7fb-fe19-4a2b-a3c4-39f3dd19e83d admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:29.389457 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d1e362-6e3b-4af0-be44-70399d5c605a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:29.390090 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d1e362-6e3b-4af0-be44-70399d5c605a admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:29.390373 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d1e362-6e3b-4af0-be44-70399d5c605a admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:29.390846 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d1e362-6e3b-4af0-be44-70399d5c605a admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:29.392525 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d1e362-6e3b-4af0-be44-70399d5c605a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:29.393356 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d1e362-6e3b-4af0-be44-70399d5c605a admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:29.404095 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1248/2495] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:29:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:29:29.408117 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5912ef-01bf-4385-9a7c-127ca55a8fde admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:29.413427 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:29:29.418834 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5912ef-01bf-4385-9a7c-127ca55a8fde admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:29.426888 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33603667-9098-4905-8766-15d80ce93a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:29.427909 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33603667-9098-4905-8766-15d80ce93a12 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:29.429123 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33603667-9098-4905-8766-15d80ce93a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:29.429423 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33603667-9098-4905-8766-15d80ce93a12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:29.430349 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33603667-9098-4905-8766-15d80ce93a12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:29.432081 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33603667-9098-4905-8766-15d80ce93a12 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:29.444986 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1248/2496] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:29:29 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 10:29:29.449045 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d1e362-6e3b-4af0-be44-70399d5c605a admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:29.459954 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d1e362-6e3b-4af0-be44-70399d5c605a admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:29.465766 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fcc43f-4e7f-4fdb-bc36-d5016ec490f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:29.466666 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fcc43f-4e7f-4fdb-bc36-d5016ec490f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:29.466787 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fcc43f-4e7f-4fdb-bc36-d5016ec490f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:29.466974 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fcc43f-4e7f-4fdb-bc36-d5016ec490f5 admin admin] PATH_INFO: `/v3/projects/be44ff1d779847bba6ec756abb8eaa37/users/3334852a43ca4802ab4b364d61ddbb4e/roles/a9895331e9694fa8b2b50908bb057bcb` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:29.483657 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fcc43f-4e7f-4fdb-bc36-d5016ec490f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be44ff1d779847bba6ec756abb8eaa37, user_id=3334852a43ca4802ab4b364d61ddbb4e, role_id=a9895331e9694fa8b2b50908bb057bcb)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:29.486492 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fcc43f-4e7f-4fdb-bc36-d5016ec490f5 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:29.513979 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1249/2497] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:29:29 2022] PUT /identity/v3/projects/be44ff1d779847bba6ec756abb8eaa37/users/3334852a43ca4802ab4b364d61ddbb4e/roles/a9895331e9694fa8b2b50908bb057bcb => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:29:29.520167 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c76b7f-aafb-4eb6-8a8f-e16b78c51407 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:29.520701 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c76b7f-aafb-4eb6-8a8f-e16b78c51407 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:29.520701 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c76b7f-aafb-4eb6-8a8f-e16b78c51407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:29.553243 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-48c76b7f-aafb-4eb6-8a8f-e16b78c51407 None None] MFA Rules not processed for user `3334852a43ca4802ab4b364d61ddbb4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:29:29.554703 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-48c76b7f-aafb-4eb6-8a8f-e16b78c51407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:29.706937 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1249/2498] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:29:29 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:29:29.712121 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fcc43f-4e7f-4fdb-bc36-d5016ec490f5 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:29.798310 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fcc43f-4e7f-4fdb-bc36-d5016ec490f5 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:29.807221 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8d0774-27d8-41ea-8bf0-8acf964bf5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:29.807906 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d0774-27d8-41ea-8bf0-8acf964bf5dd admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:29.808239 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d0774-27d8-41ea-8bf0-8acf964bf5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:29.808506 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d0774-27d8-41ea-8bf0-8acf964bf5dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:29.809182 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8d0774-27d8-41ea-8bf0-8acf964bf5dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:29.811193 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8d0774-27d8-41ea-8bf0-8acf964bf5dd admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:29.845935 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1250/2499] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:29:29 2022] POST /identity/v3/projects => generated 377 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 10:29:29.850128 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c76b7f-aafb-4eb6-8a8f-e16b78c51407 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:29.872204 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c76b7f-aafb-4eb6-8a8f-e16b78c51407 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:29.960421 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed655f5-0926-474f-a1d3-b90e421ad9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:29.961362 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed655f5-0926-474f-a1d3-b90e421ad9c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:29.962017 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed655f5-0926-474f-a1d3-b90e421ad9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:29.962519 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed655f5-0926-474f-a1d3-b90e421ad9c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:29.963529 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed655f5-0926-474f-a1d3-b90e421ad9c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:29.970319 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed655f5-0926-474f-a1d3-b90e421ad9c2 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:30.026087 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1250/2500] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:29:29 2022] POST /identity/v3/users => generated 295 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 10:29:30.029948 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8d0774-27d8-41ea-8bf0-8acf964bf5dd admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:30.041151 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8d0774-27d8-41ea-8bf0-8acf964bf5dd admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:30.047000 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bf18e6-8157-4d02-b9fa-a448721ed88d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:30.047674 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bf18e6-8157-4d02-b9fa-a448721ed88d admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:30.048006 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bf18e6-8157-4d02-b9fa-a448721ed88d admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:30.048496 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bf18e6-8157-4d02-b9fa-a448721ed88d admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:30.049186 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bf18e6-8157-4d02-b9fa-a448721ed88d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:30.051547 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bf18e6-8157-4d02-b9fa-a448721ed88d admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:30.068588 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1251/2501] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:29:30 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:29:30.072914 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed655f5-0926-474f-a1d3-b90e421ad9c2 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:30.084635 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed655f5-0926-474f-a1d3-b90e421ad9c2 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:30.089362 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdfcb5f-a10a-4469-93f0-4e64b081ab92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:30.090056 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdfcb5f-a10a-4469-93f0-4e64b081ab92 admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:30.090338 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdfcb5f-a10a-4469-93f0-4e64b081ab92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:30.090611 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdfcb5f-a10a-4469-93f0-4e64b081ab92 admin admin] PATH_INFO: `/v3/projects/3d861893246344328c93d6945a8f5977/users/00b2feafbfcc4f9cacd214ed6a7eb9b0/roles/89ca30cbbb634be8a96e9921aa56626b` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:30.106987 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdfcb5f-a10a-4469-93f0-4e64b081ab92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d861893246344328c93d6945a8f5977, user_id=00b2feafbfcc4f9cacd214ed6a7eb9b0, role_id=89ca30cbbb634be8a96e9921aa56626b)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:30.109658 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdfcb5f-a10a-4469-93f0-4e64b081ab92 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:30.125160 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1251/2502] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:29:30 2022] PUT /identity/v3/projects/3d861893246344328c93d6945a8f5977/users/00b2feafbfcc4f9cacd214ed6a7eb9b0/roles/89ca30cbbb634be8a96e9921aa56626b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:29:30.129663 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bf18e6-8157-4d02-b9fa-a448721ed88d admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:30.139729 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bf18e6-8157-4d02-b9fa-a448721ed88d admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:30.204416 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94895a2c-af47-497e-913e-65042be77c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:30.205136 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94895a2c-af47-497e-913e-65042be77c57 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:30.205414 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94895a2c-af47-497e-913e-65042be77c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:30.205684 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94895a2c-af47-497e-913e-65042be77c57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:30.206369 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94895a2c-af47-497e-913e-65042be77c57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:30.208476 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94895a2c-af47-497e-913e-65042be77c57 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:30.221802 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1252/2503] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:29:30 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:29:30.223716 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdfcb5f-a10a-4469-93f0-4e64b081ab92 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:30.234309 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdfcb5f-a10a-4469-93f0-4e64b081ab92 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:30.239040 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828dbb4b-54d4-4bf6-851a-653395516d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:30.239678 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828dbb4b-54d4-4bf6-851a-653395516d05 admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:30.239951 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828dbb4b-54d4-4bf6-851a-653395516d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:30.240220 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828dbb4b-54d4-4bf6-851a-653395516d05 admin admin] PATH_INFO: `/v3/projects/3d861893246344328c93d6945a8f5977/users/00b2feafbfcc4f9cacd214ed6a7eb9b0/roles/89ca30cbbb634be8a96e9921aa56626b` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:30.242118 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828dbb4b-54d4-4bf6-851a-653395516d05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d861893246344328c93d6945a8f5977, user_id=00b2feafbfcc4f9cacd214ed6a7eb9b0, role_id=89ca30cbbb634be8a96e9921aa56626b)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:30.244726 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828dbb4b-54d4-4bf6-851a-653395516d05 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:30.254887 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1252/2504] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:29:30 2022] PUT /identity/v3/projects/3d861893246344328c93d6945a8f5977/users/00b2feafbfcc4f9cacd214ed6a7eb9b0/roles/89ca30cbbb634be8a96e9921aa56626b => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:29:30.266415 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c96b4ce-6803-4c61-b09a-a4b2d599ce25 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:30.266702 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c96b4ce-6803-4c61-b09a-a4b2d599ce25 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:30.266971 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c96b4ce-6803-4c61-b09a-a4b2d599ce25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:30.296250 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-1c96b4ce-6803-4c61-b09a-a4b2d599ce25 None None] MFA Rules not processed for user `00b2feafbfcc4f9cacd214ed6a7eb9b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:29:30.297450 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-1c96b4ce-6803-4c61-b09a-a4b2d599ce25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:30.315354 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:29:30.365957 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1253/2505] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:29:30 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:29:30.377200 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828dbb4b-54d4-4bf6-851a-653395516d05 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:30.380081 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-828dbb4b-54d4-4bf6-851a-653395516d05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:30.415748 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:29:30.438079 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828dbb4b-54d4-4bf6-851a-653395516d05 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:30.442284 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae62acd-8bc3-4633-a591-2b89a1e9ebf8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6c687a38524de0bf23d87ae91d3b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:30.442873 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae62acd-8bc3-4633-a591-2b89a1e9ebf8 service cinder] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:30.443148 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae62acd-8bc3-4633-a591-2b89a1e9ebf8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:30.443468 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae62acd-8bc3-4633-a591-2b89a1e9ebf8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:30.499592 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae62acd-8bc3-4633-a591-2b89a1e9ebf8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:30.500945 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae62acd-8bc3-4633-a591-2b89a1e9ebf8 service cinder] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:30.510787 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1253/2506] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:29:30 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:29:31.531636 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9960c4-e244-4842-a77f-d46bbfc721e2 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:31.532134 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9960c4-e244-4842-a77f-d46bbfc721e2 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:31.532228 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9960c4-e244-4842-a77f-d46bbfc721e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:31.552803 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-dc9960c4-e244-4842-a77f-d46bbfc721e2 None None] MFA Rules not processed for user `cedc4d6c59c44c6d8fb7179070db5e91`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:29:31.554181 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-dc9960c4-e244-4842-a77f-d46bbfc721e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:31.616595 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1254/2507] 10.222.0.36 () {58 vars in 967 bytes} [Tue Aug 9 10:29:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:29:31.638831 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae62acd-8bc3-4633-a591-2b89a1e9ebf8 service cinder] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:31.640261 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-aae62acd-8bc3-4633-a591-2b89a1e9ebf8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:31.711671 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae62acd-8bc3-4633-a591-2b89a1e9ebf8 service cinder] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:31.716929 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe94fc64-2d6c-4b96-9ace-a83c1b118035 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '841c5dbaae774944b637c533ebd75b29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:31.717526 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe94fc64-2d6c-4b96-9ace-a83c1b118035 service swift] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:31.717801 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe94fc64-2d6c-4b96-9ace-a83c1b118035 service swift] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:31.718098 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe94fc64-2d6c-4b96-9ace-a83c1b118035 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:31.726127 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe94fc64-2d6c-4b96-9ace-a83c1b118035 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:31.727699 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe94fc64-2d6c-4b96-9ace-a83c1b118035 service swift] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:31.735843 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1254/2508] 10.222.0.36 () {60 vars in 1384 bytes} [Tue Aug 9 10:29:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 10:29:31.877818 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9960c4-e244-4842-a77f-d46bbfc721e2 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:31.889117 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9960c4-e244-4842-a77f-d46bbfc721e2 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:31.894074 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01b0793-138c-49ab-a00e-78d0921e52d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6c687a38524de0bf23d87ae91d3b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:31.894729 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01b0793-138c-49ab-a00e-78d0921e52d0 service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:31.895009 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01b0793-138c-49ab-a00e-78d0921e52d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:31.895333 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01b0793-138c-49ab-a00e-78d0921e52d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:31.913306 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01b0793-138c-49ab-a00e-78d0921e52d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:31.915115 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01b0793-138c-49ab-a00e-78d0921e52d0 service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:31.932499 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1255/2509] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:29:31 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:29:34.059293 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe94fc64-2d6c-4b96-9ace-a83c1b118035 service swift] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:34.060739 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-fe94fc64-2d6c-4b96-9ace-a83c1b118035 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:34.126016 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe94fc64-2d6c-4b96-9ace-a83c1b118035 service swift] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:34.131506 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8625b33-0549-47b0-9507-ae41e2be0dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:34.132117 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8625b33-0549-47b0-9507-ae41e2be0dc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:34.132394 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8625b33-0549-47b0-9507-ae41e2be0dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:34.132665 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8625b33-0549-47b0-9507-ae41e2be0dc4 admin admin] PATH_INFO: `/v3/users/84247bc4be744cf68759c4070e84a141` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:34.133756 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8625b33-0549-47b0-9507-ae41e2be0dc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84247bc4be744cf68759c4070e84a141)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:34.135691 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8625b33-0549-47b0-9507-ae41e2be0dc4 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:34.156716 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:29:34.181154 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-d8625b33-0549-47b0-9507-ae41e2be0dc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84247bc4be744cf68759c4070e84a141'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:34.195945 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-d8625b33-0549-47b0-9507-ae41e2be0dc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84247bc4be744cf68759c4070e84a141'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:34.202856 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-d8625b33-0549-47b0-9507-ae41e2be0dc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84247bc4be744cf68759c4070e84a141'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:34.203579 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-d8625b33-0549-47b0-9507-ae41e2be0dc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84247bc4be744cf68759c4070e84a141'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:34.211617 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-d8625b33-0549-47b0-9507-ae41e2be0dc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84247bc4be744cf68759c4070e84a141'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:34.217483 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1255/2510] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:29:34 2022] DELETE /identity/v3/users/84247bc4be744cf68759c4070e84a141 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:29:34.222004 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc993ba-f996-4baf-b322-dbf68f3d323f None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:34.222503 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc993ba-f996-4baf-b322-dbf68f3d323f None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:34.222601 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc993ba-f996-4baf-b322-dbf68f3d323f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:34.241241 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-dcc993ba-f996-4baf-b322-dbf68f3d323f None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:29:34.242449 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-dcc993ba-f996-4baf-b322-dbf68f3d323f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:34.301043 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1256/2511] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:29:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:29:34.310719 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8625b33-0549-47b0-9507-ae41e2be0dc4 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:34.312117 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-d8625b33-0549-47b0-9507-ae41e2be0dc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:34.371715 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8625b33-0549-47b0-9507-ae41e2be0dc4 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:34.375322 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082cf7aa-75f5-4203-92c1-b25f9bf987c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:34.375920 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082cf7aa-75f5-4203-92c1-b25f9bf987c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:34.376196 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082cf7aa-75f5-4203-92c1-b25f9bf987c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:34.376486 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082cf7aa-75f5-4203-92c1-b25f9bf987c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:34.385994 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082cf7aa-75f5-4203-92c1-b25f9bf987c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:34.387400 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082cf7aa-75f5-4203-92c1-b25f9bf987c5 service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:34.397197 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1256/2512] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:29:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:29:34.678392 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc993ba-f996-4baf-b322-dbf68f3d323f None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:34.679909 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-dcc993ba-f996-4baf-b322-dbf68f3d323f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:34.712226 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc993ba-f996-4baf-b322-dbf68f3d323f None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:34.717346 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d99b59e-9bfa-46e1-ae30-740f1f8568bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:34.718031 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d99b59e-9bfa-46e1-ae30-740f1f8568bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:34.718272 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d99b59e-9bfa-46e1-ae30-740f1f8568bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:34.718542 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d99b59e-9bfa-46e1-ae30-740f1f8568bc admin admin] PATH_INFO: `/v3/projects/e13117e64f844a2aae98927662eb3dd0` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:34.719650 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d99b59e-9bfa-46e1-ae30-740f1f8568bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=e13117e64f844a2aae98927662eb3dd0)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:34.721556 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d99b59e-9bfa-46e1-ae30-740f1f8568bc admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:34.764746 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:29:34.768909 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-0d99b59e-9bfa-46e1-ae30-740f1f8568bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e13117e64f844a2aae98927662eb3dd0', 'request_id': 'req-0d99b59e-9bfa-46e1-ae30-740f1f8568bc'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:34.775545 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-0d99b59e-9bfa-46e1-ae30-740f1f8568bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e13117e64f844a2aae98927662eb3dd0', 'request_id': 'req-0d99b59e-9bfa-46e1-ae30-740f1f8568bc'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:34.781984 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-0d99b59e-9bfa-46e1-ae30-740f1f8568bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e13117e64f844a2aae98927662eb3dd0', 'request_id': 'req-0d99b59e-9bfa-46e1-ae30-740f1f8568bc'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:34.794785 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-0d99b59e-9bfa-46e1-ae30-740f1f8568bc admin admin] The token cache is being invalidate because project e13117e64f844a2aae98927662eb3dd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:29:34.795077 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-0d99b59e-9bfa-46e1-ae30-740f1f8568bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:34.795698 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-0d99b59e-9bfa-46e1-ae30-740f1f8568bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:34.797165 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1257/2513] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:29:34 2022] DELETE /identity/v3/projects/e13117e64f844a2aae98927662eb3dd0 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:29:34.802253 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082cf7aa-75f5-4203-92c1-b25f9bf987c5 service neutron] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:34.811661 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082cf7aa-75f5-4203-92c1-b25f9bf987c5 service neutron] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:34.868906 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698ec441-c40c-43ba-80e5-4b180d85bbf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:34.869529 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698ec441-c40c-43ba-80e5-4b180d85bbf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:34.869831 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698ec441-c40c-43ba-80e5-4b180d85bbf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:34.870267 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698ec441-c40c-43ba-80e5-4b180d85bbf5 admin admin] PATH_INFO: `/v3/users/ea889fdd12254855915e9174882999fc` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:34.871665 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698ec441-c40c-43ba-80e5-4b180d85bbf5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea889fdd12254855915e9174882999fc)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:34.874049 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698ec441-c40c-43ba-80e5-4b180d85bbf5 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:34.915557 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:29:34.921608 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-698ec441-c40c-43ba-80e5-4b180d85bbf5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea889fdd12254855915e9174882999fc'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:34.934853 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-698ec441-c40c-43ba-80e5-4b180d85bbf5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea889fdd12254855915e9174882999fc'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:34.942162 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-698ec441-c40c-43ba-80e5-4b180d85bbf5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea889fdd12254855915e9174882999fc'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:34.942852 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-698ec441-c40c-43ba-80e5-4b180d85bbf5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea889fdd12254855915e9174882999fc'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:34.951733 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-698ec441-c40c-43ba-80e5-4b180d85bbf5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea889fdd12254855915e9174882999fc'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:34.958958 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1257/2514] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:29:34 2022] DELETE /identity/v3/users/ea889fdd12254855915e9174882999fc => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:29:35.248569 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d99b59e-9bfa-46e1-ae30-740f1f8568bc admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:35.250046 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-0d99b59e-9bfa-46e1-ae30-740f1f8568bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:35.264864 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d99b59e-9bfa-46e1-ae30-740f1f8568bc admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:35.321663 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3c068b-4640-4c03-8d76-9c5bd29cbd71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:35.322219 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3c068b-4640-4c03-8d76-9c5bd29cbd71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:35.322500 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3c068b-4640-4c03-8d76-9c5bd29cbd71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:35.323158 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3c068b-4640-4c03-8d76-9c5bd29cbd71 admin admin] PATH_INFO: `/v3/projects/73ba5401ce6f4888b10550863e5edae7` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:35.324197 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3c068b-4640-4c03-8d76-9c5bd29cbd71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73ba5401ce6f4888b10550863e5edae7)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:35.326164 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3c068b-4640-4c03-8d76-9c5bd29cbd71 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:35.372169 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-6c3c068b-4640-4c03-8d76-9c5bd29cbd71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73ba5401ce6f4888b10550863e5edae7', 'request_id': 'req-6c3c068b-4640-4c03-8d76-9c5bd29cbd71'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:35.377499 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-6c3c068b-4640-4c03-8d76-9c5bd29cbd71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73ba5401ce6f4888b10550863e5edae7', 'request_id': 'req-6c3c068b-4640-4c03-8d76-9c5bd29cbd71'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:35.384223 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-6c3c068b-4640-4c03-8d76-9c5bd29cbd71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73ba5401ce6f4888b10550863e5edae7', 'request_id': 'req-6c3c068b-4640-4c03-8d76-9c5bd29cbd71'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:35.396604 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-6c3c068b-4640-4c03-8d76-9c5bd29cbd71 admin admin] The token cache is being invalidate because project 73ba5401ce6f4888b10550863e5edae7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:29:35.396900 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-6c3c068b-4640-4c03-8d76-9c5bd29cbd71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:35.397565 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-6c3c068b-4640-4c03-8d76-9c5bd29cbd71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:35.399061 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1258/2515] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:29:35 2022] DELETE /identity/v3/projects/73ba5401ce6f4888b10550863e5edae7 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:29:35.404778 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ecb4cb-fb93-4a0b-a92f-8bdf8538434d None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:35.405306 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ecb4cb-fb93-4a0b-a92f-8bdf8538434d None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:35.405442 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ecb4cb-fb93-4a0b-a92f-8bdf8538434d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:35.425973 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-f5ecb4cb-fb93-4a0b-a92f-8bdf8538434d None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:29:35.427191 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-f5ecb4cb-fb93-4a0b-a92f-8bdf8538434d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:35.491996 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1258/2516] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:29:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:29:35.499906 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea9f20d-9ba4-4302-9e39-be685fac77be None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:35.500191 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea9f20d-9ba4-4302-9e39-be685fac77be None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:35.500464 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea9f20d-9ba4-4302-9e39-be685fac77be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:35.520976 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-4ea9f20d-9ba4-4302-9e39-be685fac77be None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:29:35.522249 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-4ea9f20d-9ba4-4302-9e39-be685fac77be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:35.530472 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1259/2517] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:29:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:29:35.534729 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ecb4cb-fb93-4a0b-a92f-8bdf8538434d None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:35.544338 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ecb4cb-fb93-4a0b-a92f-8bdf8538434d None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:35.548799 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09258cc4-161a-4294-8881-65c499b42943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:35.549385 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09258cc4-161a-4294-8881-65c499b42943 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:35.549659 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09258cc4-161a-4294-8881-65c499b42943 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:35.549964 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09258cc4-161a-4294-8881-65c499b42943 admin admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:35.551359 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09258cc4-161a-4294-8881-65c499b42943 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:29:35.551665 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09258cc4-161a-4294-8881-65c499b42943 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:35.553246 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09258cc4-161a-4294-8881-65c499b42943 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:35.564443 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1259/2518] 10.222.0.36 () {58 vars in 1153 bytes} [Tue Aug 9 10:29:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:29:35.569451 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea9f20d-9ba4-4302-9e39-be685fac77be None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:35.578783 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea9f20d-9ba4-4302-9e39-be685fac77be None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:35.583416 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfef58ec-c57e-4ac7-9a9a-050cbadf8bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:35.584013 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef58ec-c57e-4ac7-9a9a-050cbadf8bf9 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:35.584276 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef58ec-c57e-4ac7-9a9a-050cbadf8bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:35.584548 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef58ec-c57e-4ac7-9a9a-050cbadf8bf9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:35.585226 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfef58ec-c57e-4ac7-9a9a-050cbadf8bf9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:35.587470 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfef58ec-c57e-4ac7-9a9a-050cbadf8bf9 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:35.616648 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1260/2519] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:29:35 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:29:35.620765 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09258cc4-161a-4294-8881-65c499b42943 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:35.630723 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09258cc4-161a-4294-8881-65c499b42943 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:35.689930 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed37f713-9647-483d-bc53-6ba0b29a1543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:35.690562 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed37f713-9647-483d-bc53-6ba0b29a1543 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:35.690837 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed37f713-9647-483d-bc53-6ba0b29a1543 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:35.691116 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed37f713-9647-483d-bc53-6ba0b29a1543 admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:35.692074 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed37f713-9647-483d-bc53-6ba0b29a1543 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:35.694003 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed37f713-9647-483d-bc53-6ba0b29a1543 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:35.718990 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1260/2520] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:29:35 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:29:35.723787 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfef58ec-c57e-4ac7-9a9a-050cbadf8bf9 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:35.735343 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfef58ec-c57e-4ac7-9a9a-050cbadf8bf9 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:35.740946 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba12c529-132c-42ea-b269-cc0801430295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:35.741671 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba12c529-132c-42ea-b269-cc0801430295 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:35.741980 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba12c529-132c-42ea-b269-cc0801430295 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:35.742252 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba12c529-132c-42ea-b269-cc0801430295 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:35.742887 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba12c529-132c-42ea-b269-cc0801430295 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:35.744461 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba12c529-132c-42ea-b269-cc0801430295 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:35.755357 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1261/2521] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:29:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 10:29:35.759992 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed37f713-9647-483d-bc53-6ba0b29a1543 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:35.760735 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba12c529-132c-42ea-b269-cc0801430295 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:35.762588 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-ba12c529-132c-42ea-b269-cc0801430295 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:35.770605 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed37f713-9647-483d-bc53-6ba0b29a1543 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:35.775695 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c72b674-20c1-4fc3-877b-7c673f271c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:35.776283 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c72b674-20c1-4fc3-877b-7c673f271c65 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:35.776559 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c72b674-20c1-4fc3-877b-7c673f271c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:35.776738 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba12c529-132c-42ea-b269-cc0801430295 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:35.776842 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c72b674-20c1-4fc3-877b-7c673f271c65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:35.777459 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c72b674-20c1-4fc3-877b-7c673f271c65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:35.779146 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c72b674-20c1-4fc3-877b-7c673f271c65 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:35.781429 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cba7467-72ab-412a-aa12-70987f36f0b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:35.782063 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cba7467-72ab-412a-aa12-70987f36f0b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:35.782343 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cba7467-72ab-412a-aa12-70987f36f0b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:35.782619 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cba7467-72ab-412a-aa12-70987f36f0b2 admin admin] PATH_INFO: `/v3/users/3334852a43ca4802ab4b364d61ddbb4e` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:35.783733 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cba7467-72ab-412a-aa12-70987f36f0b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3334852a43ca4802ab4b364d61ddbb4e)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:35.786419 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cba7467-72ab-412a-aa12-70987f36f0b2 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:35.789485 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1261/2522] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:29:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:29:35.793960 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c72b674-20c1-4fc3-877b-7c673f271c65 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:35.803523 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:29:35.803824 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c72b674-20c1-4fc3-877b-7c673f271c65 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:35.808736 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd520ab-e3fd-443f-b350-1353a24d7336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:35.809356 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd520ab-e3fd-443f-b350-1353a24d7336 admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:35.809630 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd520ab-e3fd-443f-b350-1353a24d7336 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:35.810007 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd520ab-e3fd-443f-b350-1353a24d7336 admin admin] PATH_INFO: `/v3/projects/2845b3897dce44208ac45f65077d2cc3/users/dbdd03a8f39143e39f7d53493d61f46f/roles/a9895331e9694fa8b2b50908bb057bcb` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:35.827981 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd520ab-e3fd-443f-b350-1353a24d7336 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2845b3897dce44208ac45f65077d2cc3, user_id=dbdd03a8f39143e39f7d53493d61f46f, role_id=a9895331e9694fa8b2b50908bb057bcb)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:35.830804 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd520ab-e3fd-443f-b350-1353a24d7336 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:35.837545 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-1cba7467-72ab-412a-aa12-70987f36f0b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3334852a43ca4802ab4b364d61ddbb4e'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:35.840154 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:29:35.845505 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1262/2523] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:29:35 2022] PUT /identity/v3/projects/2845b3897dce44208ac45f65077d2cc3/users/dbdd03a8f39143e39f7d53493d61f46f/roles/a9895331e9694fa8b2b50908bb057bcb => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:29:35.856321 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a4ba8-fb4e-473d-bb8d-64b469a30158 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:35.856321 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a4ba8-fb4e-473d-bb8d-64b469a30158 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:35.856321 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a4ba8-fb4e-473d-bb8d-64b469a30158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:35.859047 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-1cba7467-72ab-412a-aa12-70987f36f0b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3334852a43ca4802ab4b364d61ddbb4e'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:35.866986 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-1cba7467-72ab-412a-aa12-70987f36f0b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3334852a43ca4802ab4b364d61ddbb4e'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:35.867889 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-1cba7467-72ab-412a-aa12-70987f36f0b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3334852a43ca4802ab4b364d61ddbb4e'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:35.875797 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-1cba7467-72ab-412a-aa12-70987f36f0b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3334852a43ca4802ab4b364d61ddbb4e'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:35.882562 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1262/2524] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:29:35 2022] DELETE /identity/v3/users/3334852a43ca4802ab4b364d61ddbb4e => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 10:29:35.887103 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63facb4-2ec8-495a-8286-53f88d7c1316 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:35.887340 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-497a4ba8-fb4e-473d-bb8d-64b469a30158 None None] MFA Rules not processed for user `dbdd03a8f39143e39f7d53493d61f46f`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:29:35.887479 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63facb4-2ec8-495a-8286-53f88d7c1316 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:35.887657 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63facb4-2ec8-495a-8286-53f88d7c1316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:35.888529 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-497a4ba8-fb4e-473d-bb8d-64b469a30158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:35.907683 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-d63facb4-2ec8-495a-8286-53f88d7c1316 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:29:35.908878 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-d63facb4-2ec8-495a-8286-53f88d7c1316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:35.952481 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1263/2525] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:29:35 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 10:29:35.957635 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497a4ba8-fb4e-473d-bb8d-64b469a30158 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:35.959073 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-497a4ba8-fb4e-473d-bb8d-64b469a30158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:35.974859 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1263/2526] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:29:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 10:29:35.984373 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63facb4-2ec8-495a-8286-53f88d7c1316 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:35.986104 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-d63facb4-2ec8-495a-8286-53f88d7c1316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:36.023575 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497a4ba8-fb4e-473d-bb8d-64b469a30158 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:36.028995 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748e393f-ea36-4b67-b8cb-c3a16246368f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:36.029593 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e393f-ea36-4b67-b8cb-c3a16246368f admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:36.029894 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e393f-ea36-4b67-b8cb-c3a16246368f admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:36.030172 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e393f-ea36-4b67-b8cb-c3a16246368f admin admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:36.030784 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748e393f-ea36-4b67-b8cb-c3a16246368f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:36.032689 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748e393f-ea36-4b67-b8cb-c3a16246368f admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:36.042768 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63facb4-2ec8-495a-8286-53f88d7c1316 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:36.046689 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e82969-1a11-4760-bb69-fb27d3ad03cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:36.047285 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e82969-1a11-4760-bb69-fb27d3ad03cb service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:36.047564 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e82969-1a11-4760-bb69-fb27d3ad03cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:36.047840 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e82969-1a11-4760-bb69-fb27d3ad03cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:36.058676 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e82969-1a11-4760-bb69-fb27d3ad03cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:36.060118 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e82969-1a11-4760-bb69-fb27d3ad03cb service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:36.065735 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1264/2527] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:29:35 2022] POST /identity/v3/projects => generated 385 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 10:29:36.067318 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748e393f-ea36-4b67-b8cb-c3a16246368f admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:36.071574 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1264/2528] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:29:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 10:29:36.133080 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748e393f-ea36-4b67-b8cb-c3a16246368f admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:36.138567 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da208969-2904-4a6c-abf8-67efeed34e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:36.139257 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da208969-2904-4a6c-abf8-67efeed34e5d admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:36.139631 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da208969-2904-4a6c-abf8-67efeed34e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:36.139903 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da208969-2904-4a6c-abf8-67efeed34e5d admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:36.140700 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da208969-2904-4a6c-abf8-67efeed34e5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:36.142677 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da208969-2904-4a6c-abf8-67efeed34e5d admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:36.164057 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1265/2529] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:29:36 2022] POST /identity/v3/users => generated 299 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:29:36.168061 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e82969-1a11-4760-bb69-fb27d3ad03cb service neutron] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:36.178595 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e82969-1a11-4760-bb69-fb27d3ad03cb service neutron] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:36.183279 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872c80d6-0ddc-442d-a9d6-034c1de37acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:36.183871 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c80d6-0ddc-442d-a9d6-034c1de37acc admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:36.184157 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c80d6-0ddc-442d-a9d6-034c1de37acc admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:36.184435 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c80d6-0ddc-442d-a9d6-034c1de37acc admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:36.185104 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872c80d6-0ddc-442d-a9d6-034c1de37acc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:36.186764 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872c80d6-0ddc-442d-a9d6-034c1de37acc admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:36.198289 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1265/2530] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:29:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:29:36.202195 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da208969-2904-4a6c-abf8-67efeed34e5d admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:36.210692 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:29:36.216270 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da208969-2904-4a6c-abf8-67efeed34e5d admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:36.224356 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a41908-df7b-4645-bb35-0b580ab1d487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:36.225038 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a41908-df7b-4645-bb35-0b580ab1d487 admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:36.225312 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a41908-df7b-4645-bb35-0b580ab1d487 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:36.225773 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a41908-df7b-4645-bb35-0b580ab1d487 admin admin] PATH_INFO: `/v3/projects/6ef11d9e4e5e433ebd981a6c8015ce07/users/15284cc3067f41a99b30975ca9f19cc8/roles/89ca30cbbb634be8a96e9921aa56626b` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:36.256582 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a41908-df7b-4645-bb35-0b580ab1d487 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ef11d9e4e5e433ebd981a6c8015ce07, user_id=15284cc3067f41a99b30975ca9f19cc8, role_id=89ca30cbbb634be8a96e9921aa56626b)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:36.259477 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a41908-df7b-4645-bb35-0b580ab1d487 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:36.274612 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1266/2531] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:29:36 2022] PUT /identity/v3/projects/6ef11d9e4e5e433ebd981a6c8015ce07/users/15284cc3067f41a99b30975ca9f19cc8/roles/89ca30cbbb634be8a96e9921aa56626b => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 10:29:36.278607 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872c80d6-0ddc-442d-a9d6-034c1de37acc admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:36.290109 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872c80d6-0ddc-442d-a9d6-034c1de37acc admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:36.317586 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:29:36.355723 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f35bced-da79-4781-9477-0186426867af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:36.356406 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f35bced-da79-4781-9477-0186426867af admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:36.356755 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f35bced-da79-4781-9477-0186426867af admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:36.357188 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f35bced-da79-4781-9477-0186426867af admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:36.357949 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f35bced-da79-4781-9477-0186426867af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:36.359723 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f35bced-da79-4781-9477-0186426867af admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:36.370831 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1266/2532] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:29:36 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:29:36.374838 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a41908-df7b-4645-bb35-0b580ab1d487 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:36.386540 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a41908-df7b-4645-bb35-0b580ab1d487 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:36.391260 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da224da-36cd-43b5-b260-7f04c520e028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:36.392145 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da224da-36cd-43b5-b260-7f04c520e028 admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:36.392425 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da224da-36cd-43b5-b260-7f04c520e028 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:36.392691 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da224da-36cd-43b5-b260-7f04c520e028 admin admin] PATH_INFO: `/v3/projects/6ef11d9e4e5e433ebd981a6c8015ce07/users/15284cc3067f41a99b30975ca9f19cc8/roles/89ca30cbbb634be8a96e9921aa56626b` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:36.395436 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da224da-36cd-43b5-b260-7f04c520e028 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ef11d9e4e5e433ebd981a6c8015ce07, user_id=15284cc3067f41a99b30975ca9f19cc8, role_id=89ca30cbbb634be8a96e9921aa56626b)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:36.398176 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da224da-36cd-43b5-b260-7f04c520e028 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:36.416686 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1267/2533] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:29:36 2022] PUT /identity/v3/projects/6ef11d9e4e5e433ebd981a6c8015ce07/users/15284cc3067f41a99b30975ca9f19cc8/roles/89ca30cbbb634be8a96e9921aa56626b => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:29:36.420724 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96547bec-b720-4967-b211-9359977a8932 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:36.421006 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96547bec-b720-4967-b211-9359977a8932 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:36.421282 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96547bec-b720-4967-b211-9359977a8932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:36.454641 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-96547bec-b720-4967-b211-9359977a8932 None None] MFA Rules not processed for user `15284cc3067f41a99b30975ca9f19cc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:29:36.456052 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-96547bec-b720-4967-b211-9359977a8932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:36.461013 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da224da-36cd-43b5-b260-7f04c520e028 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:36.462889 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-1da224da-36cd-43b5-b260-7f04c520e028 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:36.562752 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1267/2534] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:29:36 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:29:36.564002 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da224da-36cd-43b5-b260-7f04c520e028 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:36.572794 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96547bec-b720-4967-b211-9359977a8932 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:36.574473 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-96547bec-b720-4967-b211-9359977a8932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:36.577128 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296141f5-f06d-4009-930f-14de2cfccc11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:36.578209 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296141f5-f06d-4009-930f-14de2cfccc11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:36.578559 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296141f5-f06d-4009-930f-14de2cfccc11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:36.578705 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296141f5-f06d-4009-930f-14de2cfccc11 admin admin] PATH_INFO: `/v3/projects/be44ff1d779847bba6ec756abb8eaa37` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:36.580074 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296141f5-f06d-4009-930f-14de2cfccc11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be44ff1d779847bba6ec756abb8eaa37)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:36.590463 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296141f5-f06d-4009-930f-14de2cfccc11 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:36.647453 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96547bec-b720-4967-b211-9359977a8932 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:36.652200 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-296141f5-f06d-4009-930f-14de2cfccc11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be44ff1d779847bba6ec756abb8eaa37', 'request_id': 'req-296141f5-f06d-4009-930f-14de2cfccc11'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:36.658129 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-296141f5-f06d-4009-930f-14de2cfccc11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be44ff1d779847bba6ec756abb8eaa37', 'request_id': 'req-296141f5-f06d-4009-930f-14de2cfccc11'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:36.665193 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-296141f5-f06d-4009-930f-14de2cfccc11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be44ff1d779847bba6ec756abb8eaa37', 'request_id': 'req-296141f5-f06d-4009-930f-14de2cfccc11'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:36.683981 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-296141f5-f06d-4009-930f-14de2cfccc11 admin admin] The token cache is being invalidate because project be44ff1d779847bba6ec756abb8eaa37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80105) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:29:36.684408 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-296141f5-f06d-4009-930f-14de2cfccc11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:36.685274 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-296141f5-f06d-4009-930f-14de2cfccc11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:36.689893 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1268/2535] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:29:36 2022] DELETE /identity/v3/projects/be44ff1d779847bba6ec756abb8eaa37 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 10:29:36.692256 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296141f5-f06d-4009-930f-14de2cfccc11 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:36.693841 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-296141f5-f06d-4009-930f-14de2cfccc11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:36.716520 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ed4e25-2b57-4b1c-bc4a-d06fecbfe087 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6c687a38524de0bf23d87ae91d3b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:36.717273 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed4e25-2b57-4b1c-bc4a-d06fecbfe087 service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:36.717646 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed4e25-2b57-4b1c-bc4a-d06fecbfe087 service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:36.718064 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed4e25-2b57-4b1c-bc4a-d06fecbfe087 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:36.720061 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-e8ed4e25-2b57-4b1c-bc4a-d06fecbfe087 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:36.745043 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:29:36.766596 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:29:36.770993 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296141f5-f06d-4009-930f-14de2cfccc11 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:36.777982 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2670af36-4cf6-4c2b-8330-bc2913096d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:36.778797 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2670af36-4cf6-4c2b-8330-bc2913096d8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:36.779500 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2670af36-4cf6-4c2b-8330-bc2913096d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:36.780349 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2670af36-4cf6-4c2b-8330-bc2913096d8b admin admin] PATH_INFO: `/v3/users/00b2feafbfcc4f9cacd214ed6a7eb9b0` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:36.781639 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2670af36-4cf6-4c2b-8330-bc2913096d8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=00b2feafbfcc4f9cacd214ed6a7eb9b0)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:36.783639 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2670af36-4cf6-4c2b-8330-bc2913096d8b admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:36.806617 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ed4e25-2b57-4b1c-bc4a-d06fecbfe087 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:36.808153 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ed4e25-2b57-4b1c-bc4a-d06fecbfe087 service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:36.818887 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1268/2536] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:29:36 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 10:29:36.837512 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-2670af36-4cf6-4c2b-8330-bc2913096d8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00b2feafbfcc4f9cacd214ed6a7eb9b0'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:36.850875 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-2670af36-4cf6-4c2b-8330-bc2913096d8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00b2feafbfcc4f9cacd214ed6a7eb9b0'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:36.858366 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-2670af36-4cf6-4c2b-8330-bc2913096d8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00b2feafbfcc4f9cacd214ed6a7eb9b0'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:36.859100 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-2670af36-4cf6-4c2b-8330-bc2913096d8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00b2feafbfcc4f9cacd214ed6a7eb9b0'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:36.868840 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-2670af36-4cf6-4c2b-8330-bc2913096d8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00b2feafbfcc4f9cacd214ed6a7eb9b0'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:36.875922 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1269/2537] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:29:36 2022] DELETE /identity/v3/users/00b2feafbfcc4f9cacd214ed6a7eb9b0 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:29:36.889782 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ed4e25-2b57-4b1c-bc4a-d06fecbfe087 service cinder] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:36.891322 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-e8ed4e25-2b57-4b1c-bc4a-d06fecbfe087 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:36.906120 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ed4e25-2b57-4b1c-bc4a-d06fecbfe087 service cinder] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:36.981324 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d31220-92fd-4e4c-9f85-6eccdf663d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:36.981992 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d31220-92fd-4e4c-9f85-6eccdf663d00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:36.982271 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d31220-92fd-4e4c-9f85-6eccdf663d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:36.982546 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d31220-92fd-4e4c-9f85-6eccdf663d00 admin admin] PATH_INFO: `/v3/users/dbdd03a8f39143e39f7d53493d61f46f` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:36.983682 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d31220-92fd-4e4c-9f85-6eccdf663d00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbdd03a8f39143e39f7d53493d61f46f)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:36.985661 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d31220-92fd-4e4c-9f85-6eccdf663d00 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:37.040887 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-43d31220-92fd-4e4c-9f85-6eccdf663d00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbdd03a8f39143e39f7d53493d61f46f'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:37.054248 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-43d31220-92fd-4e4c-9f85-6eccdf663d00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbdd03a8f39143e39f7d53493d61f46f'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:37.061361 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-43d31220-92fd-4e4c-9f85-6eccdf663d00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbdd03a8f39143e39f7d53493d61f46f'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:37.062574 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-43d31220-92fd-4e4c-9f85-6eccdf663d00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbdd03a8f39143e39f7d53493d61f46f'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:37.071231 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-43d31220-92fd-4e4c-9f85-6eccdf663d00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbdd03a8f39143e39f7d53493d61f46f'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:37.077562 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1269/2538] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:29:36 2022] DELETE /identity/v3/users/dbdd03a8f39143e39f7d53493d61f46f => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:29:37.082582 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ee71e-26c1-4f90-80fa-dc606efb75ab None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:37.082872 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ee71e-26c1-4f90-80fa-dc606efb75ab None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:37.083150 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ee71e-26c1-4f90-80fa-dc606efb75ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:37.102534 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-069ee71e-26c1-4f90-80fa-dc606efb75ab None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:29:37.103754 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-069ee71e-26c1-4f90-80fa-dc606efb75ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:37.166134 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1270/2539] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:29:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:29:37.174250 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d31220-92fd-4e4c-9f85-6eccdf663d00 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:37.176045 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-43d31220-92fd-4e4c-9f85-6eccdf663d00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:37.177664 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069ee71e-26c1-4f90-80fa-dc606efb75ab None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:37.179821 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-069ee71e-26c1-4f90-80fa-dc606efb75ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:37.196434 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d31220-92fd-4e4c-9f85-6eccdf663d00 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:37.208887 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f219aa26-82b3-4864-a7eb-603d20a70b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:37.209517 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f219aa26-82b3-4864-a7eb-603d20a70b32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:37.209795 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f219aa26-82b3-4864-a7eb-603d20a70b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:37.210091 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f219aa26-82b3-4864-a7eb-603d20a70b32 admin admin] PATH_INFO: `/v3/projects/3d861893246344328c93d6945a8f5977` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:37.211227 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f219aa26-82b3-4864-a7eb-603d20a70b32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d861893246344328c93d6945a8f5977)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:37.213134 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f219aa26-82b3-4864-a7eb-603d20a70b32 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:37.244931 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:29:37.247211 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069ee71e-26c1-4f90-80fa-dc606efb75ab None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:37.265489 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-f219aa26-82b3-4864-a7eb-603d20a70b32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d861893246344328c93d6945a8f5977', 'request_id': 'req-f219aa26-82b3-4864-a7eb-603d20a70b32'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:37.271667 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-f219aa26-82b3-4864-a7eb-603d20a70b32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d861893246344328c93d6945a8f5977', 'request_id': 'req-f219aa26-82b3-4864-a7eb-603d20a70b32'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:37.278120 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-f219aa26-82b3-4864-a7eb-603d20a70b32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d861893246344328c93d6945a8f5977', 'request_id': 'req-f219aa26-82b3-4864-a7eb-603d20a70b32'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:37.279955 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:29:37.291773 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-f219aa26-82b3-4864-a7eb-603d20a70b32 admin admin] The token cache is being invalidate because project 3d861893246344328c93d6945a8f5977 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:29:37.292321 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-f219aa26-82b3-4864-a7eb-603d20a70b32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:37.292759 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-f219aa26-82b3-4864-a7eb-603d20a70b32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:37.294311 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1270/2540] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:29:37 2022] DELETE /identity/v3/projects/3d861893246344328c93d6945a8f5977 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:29:37.298942 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac51f5-5c46-4aad-bf34-4a86e3f81434 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:37.299280 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac51f5-5c46-4aad-bf34-4a86e3f81434 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:37.299556 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac51f5-5c46-4aad-bf34-4a86e3f81434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:37.302337 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee429de-0ddc-453d-b008-6220823fda6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:37.302928 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee429de-0ddc-453d-b008-6220823fda6b service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:37.303206 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee429de-0ddc-453d-b008-6220823fda6b service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:37.303479 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee429de-0ddc-453d-b008-6220823fda6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:37.305186 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-aee429de-0ddc-453d-b008-6220823fda6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:37.319337 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-d0ac51f5-5c46-4aad-bf34-4a86e3f81434 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:29:37.320499 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-d0ac51f5-5c46-4aad-bf34-4a86e3f81434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:37.368962 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee429de-0ddc-453d-b008-6220823fda6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:37.370344 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee429de-0ddc-453d-b008-6220823fda6b service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:37.380692 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1271/2541] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:29:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 10:29:37.380873 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1271/2542] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:29:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 10:29:37.388440 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d458ee8-338c-4bc3-afbd-98a55af29641 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:37.388790 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d458ee8-338c-4bc3-afbd-98a55af29641 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:37.389076 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d458ee8-338c-4bc3-afbd-98a55af29641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:37.409174 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-3d458ee8-338c-4bc3-afbd-98a55af29641 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:29:37.410920 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-3d458ee8-338c-4bc3-afbd-98a55af29641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:37.418483 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1272/2543] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:29:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 10:29:37.422597 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ac51f5-5c46-4aad-bf34-4a86e3f81434 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:37.432773 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ac51f5-5c46-4aad-bf34-4a86e3f81434 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:37.438000 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeff436-0446-406e-bae1-eb104fdf6c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:37.438752 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeff436-0446-406e-bae1-eb104fdf6c84 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:37.439086 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeff436-0446-406e-bae1-eb104fdf6c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:37.439432 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeff436-0446-406e-bae1-eb104fdf6c84 admin admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:37.440178 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeff436-0446-406e-bae1-eb104fdf6c84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:29:37.440572 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeff436-0446-406e-bae1-eb104fdf6c84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:37.443060 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeff436-0446-406e-bae1-eb104fdf6c84 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:37.457939 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1272/2544] 10.222.0.36 () {58 vars in 1153 bytes} [Tue Aug 9 10:29:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:29:37.461656 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d458ee8-338c-4bc3-afbd-98a55af29641 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:37.471513 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d458ee8-338c-4bc3-afbd-98a55af29641 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:37.476329 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f288fadc-30c7-4a49-a1d5-2a5be410a6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:37.476925 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f288fadc-30c7-4a49-a1d5-2a5be410a6c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:37.477200 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f288fadc-30c7-4a49-a1d5-2a5be410a6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:37.477467 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f288fadc-30c7-4a49-a1d5-2a5be410a6c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:37.478127 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f288fadc-30c7-4a49-a1d5-2a5be410a6c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:37.480006 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f288fadc-30c7-4a49-a1d5-2a5be410a6c2 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:37.512287 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1273/2545] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:29:37 2022] POST /identity/v3/projects => generated 381 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:29:37.516496 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeff436-0446-406e-bae1-eb104fdf6c84 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:37.527750 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeff436-0446-406e-bae1-eb104fdf6c84 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:37.590265 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f6c1db-9c0f-4727-956c-625193d8f136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:37.590878 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f6c1db-9c0f-4727-956c-625193d8f136 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:37.591153 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f6c1db-9c0f-4727-956c-625193d8f136 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:37.591425 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f6c1db-9c0f-4727-956c-625193d8f136 admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:37.592041 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f6c1db-9c0f-4727-956c-625193d8f136 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:37.594018 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f6c1db-9c0f-4727-956c-625193d8f136 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:37.638575 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1273/2546] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:29:37 2022] POST /identity/v3/users => generated 291 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 10:29:37.639829 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f288fadc-30c7-4a49-a1d5-2a5be410a6c2 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:37.651759 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f288fadc-30c7-4a49-a1d5-2a5be410a6c2 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:37.656797 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20d259a-4df4-49a6-a8f6-bb390b8cbf41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:37.657412 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20d259a-4df4-49a6-a8f6-bb390b8cbf41 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:37.657720 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20d259a-4df4-49a6-a8f6-bb390b8cbf41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:37.658006 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20d259a-4df4-49a6-a8f6-bb390b8cbf41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:37.658650 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20d259a-4df4-49a6-a8f6-bb390b8cbf41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:37.660984 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20d259a-4df4-49a6-a8f6-bb390b8cbf41 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:37.671701 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1274/2547] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:29:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:29:37.675271 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20d259a-4df4-49a6-a8f6-bb390b8cbf41 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:37.675810 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f6c1db-9c0f-4727-956c-625193d8f136 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:37.677359 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-05f6c1db-9c0f-4727-956c-625193d8f136 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:37.685530 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20d259a-4df4-49a6-a8f6-bb390b8cbf41 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:37.692256 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d93e01-3ee2-499a-a510-3be348133e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:37.692902 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d93e01-3ee2-499a-a510-3be348133e12 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:37.693184 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d93e01-3ee2-499a-a510-3be348133e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:37.693456 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d93e01-3ee2-499a-a510-3be348133e12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:37.694137 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d93e01-3ee2-499a-a510-3be348133e12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:37.696591 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d93e01-3ee2-499a-a510-3be348133e12 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:37.697694 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f6c1db-9c0f-4727-956c-625193d8f136 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:37.702725 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdc4379-5c22-4c48-8c08-657093a23d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:37.703361 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdc4379-5c22-4c48-8c08-657093a23d1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:37.703642 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdc4379-5c22-4c48-8c08-657093a23d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:37.703916 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdc4379-5c22-4c48-8c08-657093a23d1f admin admin] PATH_INFO: `/v3/projects/2845b3897dce44208ac45f65077d2cc3` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:37.705075 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdc4379-5c22-4c48-8c08-657093a23d1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2845b3897dce44208ac45f65077d2cc3)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:37.707765 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1275/2548] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:29:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 10:29:37.707916 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdc4379-5c22-4c48-8c08-657093a23d1f admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:37.711876 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d93e01-3ee2-499a-a510-3be348133e12 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:37.723117 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d93e01-3ee2-499a-a510-3be348133e12 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:37.728016 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95f1722-6be6-4579-8756-bc42fe557a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:37.728679 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f1722-6be6-4579-8756-bc42fe557a16 admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:37.728936 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f1722-6be6-4579-8756-bc42fe557a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:37.729215 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f1722-6be6-4579-8756-bc42fe557a16 admin admin] PATH_INFO: `/v3/projects/2f21937aa20448429f9d21fe392d4b5c/users/83e03c9d08504e078eecb652a128d4e0/roles/a9895331e9694fa8b2b50908bb057bcb` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:37.744379 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:29:37.745393 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95f1722-6be6-4579-8756-bc42fe557a16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f21937aa20448429f9d21fe392d4b5c, user_id=83e03c9d08504e078eecb652a128d4e0, role_id=a9895331e9694fa8b2b50908bb057bcb)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:37.748129 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95f1722-6be6-4579-8756-bc42fe557a16 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:37.761765 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1276/2549] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:29:37 2022] PUT /identity/v3/projects/2f21937aa20448429f9d21fe392d4b5c/users/83e03c9d08504e078eecb652a128d4e0/roles/a9895331e9694fa8b2b50908bb057bcb => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:29:37.763451 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-5fdc4379-5c22-4c48-8c08-657093a23d1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2845b3897dce44208ac45f65077d2cc3', 'request_id': 'req-5fdc4379-5c22-4c48-8c08-657093a23d1f'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:37.769434 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-5fdc4379-5c22-4c48-8c08-657093a23d1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2845b3897dce44208ac45f65077d2cc3', 'request_id': 'req-5fdc4379-5c22-4c48-8c08-657093a23d1f'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:37.773294 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b960c-ca87-4487-81e2-4dd1a4d2da14 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:37.773578 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b960c-ca87-4487-81e2-4dd1a4d2da14 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:37.773931 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b960c-ca87-4487-81e2-4dd1a4d2da14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:37.777357 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-5fdc4379-5c22-4c48-8c08-657093a23d1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2845b3897dce44208ac45f65077d2cc3', 'request_id': 'req-5fdc4379-5c22-4c48-8c08-657093a23d1f'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:37.791696 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-5fdc4379-5c22-4c48-8c08-657093a23d1f admin admin] The token cache is being invalidate because project 2845b3897dce44208ac45f65077d2cc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:29:37.791984 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-5fdc4379-5c22-4c48-8c08-657093a23d1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:37.792657 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-5fdc4379-5c22-4c48-8c08-657093a23d1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:37.794443 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1274/2550] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:29:37 2022] DELETE /identity/v3/projects/2845b3897dce44208ac45f65077d2cc3 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:29:37.798305 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdc4379-5c22-4c48-8c08-657093a23d1f admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:37.799744 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-5fdc4379-5c22-4c48-8c08-657093a23d1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:37.810475 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-605b960c-ca87-4487-81e2-4dd1a4d2da14 None None] MFA Rules not processed for user `83e03c9d08504e078eecb652a128d4e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:29:37.811744 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-605b960c-ca87-4487-81e2-4dd1a4d2da14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:37.879828 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:29:37.880949 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdc4379-5c22-4c48-8c08-657093a23d1f admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:37.889966 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1277/2551] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:29:37 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 10:29:37.891548 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605b960c-ca87-4487-81e2-4dd1a4d2da14 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:37.892914 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-605b960c-ca87-4487-81e2-4dd1a4d2da14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:37.946134 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88555da-20d3-4729-8fdc-179c4713efb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:37.946837 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88555da-20d3-4729-8fdc-179c4713efb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:37.947070 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88555da-20d3-4729-8fdc-179c4713efb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:37.947350 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88555da-20d3-4729-8fdc-179c4713efb2 admin admin] PATH_INFO: `/v3/users/15284cc3067f41a99b30975ca9f19cc8` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:37.948563 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88555da-20d3-4729-8fdc-179c4713efb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15284cc3067f41a99b30975ca9f19cc8)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:37.950550 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88555da-20d3-4729-8fdc-179c4713efb2 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:37.983122 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605b960c-ca87-4487-81e2-4dd1a4d2da14 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:37.988429 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e795b4-76b8-42c2-9e63-88a1e9561155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:37.989120 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e795b4-76b8-42c2-9e63-88a1e9561155 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:37.989405 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e795b4-76b8-42c2-9e63-88a1e9561155 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:37.989680 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e795b4-76b8-42c2-9e63-88a1e9561155 admin admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:37.990363 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e795b4-76b8-42c2-9e63-88a1e9561155 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:37.992270 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e795b4-76b8-42c2-9e63-88a1e9561155 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:38.011270 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-f88555da-20d3-4729-8fdc-179c4713efb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15284cc3067f41a99b30975ca9f19cc8'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:38.026983 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1278/2552] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:29:37 2022] POST /identity/v3/projects => generated 379 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 10:29:38.027850 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e795b4-76b8-42c2-9e63-88a1e9561155 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:38.029688 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-f88555da-20d3-4729-8fdc-179c4713efb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15284cc3067f41a99b30975ca9f19cc8'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:38.031088 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:29:38.042202 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-f88555da-20d3-4729-8fdc-179c4713efb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15284cc3067f41a99b30975ca9f19cc8'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:38.043801 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-f88555da-20d3-4729-8fdc-179c4713efb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15284cc3067f41a99b30975ca9f19cc8'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:38.053342 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-f88555da-20d3-4729-8fdc-179c4713efb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15284cc3067f41a99b30975ca9f19cc8'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:38.060214 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1275/2553] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:29:37 2022] DELETE /identity/v3/users/15284cc3067f41a99b30975ca9f19cc8 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 10:29:38.100729 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e795b4-76b8-42c2-9e63-88a1e9561155 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:38.170589 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30193129-2548-4d81-9f5b-9e02d4569fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:38.171269 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30193129-2548-4d81-9f5b-9e02d4569fcb admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:38.171551 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30193129-2548-4d81-9f5b-9e02d4569fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:38.171820 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30193129-2548-4d81-9f5b-9e02d4569fcb admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:38.172560 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30193129-2548-4d81-9f5b-9e02d4569fcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:38.174614 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30193129-2548-4d81-9f5b-9e02d4569fcb admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:38.204627 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1279/2554] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:29:38 2022] POST /identity/v3/users => generated 296 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:29:38.207221 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88555da-20d3-4729-8fdc-179c4713efb2 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:38.209098 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-f88555da-20d3-4729-8fdc-179c4713efb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:38.224358 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88555da-20d3-4729-8fdc-179c4713efb2 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:38.231518 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38a4d54-8f93-432f-b61d-ef0e552182ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:38.232368 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38a4d54-8f93-432f-b61d-ef0e552182ad admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:38.232707 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38a4d54-8f93-432f-b61d-ef0e552182ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:38.232987 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38a4d54-8f93-432f-b61d-ef0e552182ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:38.233777 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38a4d54-8f93-432f-b61d-ef0e552182ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:38.235495 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38a4d54-8f93-432f-b61d-ef0e552182ad admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:38.247448 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1276/2555] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:29:38 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 10:29:38.253979 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30193129-2548-4d81-9f5b-9e02d4569fcb admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:38.264664 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30193129-2548-4d81-9f5b-9e02d4569fcb admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:38.269932 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb403ea4-e85e-4c02-8b3c-8fdc79d8299d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:38.270345 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb403ea4-e85e-4c02-8b3c-8fdc79d8299d admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:38.270622 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb403ea4-e85e-4c02-8b3c-8fdc79d8299d admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:38.270891 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb403ea4-e85e-4c02-8b3c-8fdc79d8299d admin admin] PATH_INFO: `/v3/projects/948b72902d0f47519784cef77bd350a7/users/0e1b18554bb640a5b9cf687803f9ecc6/roles/89ca30cbbb634be8a96e9921aa56626b` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:38.288741 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb403ea4-e85e-4c02-8b3c-8fdc79d8299d admin admin] RBAC: Authorizing `identity:create_grant(project_id=948b72902d0f47519784cef77bd350a7, user_id=0e1b18554bb640a5b9cf687803f9ecc6, role_id=89ca30cbbb634be8a96e9921aa56626b)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:38.291606 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb403ea4-e85e-4c02-8b3c-8fdc79d8299d admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:38.296035 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:29:38.311105 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1280/2556] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:29:38 2022] PUT /identity/v3/projects/948b72902d0f47519784cef77bd350a7/users/0e1b18554bb640a5b9cf687803f9ecc6/roles/89ca30cbbb634be8a96e9921aa56626b => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:29:38.315479 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38a4d54-8f93-432f-b61d-ef0e552182ad admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:38.326933 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38a4d54-8f93-432f-b61d-ef0e552182ad admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:38.364581 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb403ea4-e85e-4c02-8b3c-8fdc79d8299d admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:38.366584 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-fb403ea4-e85e-4c02-8b3c-8fdc79d8299d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:38.412100 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5106e987-a271-43b7-a439-14551102d1b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:38.412992 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5106e987-a271-43b7-a439-14551102d1b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:38.413885 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5106e987-a271-43b7-a439-14551102d1b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:38.414341 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5106e987-a271-43b7-a439-14551102d1b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:38.414996 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5106e987-a271-43b7-a439-14551102d1b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:38.416601 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5106e987-a271-43b7-a439-14551102d1b6 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:38.427952 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1277/2557] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:29:38 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:29:38.432041 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5106e987-a271-43b7-a439-14551102d1b6 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:38.443952 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5106e987-a271-43b7-a439-14551102d1b6 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:38.449511 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde2d852-28d4-4d8f-ad5c-71003e611226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:38.450217 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde2d852-28d4-4d8f-ad5c-71003e611226 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:38.450494 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde2d852-28d4-4d8f-ad5c-71003e611226 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:38.450771 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde2d852-28d4-4d8f-ad5c-71003e611226 admin admin] PATH_INFO: `/v3/projects/948b72902d0f47519784cef77bd350a7/users/0e1b18554bb640a5b9cf687803f9ecc6/roles/89ca30cbbb634be8a96e9921aa56626b` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:38.452716 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde2d852-28d4-4d8f-ad5c-71003e611226 admin admin] RBAC: Authorizing `identity:create_grant(project_id=948b72902d0f47519784cef77bd350a7, user_id=0e1b18554bb640a5b9cf687803f9ecc6, role_id=89ca30cbbb634be8a96e9921aa56626b)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:38.455640 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde2d852-28d4-4d8f-ad5c-71003e611226 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:38.467134 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb403ea4-e85e-4c02-8b3c-8fdc79d8299d admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:38.469900 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1278/2558] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:29:38 2022] PUT /identity/v3/projects/948b72902d0f47519784cef77bd350a7/users/0e1b18554bb640a5b9cf687803f9ecc6/roles/89ca30cbbb634be8a96e9921aa56626b => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 10:29:38.482525 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30119a41-9734-485a-99ad-6672c78a77ef None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:38.482879 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30119a41-9734-485a-99ad-6672c78a77ef None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:38.483224 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30119a41-9734-485a-99ad-6672c78a77ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:38.522855 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-30119a41-9734-485a-99ad-6672c78a77ef None None] MFA Rules not processed for user `0e1b18554bb640a5b9cf687803f9ecc6`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:29:38.524506 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-30119a41-9734-485a-99ad-6672c78a77ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:38.541150 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09bfd39-2e2d-4acf-971d-07938590e423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:38.541901 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09bfd39-2e2d-4acf-971d-07938590e423 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:38.542246 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09bfd39-2e2d-4acf-971d-07938590e423 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:38.542595 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09bfd39-2e2d-4acf-971d-07938590e423 admin admin] PATH_INFO: `/v3/projects/6ef11d9e4e5e433ebd981a6c8015ce07` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:38.543842 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09bfd39-2e2d-4acf-971d-07938590e423 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ef11d9e4e5e433ebd981a6c8015ce07)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:38.545859 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09bfd39-2e2d-4acf-971d-07938590e423 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:38.615080 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-e09bfd39-2e2d-4acf-971d-07938590e423 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ef11d9e4e5e433ebd981a6c8015ce07', 'request_id': 'req-e09bfd39-2e2d-4acf-971d-07938590e423'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:38.621888 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-e09bfd39-2e2d-4acf-971d-07938590e423 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ef11d9e4e5e433ebd981a6c8015ce07', 'request_id': 'req-e09bfd39-2e2d-4acf-971d-07938590e423'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:38.629909 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-e09bfd39-2e2d-4acf-971d-07938590e423 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ef11d9e4e5e433ebd981a6c8015ce07', 'request_id': 'req-e09bfd39-2e2d-4acf-971d-07938590e423'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:38.649521 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-e09bfd39-2e2d-4acf-971d-07938590e423 admin admin] The token cache is being invalidate because project 6ef11d9e4e5e433ebd981a6c8015ce07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80105) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:29:38.649940 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-e09bfd39-2e2d-4acf-971d-07938590e423 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:38.650621 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-e09bfd39-2e2d-4acf-971d-07938590e423 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:38.652604 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1281/2559] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:29:38 2022] DELETE /identity/v3/projects/6ef11d9e4e5e433ebd981a6c8015ce07 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 10:29:38.659160 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5fa2b1-6e3f-4c7b-92a1-adcd53611706 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:38.660192 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5fa2b1-6e3f-4c7b-92a1-adcd53611706 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:38.662017 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5fa2b1-6e3f-4c7b-92a1-adcd53611706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:38.677551 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1279/2560] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:29:38 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:29:38.689455 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-cc5fa2b1-6e3f-4c7b-92a1-adcd53611706 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:29:38.691549 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30119a41-9734-485a-99ad-6672c78a77ef None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:38.691715 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-cc5fa2b1-6e3f-4c7b-92a1-adcd53611706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:38.693067 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-30119a41-9734-485a-99ad-6672c78a77ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:38.731132 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:29:38.742185 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:29:38.761945 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30119a41-9734-485a-99ad-6672c78a77ef None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:38.767298 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1282/2561] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:29:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:29:38.776452 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a9ef6-6e51-4031-bad1-f9f5cc24b3af None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:38.776786 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a9ef6-6e51-4031-bad1-f9f5cc24b3af None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:38.777065 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20a9ef6-6e51-4031-bad1-f9f5cc24b3af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:38.797247 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-f20a9ef6-6e51-4031-bad1-f9f5cc24b3af None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:29:38.798410 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-f20a9ef6-6e51-4031-bad1-f9f5cc24b3af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:38.806909 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1283/2562] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:29:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:29:38.811108 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20a9ef6-6e51-4031-bad1-f9f5cc24b3af None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:38.818338 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c808696b-8b40-420f-81c6-235316ed676b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6c687a38524de0bf23d87ae91d3b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:38.818941 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c808696b-8b40-420f-81c6-235316ed676b service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:38.819253 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c808696b-8b40-420f-81c6-235316ed676b service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:38.819522 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c808696b-8b40-420f-81c6-235316ed676b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:38.821375 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20a9ef6-6e51-4031-bad1-f9f5cc24b3af None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:38.826054 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7975f1f9-e7b2-4e52-9bcc-740cfbfb41b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:38.826637 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7975f1f9-e7b2-4e52-9bcc-740cfbfb41b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:38.826913 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7975f1f9-e7b2-4e52-9bcc-740cfbfb41b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:38.827183 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7975f1f9-e7b2-4e52-9bcc-740cfbfb41b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:38.827819 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7975f1f9-e7b2-4e52-9bcc-740cfbfb41b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:29:38.828118 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7975f1f9-e7b2-4e52-9bcc-740cfbfb41b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:38.829687 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7975f1f9-e7b2-4e52-9bcc-740cfbfb41b7 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:38.846025 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1284/2563] 10.222.0.36 () {58 vars in 1153 bytes} [Tue Aug 9 10:29:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:29:38.847761 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7975f1f9-e7b2-4e52-9bcc-740cfbfb41b7 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:38.861544 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7975f1f9-e7b2-4e52-9bcc-740cfbfb41b7 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:38.870241 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b521be9f-1e27-46a5-abce-47e5f7bb6ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:38.870854 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b521be9f-1e27-46a5-abce-47e5f7bb6ead admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:38.871134 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b521be9f-1e27-46a5-abce-47e5f7bb6ead admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:38.871406 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b521be9f-1e27-46a5-abce-47e5f7bb6ead admin admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:38.872033 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b521be9f-1e27-46a5-abce-47e5f7bb6ead admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:38.873979 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b521be9f-1e27-46a5-abce-47e5f7bb6ead admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:38.898432 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c808696b-8b40-420f-81c6-235316ed676b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:38.900209 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c808696b-8b40-420f-81c6-235316ed676b service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:38.911560 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1285/2564] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:29:38 2022] POST /identity/v3/projects => generated 385 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:29:38.911861 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1280/2565] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:29:38 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:29:38.914933 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b521be9f-1e27-46a5-abce-47e5f7bb6ead admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:38.993073 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b521be9f-1e27-46a5-abce-47e5f7bb6ead admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:38.997797 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921224bd-1488-4aad-97ab-525abca21fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:38.998426 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921224bd-1488-4aad-97ab-525abca21fa0 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:38.998707 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921224bd-1488-4aad-97ab-525abca21fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:38.998982 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921224bd-1488-4aad-97ab-525abca21fa0 admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:38.999612 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921224bd-1488-4aad-97ab-525abca21fa0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:39.001504 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921224bd-1488-4aad-97ab-525abca21fa0 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:39.023253 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1286/2566] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:29:38 2022] POST /identity/v3/users => generated 293 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:29:39.027451 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c808696b-8b40-420f-81c6-235316ed676b service cinder] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:39.039057 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c808696b-8b40-420f-81c6-235316ed676b service cinder] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:39.044801 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406ba2d7-7ac1-4878-8fa0-36715e13ae3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:39.045408 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ba2d7-7ac1-4878-8fa0-36715e13ae3e admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:39.045691 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ba2d7-7ac1-4878-8fa0-36715e13ae3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:39.046015 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ba2d7-7ac1-4878-8fa0-36715e13ae3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:39.046917 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406ba2d7-7ac1-4878-8fa0-36715e13ae3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:39.048540 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406ba2d7-7ac1-4878-8fa0-36715e13ae3e admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:39.062163 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1281/2567] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:29:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:29:39.064319 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921224bd-1488-4aad-97ab-525abca21fa0 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:39.087705 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921224bd-1488-4aad-97ab-525abca21fa0 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:39.096551 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84b9140-6907-477c-96ea-ba913efc09ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:39.098083 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b9140-6907-477c-96ea-ba913efc09ce admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:39.098588 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b9140-6907-477c-96ea-ba913efc09ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:39.099039 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b9140-6907-477c-96ea-ba913efc09ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:39.100431 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84b9140-6907-477c-96ea-ba913efc09ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:39.104753 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84b9140-6907-477c-96ea-ba913efc09ce admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:39.129154 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1287/2568] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:29:39 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:29:39.130383 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406ba2d7-7ac1-4878-8fa0-36715e13ae3e admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:39.142286 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406ba2d7-7ac1-4878-8fa0-36715e13ae3e admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:39.156510 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d4e988-576f-4b79-ad24-5ee5888ca92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:39.157171 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d4e988-576f-4b79-ad24-5ee5888ca92b admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:39.157420 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d4e988-576f-4b79-ad24-5ee5888ca92b admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:39.157740 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d4e988-576f-4b79-ad24-5ee5888ca92b admin admin] PATH_INFO: `/v3/projects/6af84a9c898747dfb89010635497be7e/users/2ec29d2f2ce54ef28d594fb262b6195e/roles/a9895331e9694fa8b2b50908bb057bcb` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:39.178761 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d4e988-576f-4b79-ad24-5ee5888ca92b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6af84a9c898747dfb89010635497be7e, user_id=2ec29d2f2ce54ef28d594fb262b6195e, role_id=a9895331e9694fa8b2b50908bb057bcb)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:39.181992 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d4e988-576f-4b79-ad24-5ee5888ca92b admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:39.201284 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1282/2569] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:29:39 2022] PUT /identity/v3/projects/6af84a9c898747dfb89010635497be7e/users/2ec29d2f2ce54ef28d594fb262b6195e/roles/a9895331e9694fa8b2b50908bb057bcb => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:29:39.212722 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b218a2a8-329e-4929-b3af-320c0ec15054 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:39.213015 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b218a2a8-329e-4929-b3af-320c0ec15054 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:39.213347 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b218a2a8-329e-4929-b3af-320c0ec15054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:39.243150 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-b218a2a8-329e-4929-b3af-320c0ec15054 None None] MFA Rules not processed for user `2ec29d2f2ce54ef28d594fb262b6195e`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:29:39.244356 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-b218a2a8-329e-4929-b3af-320c0ec15054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:39.283477 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d4e988-576f-4b79-ad24-5ee5888ca92b admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:39.311592 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:29:39.316429 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1288/2570] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:29:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 10:29:39.327349 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b218a2a8-329e-4929-b3af-320c0ec15054 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:39.328704 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-b218a2a8-329e-4929-b3af-320c0ec15054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:39.349111 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d4e988-576f-4b79-ad24-5ee5888ca92b admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:39.354408 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6972b50-cffd-4353-a94c-784ab727cc9f tempest-VolumeQuotaClassesTest-516461578 tempest-VolumeQuotaClassesTest-516461578-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e1b18554bb640a5b9cf687803f9ecc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '948b72902d0f47519784cef77bd350a7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:39.355004 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6972b50-cffd-4353-a94c-784ab727cc9f tempest-VolumeQuotaClassesTest-516461578 tempest-VolumeQuotaClassesTest-516461578-project-admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:39.355288 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6972b50-cffd-4353-a94c-784ab727cc9f tempest-VolumeQuotaClassesTest-516461578 tempest-VolumeQuotaClassesTest-516461578-project-admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:39.355560 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6972b50-cffd-4353-a94c-784ab727cc9f tempest-VolumeQuotaClassesTest-516461578 tempest-VolumeQuotaClassesTest-516461578-project-admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:39.356204 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6972b50-cffd-4353-a94c-784ab727cc9f tempest-VolumeQuotaClassesTest-516461578 tempest-VolumeQuotaClassesTest-516461578-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:29:39.356553 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6972b50-cffd-4353-a94c-784ab727cc9f tempest-VolumeQuotaClassesTest-516461578 tempest-VolumeQuotaClassesTest-516461578-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:39.358151 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6972b50-cffd-4353-a94c-784ab727cc9f tempest-VolumeQuotaClassesTest-516461578 tempest-VolumeQuotaClassesTest-516461578-project-admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:39.369572 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1283/2571] 10.222.0.36 () {58 vars in 1153 bytes} [Tue Aug 9 10:29:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:29:39.373797 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6972b50-cffd-4353-a94c-784ab727cc9f tempest-VolumeQuotaClassesTest-516461578 tempest-VolumeQuotaClassesTest-516461578-project-admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:39.380144 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:29:39.384402 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6972b50-cffd-4353-a94c-784ab727cc9f tempest-VolumeQuotaClassesTest-516461578 tempest-VolumeQuotaClassesTest-516461578-project-admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:39.387825 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b218a2a8-329e-4929-b3af-320c0ec15054 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:39.390323 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86866c27-9fa6-4133-a686-8a8879869747 tempest-VolumeQuotaClassesTest-516461578 tempest-VolumeQuotaClassesTest-516461578-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e1b18554bb640a5b9cf687803f9ecc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '948b72902d0f47519784cef77bd350a7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:39.390900 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86866c27-9fa6-4133-a686-8a8879869747 tempest-VolumeQuotaClassesTest-516461578 tempest-VolumeQuotaClassesTest-516461578-project-admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:39.391179 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86866c27-9fa6-4133-a686-8a8879869747 tempest-VolumeQuotaClassesTest-516461578 tempest-VolumeQuotaClassesTest-516461578-project-admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:39.391451 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86866c27-9fa6-4133-a686-8a8879869747 tempest-VolumeQuotaClassesTest-516461578 tempest-VolumeQuotaClassesTest-516461578-project-admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:39.391568 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00b9dbc-7691-4b3e-8a7f-1d0a022a8de0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6c687a38524de0bf23d87ae91d3b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:39.392047 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00b9dbc-7691-4b3e-8a7f-1d0a022a8de0 service cinder] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:39.392144 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86866c27-9fa6-4133-a686-8a8879869747 tempest-VolumeQuotaClassesTest-516461578 tempest-VolumeQuotaClassesTest-516461578-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:39.392408 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00b9dbc-7691-4b3e-8a7f-1d0a022a8de0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:39.392688 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00b9dbc-7691-4b3e-8a7f-1d0a022a8de0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:39.394516 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86866c27-9fa6-4133-a686-8a8879869747 tempest-VolumeQuotaClassesTest-516461578 tempest-VolumeQuotaClassesTest-516461578-project-admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:39.402721 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00b9dbc-7691-4b3e-8a7f-1d0a022a8de0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:39.404208 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00b9dbc-7691-4b3e-8a7f-1d0a022a8de0 service cinder] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:39.413581 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1289/2572] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:29:39 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 10:29:39.423879 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1284/2573] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:29:39 2022] POST /identity/v3/projects => generated 354 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:29:39.432376 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00b9dbc-7691-4b3e-8a7f-1d0a022a8de0 service cinder] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:39.433461 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86866c27-9fa6-4133-a686-8a8879869747 tempest-VolumeQuotaClassesTest-516461578 tempest-VolumeQuotaClassesTest-516461578-project-admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:39.443258 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00b9dbc-7691-4b3e-8a7f-1d0a022a8de0 service cinder] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:39.504861 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86866c27-9fa6-4133-a686-8a8879869747 tempest-VolumeQuotaClassesTest-516461578 tempest-VolumeQuotaClassesTest-516461578-project-admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:39.510102 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4c0e5c-923c-4443-ade1-0c06eee030b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:39.511008 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c0e5c-923c-4443-ade1-0c06eee030b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:39.511512 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c0e5c-923c-4443-ade1-0c06eee030b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:39.511970 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c0e5c-923c-4443-ade1-0c06eee030b6 admin admin] PATH_INFO: `/v3/users/2ec29d2f2ce54ef28d594fb262b6195e` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:39.513345 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4c0e5c-923c-4443-ade1-0c06eee030b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ec29d2f2ce54ef28d594fb262b6195e)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:39.515676 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4c0e5c-923c-4443-ade1-0c06eee030b6 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:39.516147 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0e52fa-726c-4863-9177-2de6e35b71da tempest-VolumeQuotaClassesTest-516461578 tempest-VolumeQuotaClassesTest-516461578-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e1b18554bb640a5b9cf687803f9ecc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '948b72902d0f47519784cef77bd350a7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:39.516846 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0e52fa-726c-4863-9177-2de6e35b71da tempest-VolumeQuotaClassesTest-516461578 tempest-VolumeQuotaClassesTest-516461578-project-admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:39.517244 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0e52fa-726c-4863-9177-2de6e35b71da tempest-VolumeQuotaClassesTest-516461578 tempest-VolumeQuotaClassesTest-516461578-project-admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:39.517922 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0e52fa-726c-4863-9177-2de6e35b71da tempest-VolumeQuotaClassesTest-516461578 tempest-VolumeQuotaClassesTest-516461578-project-admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:39.518580 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0e52fa-726c-4863-9177-2de6e35b71da tempest-VolumeQuotaClassesTest-516461578 tempest-VolumeQuotaClassesTest-516461578-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:29:39.520258 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0e52fa-726c-4863-9177-2de6e35b71da tempest-VolumeQuotaClassesTest-516461578 tempest-VolumeQuotaClassesTest-516461578-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:39.522595 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0e52fa-726c-4863-9177-2de6e35b71da tempest-VolumeQuotaClassesTest-516461578 tempest-VolumeQuotaClassesTest-516461578-project-admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:39.539095 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1290/2574] 10.222.0.36 () {58 vars in 1153 bytes} [Tue Aug 9 10:29:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:29:39.576226 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0e52fa-726c-4863-9177-2de6e35b71da tempest-VolumeQuotaClassesTest-516461578 tempest-VolumeQuotaClassesTest-516461578-project-admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:39.581095 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-ea4c0e5c-923c-4443-ade1-0c06eee030b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ec29d2f2ce54ef28d594fb262b6195e'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:39.587230 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0e52fa-726c-4863-9177-2de6e35b71da tempest-VolumeQuotaClassesTest-516461578 tempest-VolumeQuotaClassesTest-516461578-project-admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:39.592523 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4759891-34e9-4443-876f-f47c013b519e tempest-VolumeQuotaClassesTest-516461578 tempest-VolumeQuotaClassesTest-516461578-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e1b18554bb640a5b9cf687803f9ecc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '948b72902d0f47519784cef77bd350a7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:39.593142 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4759891-34e9-4443-876f-f47c013b519e tempest-VolumeQuotaClassesTest-516461578 tempest-VolumeQuotaClassesTest-516461578-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:39.593423 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4759891-34e9-4443-876f-f47c013b519e tempest-VolumeQuotaClassesTest-516461578 tempest-VolumeQuotaClassesTest-516461578-project-admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:39.593692 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4759891-34e9-4443-876f-f47c013b519e tempest-VolumeQuotaClassesTest-516461578 tempest-VolumeQuotaClassesTest-516461578-project-admin] PATH_INFO: `/v3/projects/f85a91c1e5ff4a3b83b8c5de600f6fbe` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:39.594778 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-ea4c0e5c-923c-4443-ade1-0c06eee030b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ec29d2f2ce54ef28d594fb262b6195e'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:39.594897 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4759891-34e9-4443-876f-f47c013b519e tempest-VolumeQuotaClassesTest-516461578 tempest-VolumeQuotaClassesTest-516461578-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f85a91c1e5ff4a3b83b8c5de600f6fbe)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:39.596726 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4759891-34e9-4443-876f-f47c013b519e tempest-VolumeQuotaClassesTest-516461578 tempest-VolumeQuotaClassesTest-516461578-project-admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:39.602686 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-ea4c0e5c-923c-4443-ade1-0c06eee030b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ec29d2f2ce54ef28d594fb262b6195e'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:39.603442 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-ea4c0e5c-923c-4443-ade1-0c06eee030b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ec29d2f2ce54ef28d594fb262b6195e'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:39.612410 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-ea4c0e5c-923c-4443-ade1-0c06eee030b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ec29d2f2ce54ef28d594fb262b6195e'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:39.620864 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1285/2575] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:29:39 2022] DELETE /identity/v3/users/2ec29d2f2ce54ef28d594fb262b6195e => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 10:29:39.625175 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d01f106-a6df-4d21-a8e7-8236d835af95 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:39.625459 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d01f106-a6df-4d21-a8e7-8236d835af95 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:39.625730 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d01f106-a6df-4d21-a8e7-8236d835af95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:39.646600 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-8d01f106-a6df-4d21-a8e7-8236d835af95 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:29:39.647776 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-8d01f106-a6df-4d21-a8e7-8236d835af95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:39.653596 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-c4759891-34e9-4443-876f-f47c013b519e tempest-VolumeQuotaClassesTest-516461578 tempest-VolumeQuotaClassesTest-516461578-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f85a91c1e5ff4a3b83b8c5de600f6fbe', 'request_id': 'req-c4759891-34e9-4443-876f-f47c013b519e'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:39.659314 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-c4759891-34e9-4443-876f-f47c013b519e tempest-VolumeQuotaClassesTest-516461578 tempest-VolumeQuotaClassesTest-516461578-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f85a91c1e5ff4a3b83b8c5de600f6fbe', 'request_id': 'req-c4759891-34e9-4443-876f-f47c013b519e'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:39.666105 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-c4759891-34e9-4443-876f-f47c013b519e tempest-VolumeQuotaClassesTest-516461578 tempest-VolumeQuotaClassesTest-516461578-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f85a91c1e5ff4a3b83b8c5de600f6fbe', 'request_id': 'req-c4759891-34e9-4443-876f-f47c013b519e'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:39.679339 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-c4759891-34e9-4443-876f-f47c013b519e tempest-VolumeQuotaClassesTest-516461578 tempest-VolumeQuotaClassesTest-516461578-project-admin] The token cache is being invalidate because project f85a91c1e5ff4a3b83b8c5de600f6fbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80105) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:29:39.679629 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-c4759891-34e9-4443-876f-f47c013b519e tempest-VolumeQuotaClassesTest-516461578 tempest-VolumeQuotaClassesTest-516461578-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:39.680270 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-c4759891-34e9-4443-876f-f47c013b519e tempest-VolumeQuotaClassesTest-516461578 tempest-VolumeQuotaClassesTest-516461578-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:39.681817 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1291/2576] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:29:39 2022] DELETE /identity/v3/projects/f85a91c1e5ff4a3b83b8c5de600f6fbe => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 10:29:39.710007 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1286/2577] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:29:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 10:29:39.720811 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4759891-34e9-4443-876f-f47c013b519e tempest-VolumeQuotaClassesTest-516461578 tempest-VolumeQuotaClassesTest-516461578-project-admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:39.722304 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-c4759891-34e9-4443-876f-f47c013b519e tempest-VolumeQuotaClassesTest-516461578 tempest-VolumeQuotaClassesTest-516461578-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:39.746091 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:29:39.789528 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4759891-34e9-4443-876f-f47c013b519e tempest-VolumeQuotaClassesTest-516461578 tempest-VolumeQuotaClassesTest-516461578-project-admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:39.793317 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b776e4c7-39b7-419d-9af8-f6e4d88ef298 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:39.794069 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b776e4c7-39b7-419d-9af8-f6e4d88ef298 service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:39.794468 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b776e4c7-39b7-419d-9af8-f6e4d88ef298 service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:39.794838 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b776e4c7-39b7-419d-9af8-f6e4d88ef298 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:39.805546 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b776e4c7-39b7-419d-9af8-f6e4d88ef298 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:39.807288 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b776e4c7-39b7-419d-9af8-f6e4d88ef298 service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:39.822284 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1292/2578] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:29:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:29:39.884180 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d01f106-a6df-4d21-a8e7-8236d835af95 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:39.885697 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-8d01f106-a6df-4d21-a8e7-8236d835af95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:39.893015 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:29:39.901172 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d01f106-a6df-4d21-a8e7-8236d835af95 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:39.910300 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db26784-7988-4b01-80ca-0420fb098a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:39.910942 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db26784-7988-4b01-80ca-0420fb098a2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:39.911985 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db26784-7988-4b01-80ca-0420fb098a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:39.912260 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db26784-7988-4b01-80ca-0420fb098a2b admin admin] PATH_INFO: `/v3/users/83e03c9d08504e078eecb652a128d4e0` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:39.913435 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db26784-7988-4b01-80ca-0420fb098a2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=83e03c9d08504e078eecb652a128d4e0)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:39.915373 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db26784-7988-4b01-80ca-0420fb098a2b admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:39.968081 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-2db26784-7988-4b01-80ca-0420fb098a2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83e03c9d08504e078eecb652a128d4e0'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:39.982817 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-2db26784-7988-4b01-80ca-0420fb098a2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83e03c9d08504e078eecb652a128d4e0'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:39.990063 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-2db26784-7988-4b01-80ca-0420fb098a2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83e03c9d08504e078eecb652a128d4e0'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:39.990893 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-2db26784-7988-4b01-80ca-0420fb098a2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83e03c9d08504e078eecb652a128d4e0'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:39.998819 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-2db26784-7988-4b01-80ca-0420fb098a2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83e03c9d08504e078eecb652a128d4e0'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:40.004803 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1287/2579] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:29:39 2022] DELETE /identity/v3/users/83e03c9d08504e078eecb652a128d4e0 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:29:40.009360 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cc42d1-86ba-4bb7-aa52-b28f72ea40fd None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:40.009756 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cc42d1-86ba-4bb7-aa52-b28f72ea40fd None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:40.010207 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cc42d1-86ba-4bb7-aa52-b28f72ea40fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:40.030517 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-38cc42d1-86ba-4bb7-aa52-b28f72ea40fd None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:29:40.031819 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-38cc42d1-86ba-4bb7-aa52-b28f72ea40fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:40.098751 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1293/2580] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:29:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:29:40.109101 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db26784-7988-4b01-80ca-0420fb098a2b admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:40.110062 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cc42d1-86ba-4bb7-aa52-b28f72ea40fd None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:40.110990 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-2db26784-7988-4b01-80ca-0420fb098a2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:40.111612 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-38cc42d1-86ba-4bb7-aa52-b28f72ea40fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:40.124031 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cc42d1-86ba-4bb7-aa52-b28f72ea40fd None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:40.129683 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbdbd94-9198-4f79-bfda-7fcc33abcf0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:40.130427 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbdbd94-9198-4f79-bfda-7fcc33abcf0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:40.130766 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbdbd94-9198-4f79-bfda-7fcc33abcf0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:40.131102 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbdbd94-9198-4f79-bfda-7fcc33abcf0c admin admin] PATH_INFO: `/v3/projects/6af84a9c898747dfb89010635497be7e` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:40.132314 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbdbd94-9198-4f79-bfda-7fcc33abcf0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6af84a9c898747dfb89010635497be7e)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:40.134318 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbdbd94-9198-4f79-bfda-7fcc33abcf0c admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:40.185265 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-4dbdbd94-9198-4f79-bfda-7fcc33abcf0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6af84a9c898747dfb89010635497be7e', 'request_id': 'req-4dbdbd94-9198-4f79-bfda-7fcc33abcf0c'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:40.188442 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db26784-7988-4b01-80ca-0420fb098a2b admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:40.191415 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-4dbdbd94-9198-4f79-bfda-7fcc33abcf0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6af84a9c898747dfb89010635497be7e', 'request_id': 'req-4dbdbd94-9198-4f79-bfda-7fcc33abcf0c'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:40.197536 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-4dbdbd94-9198-4f79-bfda-7fcc33abcf0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6af84a9c898747dfb89010635497be7e', 'request_id': 'req-4dbdbd94-9198-4f79-bfda-7fcc33abcf0c'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:40.209598 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-4dbdbd94-9198-4f79-bfda-7fcc33abcf0c admin admin] The token cache is being invalidate because project 6af84a9c898747dfb89010635497be7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80105) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:29:40.209924 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-4dbdbd94-9198-4f79-bfda-7fcc33abcf0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:40.210562 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-4dbdbd94-9198-4f79-bfda-7fcc33abcf0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:40.212048 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1294/2581] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:29:40 2022] DELETE /identity/v3/projects/6af84a9c898747dfb89010635497be7e => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:29:40.216866 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a662a4d0-4931-4024-8825-db9843ea86e4 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:40.217221 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a662a4d0-4931-4024-8825-db9843ea86e4 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:40.217502 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a662a4d0-4931-4024-8825-db9843ea86e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:40.238219 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-a662a4d0-4931-4024-8825-db9843ea86e4 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:29:40.239417 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-a662a4d0-4931-4024-8825-db9843ea86e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:40.244741 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a5b627-23d1-4330-a171-d0bcb5a8da21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:40.245475 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a5b627-23d1-4330-a171-d0bcb5a8da21 service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:40.245757 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a5b627-23d1-4330-a171-d0bcb5a8da21 service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:40.246049 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a5b627-23d1-4330-a171-d0bcb5a8da21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:40.247765 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-10a5b627-23d1-4330-a171-d0bcb5a8da21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:40.293533 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:29:40.305488 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:29:40.324962 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1295/2582] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:29:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 10:29:40.332916 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a5b627-23d1-4330-a171-d0bcb5a8da21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:40.334569 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438a1db5-df2e-45fe-9335-5ebf9f098cf5 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:40.334676 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a5b627-23d1-4330-a171-d0bcb5a8da21 service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:40.334855 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438a1db5-df2e-45fe-9335-5ebf9f098cf5 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:40.335136 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438a1db5-df2e-45fe-9335-5ebf9f098cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:40.345176 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1288/2583] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:29:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:29:40.360369 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-438a1db5-df2e-45fe-9335-5ebf9f098cf5 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:29:40.361803 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-438a1db5-df2e-45fe-9335-5ebf9f098cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:40.371112 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1296/2584] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:29:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 10:29:40.375190 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a5b627-23d1-4330-a171-d0bcb5a8da21 service neutron] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:40.387075 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a5b627-23d1-4330-a171-d0bcb5a8da21 service neutron] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:40.392624 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84a1608-a8e6-4b77-8e67-aeebe6663351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:40.393255 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a1608-a8e6-4b77-8e67-aeebe6663351 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:40.393538 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a1608-a8e6-4b77-8e67-aeebe6663351 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:40.394496 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a1608-a8e6-4b77-8e67-aeebe6663351 admin admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:40.395260 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84a1608-a8e6-4b77-8e67-aeebe6663351 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:29:40.395601 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84a1608-a8e6-4b77-8e67-aeebe6663351 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:40.397766 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84a1608-a8e6-4b77-8e67-aeebe6663351 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:40.412074 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1289/2585] 10.222.0.36 () {58 vars in 1153 bytes} [Tue Aug 9 10:29:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:29:40.416557 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84a1608-a8e6-4b77-8e67-aeebe6663351 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:40.417517 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e60cde-1490-4625-bb58-04db5935a4c6 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:40.417940 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e60cde-1490-4625-bb58-04db5935a4c6 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:40.418343 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e60cde-1490-4625-bb58-04db5935a4c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:40.427168 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84a1608-a8e6-4b77-8e67-aeebe6663351 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:40.434381 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b27110a-7b99-4a7f-8b84-ff3084881f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:40.434620 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b27110a-7b99-4a7f-8b84-ff3084881f41 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:40.434908 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b27110a-7b99-4a7f-8b84-ff3084881f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:40.435372 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b27110a-7b99-4a7f-8b84-ff3084881f41 admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:40.436014 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b27110a-7b99-4a7f-8b84-ff3084881f41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:40.438023 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b27110a-7b99-4a7f-8b84-ff3084881f41 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:40.440237 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-d3e60cde-1490-4625-bb58-04db5935a4c6 None None] MFA Rules not processed for user `cedc4d6c59c44c6d8fb7179070db5e91`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:29:40.442286 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-d3e60cde-1490-4625-bb58-04db5935a4c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:40.468966 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1290/2586] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:29:40 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:29:40.473474 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b27110a-7b99-4a7f-8b84-ff3084881f41 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:40.514625 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1297/2587] 10.222.0.36 () {58 vars in 1009 bytes} [Tue Aug 9 10:29:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 10:29:40.528895 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e60cde-1490-4625-bb58-04db5935a4c6 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:40.530605 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-d3e60cde-1490-4625-bb58-04db5935a4c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:40.546222 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b27110a-7b99-4a7f-8b84-ff3084881f41 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:40.551972 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84034193-51e1-428f-924e-5138cf71583d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:40.552820 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84034193-51e1-428f-924e-5138cf71583d admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:40.553512 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84034193-51e1-428f-924e-5138cf71583d admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:40.553858 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84034193-51e1-428f-924e-5138cf71583d admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:40.554596 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84034193-51e1-428f-924e-5138cf71583d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:40.556630 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84034193-51e1-428f-924e-5138cf71583d admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:40.580627 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1291/2588] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:29:40 2022] POST /identity/v3/users => generated 287 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:29:40.586096 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84034193-51e1-428f-924e-5138cf71583d admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:40.597912 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84034193-51e1-428f-924e-5138cf71583d admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:40.602787 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d442acc-9e5a-4311-aec8-92a5b8ea66a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:40.603651 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d442acc-9e5a-4311-aec8-92a5b8ea66a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:40.603820 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d442acc-9e5a-4311-aec8-92a5b8ea66a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:40.604141 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d442acc-9e5a-4311-aec8-92a5b8ea66a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:40.604862 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d442acc-9e5a-4311-aec8-92a5b8ea66a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:40.606573 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d442acc-9e5a-4311-aec8-92a5b8ea66a4 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:40.613163 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e60cde-1490-4625-bb58-04db5935a4c6 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:40.618755 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1292/2589] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:29:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 10:29:40.622523 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d442acc-9e5a-4311-aec8-92a5b8ea66a4 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:40.635229 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d442acc-9e5a-4311-aec8-92a5b8ea66a4 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:40.642701 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115a4322-e462-46b2-9fa6-ae1116663b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:40.643485 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a4322-e462-46b2-9fa6-ae1116663b29 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:40.643967 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a4322-e462-46b2-9fa6-ae1116663b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:40.644989 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a4322-e462-46b2-9fa6-ae1116663b29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:40.645770 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115a4322-e462-46b2-9fa6-ae1116663b29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:40.647566 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115a4322-e462-46b2-9fa6-ae1116663b29 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:40.663745 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1293/2590] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:29:40 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 10:29:40.665174 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115a4322-e462-46b2-9fa6-ae1116663b29 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:40.667132 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-115a4322-e462-46b2-9fa6-ae1116663b29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:40.681237 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115a4322-e462-46b2-9fa6-ae1116663b29 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:40.686064 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32badfea-6a59-4f50-ac66-802f86e758c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:40.686625 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32badfea-6a59-4f50-ac66-802f86e758c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:40.686905 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32badfea-6a59-4f50-ac66-802f86e758c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:40.687180 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32badfea-6a59-4f50-ac66-802f86e758c8 admin admin] PATH_INFO: `/v3/projects/2f21937aa20448429f9d21fe392d4b5c` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:40.688318 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32badfea-6a59-4f50-ac66-802f86e758c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f21937aa20448429f9d21fe392d4b5c)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:40.689414 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab0ab0c-b6ae-4afe-8ebc-a2b03712bc7a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '841c5dbaae774944b637c533ebd75b29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:40.690255 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32badfea-6a59-4f50-ac66-802f86e758c8 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:40.690451 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0ab0c-b6ae-4afe-8ebc-a2b03712bc7a service swift] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:40.691726 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0ab0c-b6ae-4afe-8ebc-a2b03712bc7a service swift] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:40.692197 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0ab0c-b6ae-4afe-8ebc-a2b03712bc7a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:40.724676 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:29:40.742673 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-32badfea-6a59-4f50-ac66-802f86e758c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f21937aa20448429f9d21fe392d4b5c', 'request_id': 'req-32badfea-6a59-4f50-ac66-802f86e758c8'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:40.748220 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-32badfea-6a59-4f50-ac66-802f86e758c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f21937aa20448429f9d21fe392d4b5c', 'request_id': 'req-32badfea-6a59-4f50-ac66-802f86e758c8'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:40.755162 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-32badfea-6a59-4f50-ac66-802f86e758c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f21937aa20448429f9d21fe392d4b5c', 'request_id': 'req-32badfea-6a59-4f50-ac66-802f86e758c8'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:40.755351 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab0ab0c-b6ae-4afe-8ebc-a2b03712bc7a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:40.756956 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab0ab0c-b6ae-4afe-8ebc-a2b03712bc7a service swift] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:40.758690 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:29:40.767635 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1298/2591] 10.222.0.36 () {60 vars in 1384 bytes} [Tue Aug 9 10:29:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 09 10:29:40.768428 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab0ab0c-b6ae-4afe-8ebc-a2b03712bc7a service swift] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:40.769590 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-32badfea-6a59-4f50-ac66-802f86e758c8 admin admin] The token cache is being invalidate because project 2f21937aa20448429f9d21fe392d4b5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:29:40.770458 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-32badfea-6a59-4f50-ac66-802f86e758c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:40.771207 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-32badfea-6a59-4f50-ac66-802f86e758c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:40.776243 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1294/2592] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:29:40 2022] DELETE /identity/v3/projects/2f21937aa20448429f9d21fe392d4b5c => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:29:40.777114 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32badfea-6a59-4f50-ac66-802f86e758c8 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:40.779491 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-32badfea-6a59-4f50-ac66-802f86e758c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:40.780517 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab0ab0c-b6ae-4afe-8ebc-a2b03712bc7a service swift] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:40.850992 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8904fb9d-55f9-4501-800c-6d3c7884060d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:40.851521 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8904fb9d-55f9-4501-800c-6d3c7884060d admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:40.852315 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8904fb9d-55f9-4501-800c-6d3c7884060d admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:40.852582 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8904fb9d-55f9-4501-800c-6d3c7884060d admin admin] PATH_INFO: `/v3/projects/627c4f2031444838ba32b31752eb89ee/users/91866320797b424a9d7062ff028e015f/roles/a9895331e9694fa8b2b50908bb057bcb` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:40.854571 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32badfea-6a59-4f50-ac66-802f86e758c8 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:40.859517 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59916bc-bfab-46d8-bfe1-1e2f8d297199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:40.860231 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59916bc-bfab-46d8-bfe1-1e2f8d297199 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:40.860588 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59916bc-bfab-46d8-bfe1-1e2f8d297199 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:40.860927 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59916bc-bfab-46d8-bfe1-1e2f8d297199 admin admin] PATH_INFO: `/v3/users/0e1b18554bb640a5b9cf687803f9ecc6` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:40.862159 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59916bc-bfab-46d8-bfe1-1e2f8d297199 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e1b18554bb640a5b9cf687803f9ecc6)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:40.864751 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59916bc-bfab-46d8-bfe1-1e2f8d297199 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:40.872403 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8904fb9d-55f9-4501-800c-6d3c7884060d admin admin] RBAC: Authorizing `identity:create_grant(project_id=627c4f2031444838ba32b31752eb89ee, user_id=91866320797b424a9d7062ff028e015f, role_id=a9895331e9694fa8b2b50908bb057bcb)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:40.875226 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8904fb9d-55f9-4501-800c-6d3c7884060d admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:40.895145 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1299/2593] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:29:40 2022] PUT /identity/v3/projects/627c4f2031444838ba32b31752eb89ee/users/91866320797b424a9d7062ff028e015f/roles/a9895331e9694fa8b2b50908bb057bcb => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:29:40.900595 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f75581-c065-4389-9bdd-4239673ca189 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:40.900841 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f75581-c065-4389-9bdd-4239673ca189 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:40.901122 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f75581-c065-4389-9bdd-4239673ca189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:40.922423 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-01f75581-c065-4389-9bdd-4239673ca189 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:29:40.923685 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-01f75581-c065-4389-9bdd-4239673ca189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:40.924383 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-b59916bc-bfab-46d8-bfe1-1e2f8d297199 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e1b18554bb640a5b9cf687803f9ecc6'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:40.949476 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-b59916bc-bfab-46d8-bfe1-1e2f8d297199 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e1b18554bb640a5b9cf687803f9ecc6'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:40.958698 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-b59916bc-bfab-46d8-bfe1-1e2f8d297199 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e1b18554bb640a5b9cf687803f9ecc6'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:40.959621 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-b59916bc-bfab-46d8-bfe1-1e2f8d297199 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e1b18554bb640a5b9cf687803f9ecc6'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:40.969024 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-b59916bc-bfab-46d8-bfe1-1e2f8d297199 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e1b18554bb640a5b9cf687803f9ecc6'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:40.978308 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1295/2594] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:29:40 2022] DELETE /identity/v3/users/0e1b18554bb640a5b9cf687803f9ecc6 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:29:40.999020 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1300/2595] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:29:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 10:29:41.012279 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59916bc-bfab-46d8-bfe1-1e2f8d297199 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:41.014656 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-b59916bc-bfab-46d8-bfe1-1e2f8d297199 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:41.093678 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59916bc-bfab-46d8-bfe1-1e2f8d297199 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:41.099421 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4307dbcd-046c-4123-afa7-bbe0974f64ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:41.100114 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4307dbcd-046c-4123-afa7-bbe0974f64ba service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:41.100391 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4307dbcd-046c-4123-afa7-bbe0974f64ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:41.100724 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4307dbcd-046c-4123-afa7-bbe0974f64ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:41.137364 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:29:41.206835 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4307dbcd-046c-4123-afa7-bbe0974f64ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:41.208396 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4307dbcd-046c-4123-afa7-bbe0974f64ba service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:41.221822 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1296/2596] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:29:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:29:41.365801 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f75581-c065-4389-9bdd-4239673ca189 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:41.367695 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-01f75581-c065-4389-9bdd-4239673ca189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:41.384156 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f75581-c065-4389-9bdd-4239673ca189 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:41.404576 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca32310-5693-46f4-a04f-5ae7875243e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:41.405292 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca32310-5693-46f4-a04f-5ae7875243e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:41.405667 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca32310-5693-46f4-a04f-5ae7875243e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:41.406012 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca32310-5693-46f4-a04f-5ae7875243e6 admin admin] PATH_INFO: `/v3/projects/948b72902d0f47519784cef77bd350a7` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:41.407639 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca32310-5693-46f4-a04f-5ae7875243e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=948b72902d0f47519784cef77bd350a7)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:41.410604 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca32310-5693-46f4-a04f-5ae7875243e6 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:41.479354 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:29:41.481904 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-9ca32310-5693-46f4-a04f-5ae7875243e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '948b72902d0f47519784cef77bd350a7', 'request_id': 'req-9ca32310-5693-46f4-a04f-5ae7875243e6'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:41.492762 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-9ca32310-5693-46f4-a04f-5ae7875243e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '948b72902d0f47519784cef77bd350a7', 'request_id': 'req-9ca32310-5693-46f4-a04f-5ae7875243e6'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:41.499671 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-9ca32310-5693-46f4-a04f-5ae7875243e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '948b72902d0f47519784cef77bd350a7', 'request_id': 'req-9ca32310-5693-46f4-a04f-5ae7875243e6'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:41.514422 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-9ca32310-5693-46f4-a04f-5ae7875243e6 admin admin] The token cache is being invalidate because project 948b72902d0f47519784cef77bd350a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80105) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:29:41.514888 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-9ca32310-5693-46f4-a04f-5ae7875243e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:41.515503 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-9ca32310-5693-46f4-a04f-5ae7875243e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:41.517175 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1301/2597] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:29:41 2022] DELETE /identity/v3/projects/948b72902d0f47519784cef77bd350a7 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:29:41.524046 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af125cc0-6d93-4728-8b4d-fce524ea25c6 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:41.524754 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af125cc0-6d93-4728-8b4d-fce524ea25c6 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:41.524836 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af125cc0-6d93-4728-8b4d-fce524ea25c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:41.546410 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-af125cc0-6d93-4728-8b4d-fce524ea25c6 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:29:41.547635 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-af125cc0-6d93-4728-8b4d-fce524ea25c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:41.556465 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472aa5e9-5fa0-4d4d-9ccc-eb443372090c None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:41.556956 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472aa5e9-5fa0-4d4d-9ccc-eb443372090c None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:41.557037 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472aa5e9-5fa0-4d4d-9ccc-eb443372090c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:41.580404 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-472aa5e9-5fa0-4d4d-9ccc-eb443372090c None None] MFA Rules not processed for user `cedc4d6c59c44c6d8fb7179070db5e91`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:29:41.583448 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-472aa5e9-5fa0-4d4d-9ccc-eb443372090c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:41.618198 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1297/2598] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:29:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:29:41.626230 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89bd4bd-5a6f-4a33-beb4-1ad3356cf8f6 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:41.626711 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89bd4bd-5a6f-4a33-beb4-1ad3356cf8f6 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:41.627086 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89bd4bd-5a6f-4a33-beb4-1ad3356cf8f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:41.650558 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-c89bd4bd-5a6f-4a33-beb4-1ad3356cf8f6 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:29:41.651888 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-c89bd4bd-5a6f-4a33-beb4-1ad3356cf8f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:41.657949 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1302/2599] 10.222.0.36 () {58 vars in 967 bytes} [Tue Aug 9 10:29:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 10:29:41.660886 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1298/2600] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:29:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 10:29:41.664944 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472aa5e9-5fa0-4d4d-9ccc-eb443372090c None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:41.677456 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472aa5e9-5fa0-4d4d-9ccc-eb443372090c None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:41.683109 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e66665c-ce08-41aa-8296-acc4f235cd53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:41.683923 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e66665c-ce08-41aa-8296-acc4f235cd53 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:41.684202 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e66665c-ce08-41aa-8296-acc4f235cd53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:41.684472 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e66665c-ce08-41aa-8296-acc4f235cd53 admin admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:41.685190 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e66665c-ce08-41aa-8296-acc4f235cd53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:29:41.685473 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e66665c-ce08-41aa-8296-acc4f235cd53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:41.686538 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89bd4bd-5a6f-4a33-beb4-1ad3356cf8f6 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:41.687178 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e66665c-ce08-41aa-8296-acc4f235cd53 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:41.691252 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-c89bd4bd-5a6f-4a33-beb4-1ad3356cf8f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:41.701888 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1303/2601] 10.222.0.36 () {58 vars in 1153 bytes} [Tue Aug 9 10:29:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:29:41.706151 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e66665c-ce08-41aa-8296-acc4f235cd53 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:41.718889 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e66665c-ce08-41aa-8296-acc4f235cd53 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:41.725735 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e760915-f117-4b45-816e-c1c017b3179d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:41.726640 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e760915-f117-4b45-816e-c1c017b3179d admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:41.727146 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e760915-f117-4b45-816e-c1c017b3179d admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:41.727621 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e760915-f117-4b45-816e-c1c017b3179d admin admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:41.728422 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e760915-f117-4b45-816e-c1c017b3179d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:41.730482 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e760915-f117-4b45-816e-c1c017b3179d admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:41.776000 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1304/2602] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:29:41 2022] POST /identity/v3/projects => generated 371 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:29:41.781403 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e760915-f117-4b45-816e-c1c017b3179d admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:41.795644 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89bd4bd-5a6f-4a33-beb4-1ad3356cf8f6 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:41.857385 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e760915-f117-4b45-816e-c1c017b3179d admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:41.859702 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:29:41.862503 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5e4c31-3400-41e4-8794-ffce77c5ac1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:41.863721 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e4c31-3400-41e4-8794-ffce77c5ac1f admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:41.863960 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e4c31-3400-41e4-8794-ffce77c5ac1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:41.864239 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e4c31-3400-41e4-8794-ffce77c5ac1f admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:41.864868 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5e4c31-3400-41e4-8794-ffce77c5ac1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:41.867423 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5e4c31-3400-41e4-8794-ffce77c5ac1f admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:41.868237 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319ee757-08a5-494d-9f95-f4f98169a532 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '841c5dbaae774944b637c533ebd75b29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:41.868947 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ee757-08a5-494d-9f95-f4f98169a532 service swift] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:41.869399 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ee757-08a5-494d-9f95-f4f98169a532 service swift] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:41.869917 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ee757-08a5-494d-9f95-f4f98169a532 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:41.891937 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1305/2603] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:29:41 2022] POST /identity/v3/users => generated 286 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:29:41.896640 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5e4c31-3400-41e4-8794-ffce77c5ac1f admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:41.908339 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5e4c31-3400-41e4-8794-ffce77c5ac1f admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:41.915469 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c13547a-1afd-4e12-b6b1-0e1539b0f838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:41.916090 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c13547a-1afd-4e12-b6b1-0e1539b0f838 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:41.916826 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c13547a-1afd-4e12-b6b1-0e1539b0f838 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:41.916826 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c13547a-1afd-4e12-b6b1-0e1539b0f838 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:41.917404 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c13547a-1afd-4e12-b6b1-0e1539b0f838 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:41.919131 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c13547a-1afd-4e12-b6b1-0e1539b0f838 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:41.932536 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1306/2604] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:29:41 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:29:41.936402 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c13547a-1afd-4e12-b6b1-0e1539b0f838 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:41.947261 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c13547a-1afd-4e12-b6b1-0e1539b0f838 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:41.953655 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319ee757-08a5-494d-9f95-f4f98169a532 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:41.954833 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc23ceca-7a25-485c-83b6-edd37c501835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:41.955445 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc23ceca-7a25-485c-83b6-edd37c501835 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:41.955719 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc23ceca-7a25-485c-83b6-edd37c501835 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:41.956042 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc23ceca-7a25-485c-83b6-edd37c501835 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:41.956730 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc23ceca-7a25-485c-83b6-edd37c501835 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:41.958343 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc23ceca-7a25-485c-83b6-edd37c501835 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:41.962104 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319ee757-08a5-494d-9f95-f4f98169a532 service swift] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:41.976238 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1299/2606] 10.222.0.36 () {60 vars in 1384 bytes} [Tue Aug 9 10:29:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 10:29:41.976906 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1307/2606] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:29:41 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 10:29:41.981020 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319ee757-08a5-494d-9f95-f4f98169a532 service swift] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:42.004469 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319ee757-08a5-494d-9f95-f4f98169a532 service swift] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:42.011406 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4769d95-5257-4b01-9d1d-779d35bed69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:42.012233 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4769d95-5257-4b01-9d1d-779d35bed69a admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:42.012524 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4769d95-5257-4b01-9d1d-779d35bed69a admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:42.012833 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4769d95-5257-4b01-9d1d-779d35bed69a admin admin] PATH_INFO: `/v3/projects/ef3afad4f23d42b89d770d53045136db/users/26974048549d4617bd9baa559535edd9/roles/a9895331e9694fa8b2b50908bb057bcb` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:42.027581 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038ac774-4955-48fa-af66-674f2f090d16 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:42.027868 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038ac774-4955-48fa-af66-674f2f090d16 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:42.028131 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038ac774-4955-48fa-af66-674f2f090d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:42.042570 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4769d95-5257-4b01-9d1d-779d35bed69a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef3afad4f23d42b89d770d53045136db, user_id=26974048549d4617bd9baa559535edd9, role_id=a9895331e9694fa8b2b50908bb057bcb)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:42.046464 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4769d95-5257-4b01-9d1d-779d35bed69a admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:42.062447 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:29:42.067230 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-038ac774-4955-48fa-af66-674f2f090d16 None None] MFA Rules not processed for user `91866320797b424a9d7062ff028e015f`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:29:42.069246 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-038ac774-4955-48fa-af66-674f2f090d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:42.070037 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1300/2607] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:29:41 2022] PUT /identity/v3/projects/ef3afad4f23d42b89d770d53045136db/users/26974048549d4617bd9baa559535edd9/roles/a9895331e9694fa8b2b50908bb057bcb => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:29:42.084497 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f043683-7d46-4d93-9c0f-35af5848e661 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:42.084976 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f043683-7d46-4d93-9c0f-35af5848e661 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:42.085469 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f043683-7d46-4d93-9c0f-35af5848e661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:42.120267 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-6f043683-7d46-4d93-9c0f-35af5848e661 None None] MFA Rules not processed for user `26974048549d4617bd9baa559535edd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:29:42.121612 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-6f043683-7d46-4d93-9c0f-35af5848e661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:42.192105 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1308/2608] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:29:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 10:29:42.205651 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038ac774-4955-48fa-af66-674f2f090d16 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:42.208090 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-038ac774-4955-48fa-af66-674f2f090d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:42.212995 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1301/2609] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:29:42 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 10:29:42.224770 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f043683-7d46-4d93-9c0f-35af5848e661 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:42.226133 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-6f043683-7d46-4d93-9c0f-35af5848e661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:42.295013 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038ac774-4955-48fa-af66-674f2f090d16 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:42.298657 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f043683-7d46-4d93-9c0f-35af5848e661 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:42.298834 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d762835-a373-4b04-8d2e-9bac1aefb4b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6c687a38524de0bf23d87ae91d3b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:42.299364 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d762835-a373-4b04-8d2e-9bac1aefb4b7 service cinder] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:42.299616 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d762835-a373-4b04-8d2e-9bac1aefb4b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:42.299869 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d762835-a373-4b04-8d2e-9bac1aefb4b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:42.303702 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6eb21d-4cfe-44d7-8876-521e58562217 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6c687a38524de0bf23d87ae91d3b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:42.304330 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6eb21d-4cfe-44d7-8876-521e58562217 service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:42.304617 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6eb21d-4cfe-44d7-8876-521e58562217 service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:42.305035 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6eb21d-4cfe-44d7-8876-521e58562217 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:42.311469 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d762835-a373-4b04-8d2e-9bac1aefb4b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:42.314114 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d762835-a373-4b04-8d2e-9bac1aefb4b7 service cinder] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:42.315688 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6eb21d-4cfe-44d7-8876-521e58562217 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:42.317650 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6eb21d-4cfe-44d7-8876-521e58562217 service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:42.328391 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1302/2610] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:29:42 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:29:42.329910 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646a1468-e8e4-42a8-9e20-a37522829a1f None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:42.330284 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646a1468-e8e4-42a8-9e20-a37522829a1f None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:42.330658 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646a1468-e8e4-42a8-9e20-a37522829a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:42.351667 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1309/2611] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:29:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 10:29:42.352861 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d762835-a373-4b04-8d2e-9bac1aefb4b7 service cinder] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:42.353088 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-646a1468-e8e4-42a8-9e20-a37522829a1f None None] MFA Rules not processed for user `cedc4d6c59c44c6d8fb7179070db5e91`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:29:42.354442 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-646a1468-e8e4-42a8-9e20-a37522829a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:42.360803 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:29:42.433146 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1303/2612] 10.222.0.36 () {58 vars in 1009 bytes} [Tue Aug 9 10:29:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:29:42.433410 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d762835-a373-4b04-8d2e-9bac1aefb4b7 service cinder] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:42.440333 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa873099-ee49-4450-8a50-e5fc84e2ced9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:42.441834 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa873099-ee49-4450-8a50-e5fc84e2ced9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:42.441834 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa873099-ee49-4450-8a50-e5fc84e2ced9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:42.442145 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa873099-ee49-4450-8a50-e5fc84e2ced9 admin admin] PATH_INFO: `/v3/users/26974048549d4617bd9baa559535edd9` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:42.443274 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa873099-ee49-4450-8a50-e5fc84e2ced9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26974048549d4617bd9baa559535edd9)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:42.445179 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa873099-ee49-4450-8a50-e5fc84e2ced9 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:42.447112 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646a1468-e8e4-42a8-9e20-a37522829a1f None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:42.497964 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-fa873099-ee49-4450-8a50-e5fc84e2ced9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26974048549d4617bd9baa559535edd9'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:42.499473 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:29:42.517598 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-fa873099-ee49-4450-8a50-e5fc84e2ced9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26974048549d4617bd9baa559535edd9'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:42.527780 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-fa873099-ee49-4450-8a50-e5fc84e2ced9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26974048549d4617bd9baa559535edd9'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:42.528496 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-fa873099-ee49-4450-8a50-e5fc84e2ced9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26974048549d4617bd9baa559535edd9'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:42.535673 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646a1468-e8e4-42a8-9e20-a37522829a1f None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:42.536739 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-fa873099-ee49-4450-8a50-e5fc84e2ced9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26974048549d4617bd9baa559535edd9'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:42.541159 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6eba2f-fb3c-47de-824e-4b0da4a2c7e9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '841c5dbaae774944b637c533ebd75b29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:42.541768 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6eba2f-fb3c-47de-824e-4b0da4a2c7e9 service swift] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:42.542137 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6eba2f-fb3c-47de-824e-4b0da4a2c7e9 service swift] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:42.542507 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6eba2f-fb3c-47de-824e-4b0da4a2c7e9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:42.543900 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1310/2613] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:29:42 2022] DELETE /identity/v3/users/26974048549d4617bd9baa559535edd9 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:29:42.544464 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-5a6eba2f-fb3c-47de-824e-4b0da4a2c7e9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:42.549785 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f17ed3-bf6a-4f1b-9a57-134bc93047f0 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:42.550344 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f17ed3-bf6a-4f1b-9a57-134bc93047f0 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:42.550808 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f17ed3-bf6a-4f1b-9a57-134bc93047f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:42.556294 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6eba2f-fb3c-47de-824e-4b0da4a2c7e9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:42.557920 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6eba2f-fb3c-47de-824e-4b0da4a2c7e9 service swift] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:42.567434 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1304/2614] 10.222.0.36 () {60 vars in 1384 bytes} [Tue Aug 9 10:29:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 09 10:29:42.577697 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-f9f17ed3-bf6a-4f1b-9a57-134bc93047f0 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:29:42.580586 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-f9f17ed3-bf6a-4f1b-9a57-134bc93047f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:42.670982 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1311/2615] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:29:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 10:29:42.691524 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6eba2f-fb3c-47de-824e-4b0da4a2c7e9 service swift] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:42.694959 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-5a6eba2f-fb3c-47de-824e-4b0da4a2c7e9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:42.768581 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6eba2f-fb3c-47de-824e-4b0da4a2c7e9 service swift] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:42.820564 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37574c3-3c0b-4d48-99a1-680619f14809 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:42.821199 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37574c3-3c0b-4d48-99a1-680619f14809 service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:42.821480 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37574c3-3c0b-4d48-99a1-680619f14809 service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:42.821756 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37574c3-3c0b-4d48-99a1-680619f14809 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:42.832137 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37574c3-3c0b-4d48-99a1-680619f14809 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:42.833589 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37574c3-3c0b-4d48-99a1-680619f14809 service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:42.843609 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1305/2616] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:29:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:29:42.955116 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876b1b0e-bb45-4d91-9d27-2b0ceffff683 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:42.955403 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876b1b0e-bb45-4d91-9d27-2b0ceffff683 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:42.955677 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876b1b0e-bb45-4d91-9d27-2b0ceffff683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:42.974854 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-876b1b0e-bb45-4d91-9d27-2b0ceffff683 None None] MFA Rules not processed for user `cedc4d6c59c44c6d8fb7179070db5e91`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:29:42.976053 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-876b1b0e-bb45-4d91-9d27-2b0ceffff683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:43.038186 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1312/2617] 10.222.0.36 () {58 vars in 967 bytes} [Tue Aug 9 10:29:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:29:43.049465 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37574c3-3c0b-4d48-99a1-680619f14809 service neutron] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:43.051513 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-c37574c3-3c0b-4d48-99a1-680619f14809 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:43.057915 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:29:43.125572 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37574c3-3c0b-4d48-99a1-680619f14809 service neutron] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:43.131621 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876b1b0e-bb45-4d91-9d27-2b0ceffff683 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:43.133110 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-876b1b0e-bb45-4d91-9d27-2b0ceffff683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:43.134510 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df7ceec-50bc-40d3-91b1-8eb91892afc6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '841c5dbaae774944b637c533ebd75b29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:43.135271 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df7ceec-50bc-40d3-91b1-8eb91892afc6 service swift] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:43.135554 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df7ceec-50bc-40d3-91b1-8eb91892afc6 service swift] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:43.135866 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df7ceec-50bc-40d3-91b1-8eb91892afc6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:43.147976 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df7ceec-50bc-40d3-91b1-8eb91892afc6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:43.150175 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876b1b0e-bb45-4d91-9d27-2b0ceffff683 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:43.150415 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df7ceec-50bc-40d3-91b1-8eb91892afc6 service swift] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:43.154990 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b312de52-55eb-441e-87d2-2370bea72dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:43.155629 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312de52-55eb-441e-87d2-2370bea72dcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:43.155904 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312de52-55eb-441e-87d2-2370bea72dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:43.156177 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312de52-55eb-441e-87d2-2370bea72dcb admin admin] PATH_INFO: `/v3/projects/ef3afad4f23d42b89d770d53045136db` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:43.157322 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b312de52-55eb-441e-87d2-2370bea72dcb admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef3afad4f23d42b89d770d53045136db)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:43.159232 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b312de52-55eb-441e-87d2-2370bea72dcb admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:43.167048 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1306/2618] 10.222.0.36 () {60 vars in 1384 bytes} [Tue Aug 9 10:29:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 09 10:29:43.215037 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-b312de52-55eb-441e-87d2-2370bea72dcb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef3afad4f23d42b89d770d53045136db', 'request_id': 'req-b312de52-55eb-441e-87d2-2370bea72dcb'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:43.221447 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-b312de52-55eb-441e-87d2-2370bea72dcb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef3afad4f23d42b89d770d53045136db', 'request_id': 'req-b312de52-55eb-441e-87d2-2370bea72dcb'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:43.229228 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-b312de52-55eb-441e-87d2-2370bea72dcb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef3afad4f23d42b89d770d53045136db', 'request_id': 'req-b312de52-55eb-441e-87d2-2370bea72dcb'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:43.232031 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:29:43.244755 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-b312de52-55eb-441e-87d2-2370bea72dcb admin admin] The token cache is being invalidate because project ef3afad4f23d42b89d770d53045136db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80105) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:29:43.245046 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-b312de52-55eb-441e-87d2-2370bea72dcb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:43.245690 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-b312de52-55eb-441e-87d2-2370bea72dcb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:43.247312 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1313/2619] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:29:43 2022] DELETE /identity/v3/projects/ef3afad4f23d42b89d770d53045136db => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:29:43.252399 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6916658-90a6-4c35-867d-33951b169d4a None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:43.252725 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6916658-90a6-4c35-867d-33951b169d4a None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:43.253686 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6916658-90a6-4c35-867d-33951b169d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:43.278117 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-f6916658-90a6-4c35-867d-33951b169d4a None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:29:43.283006 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-f6916658-90a6-4c35-867d-33951b169d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:43.351034 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1307/2620] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:29:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:29:43.359939 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b97707-b719-433a-a80d-62f251dd0ed3 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:43.360347 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b97707-b719-433a-a80d-62f251dd0ed3 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:43.360544 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b97707-b719-433a-a80d-62f251dd0ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:43.382106 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-c8b97707-b719-433a-a80d-62f251dd0ed3 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:29:43.383367 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-c8b97707-b719-433a-a80d-62f251dd0ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:43.393879 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1314/2621] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:29:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:29:43.396176 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6916658-90a6-4c35-867d-33951b169d4a None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:43.407814 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6916658-90a6-4c35-867d-33951b169d4a None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:43.413188 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d3231d-6111-41a7-acf1-813772177cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:43.413786 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d3231d-6111-41a7-acf1-813772177cea admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:43.414094 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d3231d-6111-41a7-acf1-813772177cea admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:43.414359 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d3231d-6111-41a7-acf1-813772177cea admin admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:43.414997 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d3231d-6111-41a7-acf1-813772177cea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:29:43.415295 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d3231d-6111-41a7-acf1-813772177cea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:43.416909 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d3231d-6111-41a7-acf1-813772177cea admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:43.433880 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1308/2622] 10.222.0.36 () {58 vars in 1153 bytes} [Tue Aug 9 10:29:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:29:43.435232 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b97707-b719-433a-a80d-62f251dd0ed3 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:43.448603 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b97707-b719-433a-a80d-62f251dd0ed3 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:43.454885 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a03d1a-c5a5-4d8b-9805-29f4c83ad912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:43.455483 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a03d1a-c5a5-4d8b-9805-29f4c83ad912 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:43.455758 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a03d1a-c5a5-4d8b-9805-29f4c83ad912 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:43.456026 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a03d1a-c5a5-4d8b-9805-29f4c83ad912 admin admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:43.457107 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a03d1a-c5a5-4d8b-9805-29f4c83ad912 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:43.459114 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a03d1a-c5a5-4d8b-9805-29f4c83ad912 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:43.494928 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1315/2623] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:29:43 2022] POST /identity/v3/projects => generated 375 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:29:43.503698 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d3231d-6111-41a7-acf1-813772177cea admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:43.521463 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d3231d-6111-41a7-acf1-813772177cea admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:43.584068 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707f4094-9452-4ae2-b4b2-f3e62c8827b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:43.584675 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707f4094-9452-4ae2-b4b2-f3e62c8827b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:43.584675 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707f4094-9452-4ae2-b4b2-f3e62c8827b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:43.585185 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707f4094-9452-4ae2-b4b2-f3e62c8827b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:43.585543 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707f4094-9452-4ae2-b4b2-f3e62c8827b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:43.587637 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707f4094-9452-4ae2-b4b2-f3e62c8827b8 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:43.616510 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1309/2624] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:29:43 2022] POST /identity/v3/users => generated 288 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:29:43.616746 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a03d1a-c5a5-4d8b-9805-29f4c83ad912 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:43.627691 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a03d1a-c5a5-4d8b-9805-29f4c83ad912 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:43.632654 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834c3583-d65b-4c5d-bcf5-197d91b83c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:43.633259 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834c3583-d65b-4c5d-bcf5-197d91b83c6e admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:43.633610 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834c3583-d65b-4c5d-bcf5-197d91b83c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:43.633899 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834c3583-d65b-4c5d-bcf5-197d91b83c6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:43.634534 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834c3583-d65b-4c5d-bcf5-197d91b83c6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:43.636240 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834c3583-d65b-4c5d-bcf5-197d91b83c6e admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:43.647849 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1316/2625] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:29:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 10:29:43.654107 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707f4094-9452-4ae2-b4b2-f3e62c8827b8 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:43.678632 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707f4094-9452-4ae2-b4b2-f3e62c8827b8 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:43.683703 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9e9f39-bc74-4aeb-89c3-8050b1f52d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:43.684398 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9e9f39-bc74-4aeb-89c3-8050b1f52d90 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:43.684747 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9e9f39-bc74-4aeb-89c3-8050b1f52d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:43.685129 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9e9f39-bc74-4aeb-89c3-8050b1f52d90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:43.685838 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9e9f39-bc74-4aeb-89c3-8050b1f52d90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:43.687591 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9e9f39-bc74-4aeb-89c3-8050b1f52d90 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:43.693548 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:29:43.703015 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1310/2626] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:29:43 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:29:43.707426 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834c3583-d65b-4c5d-bcf5-197d91b83c6e admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:43.721364 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834c3583-d65b-4c5d-bcf5-197d91b83c6e admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:43.730383 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8e89bf-dc9a-44f3-b47b-de5b716e95a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:43.731122 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e89bf-dc9a-44f3-b47b-de5b716e95a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:43.731472 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e89bf-dc9a-44f3-b47b-de5b716e95a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:43.731815 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e89bf-dc9a-44f3-b47b-de5b716e95a9 admin admin] PATH_INFO: `/v3/projects/4eb3dcc49a164fc087cc557a6cae6ffb/users/50c628027e2b45878fe96044681301d0/roles/a9895331e9694fa8b2b50908bb057bcb` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:43.757788 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8e89bf-dc9a-44f3-b47b-de5b716e95a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4eb3dcc49a164fc087cc557a6cae6ffb, user_id=50c628027e2b45878fe96044681301d0, role_id=a9895331e9694fa8b2b50908bb057bcb)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:43.760494 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8e89bf-dc9a-44f3-b47b-de5b716e95a9 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:43.780448 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1317/2627] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:29:43 2022] PUT /identity/v3/projects/4eb3dcc49a164fc087cc557a6cae6ffb/users/50c628027e2b45878fe96044681301d0/roles/a9895331e9694fa8b2b50908bb057bcb => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:29:43.789690 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aac0f2-73e0-4311-bede-a9b3b7ad7ee2 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:43.790122 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aac0f2-73e0-4311-bede-a9b3b7ad7ee2 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:43.790402 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aac0f2-73e0-4311-bede-a9b3b7ad7ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:43.794895 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c9cce2-5abd-4e69-8db4-f4e8c9529bc6 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:43.795198 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c9cce2-5abd-4e69-8db4-f4e8c9529bc6 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:43.795452 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c9cce2-5abd-4e69-8db4-f4e8c9529bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:43.812085 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-98aac0f2-73e0-4311-bede-a9b3b7ad7ee2 None None] MFA Rules not processed for user `91866320797b424a9d7062ff028e015f`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:29:43.813350 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-98aac0f2-73e0-4311-bede-a9b3b7ad7ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:43.831770 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-68c9cce2-5abd-4e69-8db4-f4e8c9529bc6 None None] MFA Rules not processed for user `50c628027e2b45878fe96044681301d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:29:43.833911 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-68c9cce2-5abd-4e69-8db4-f4e8c9529bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:43.876007 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1311/2628] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:29:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:29:43.920100 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1318/2629] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:29:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:29:43.933588 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aac0f2-73e0-4311-bede-a9b3b7ad7ee2 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:43.935054 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-98aac0f2-73e0-4311-bede-a9b3b7ad7ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:44.011685 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aac0f2-73e0-4311-bede-a9b3b7ad7ee2 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:44.016251 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25334ba8-1b10-45cf-952f-16d323aaa30e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6c687a38524de0bf23d87ae91d3b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:44.016724 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25334ba8-1b10-45cf-952f-16d323aaa30e service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:44.017000 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25334ba8-1b10-45cf-952f-16d323aaa30e service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:44.017274 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25334ba8-1b10-45cf-952f-16d323aaa30e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:44.028433 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25334ba8-1b10-45cf-952f-16d323aaa30e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:44.030045 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25334ba8-1b10-45cf-952f-16d323aaa30e service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:44.042062 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1312/2630] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:29:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:29:44.166284 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c9cce2-5abd-4e69-8db4-f4e8c9529bc6 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:44.167907 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-68c9cce2-5abd-4e69-8db4-f4e8c9529bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:44.236926 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c9cce2-5abd-4e69-8db4-f4e8c9529bc6 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:44.243070 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26222a7-3599-4ffa-84a2-4419be15dab8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:44.243798 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26222a7-3599-4ffa-84a2-4419be15dab8 service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:44.244078 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26222a7-3599-4ffa-84a2-4419be15dab8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:44.244346 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26222a7-3599-4ffa-84a2-4419be15dab8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:44.246127 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-f26222a7-3599-4ffa-84a2-4419be15dab8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:44.258067 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26222a7-3599-4ffa-84a2-4419be15dab8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:44.259502 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26222a7-3599-4ffa-84a2-4419be15dab8 service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:44.269641 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1319/2631] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:29:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:29:45.373022 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25334ba8-1b10-45cf-952f-16d323aaa30e service cinder] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:45.374563 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-25334ba8-1b10-45cf-952f-16d323aaa30e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:45.440994 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25334ba8-1b10-45cf-952f-16d323aaa30e service cinder] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:45.446343 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ffe13-e081-4672-8622-0a8112599a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:45.446973 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ffe13-e081-4672-8622-0a8112599a3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:45.447252 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ffe13-e081-4672-8622-0a8112599a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:45.447520 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ffe13-e081-4672-8622-0a8112599a3c admin admin] PATH_INFO: `/v3/users/1c614d238a1b404a80737229573c8018` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:45.448652 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5ffe13-e081-4672-8622-0a8112599a3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c614d238a1b404a80737229573c8018)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:45.450857 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5ffe13-e081-4672-8622-0a8112599a3c admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:45.518475 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-ca5ffe13-e081-4672-8622-0a8112599a3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c614d238a1b404a80737229573c8018'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:45.521217 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:29:45.553340 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-ca5ffe13-e081-4672-8622-0a8112599a3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c614d238a1b404a80737229573c8018'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:45.561937 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-ca5ffe13-e081-4672-8622-0a8112599a3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c614d238a1b404a80737229573c8018'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:45.562687 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-ca5ffe13-e081-4672-8622-0a8112599a3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c614d238a1b404a80737229573c8018'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:45.572122 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-ca5ffe13-e081-4672-8622-0a8112599a3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c614d238a1b404a80737229573c8018'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:45.579647 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1313/2632] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:29:45 2022] DELETE /identity/v3/users/1c614d238a1b404a80737229573c8018 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:29:45.586202 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9736f64e-b8e0-4796-b7c7-849cabfbfec9 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:45.586785 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9736f64e-b8e0-4796-b7c7-849cabfbfec9 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:45.586785 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9736f64e-b8e0-4796-b7c7-849cabfbfec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:45.615903 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-9736f64e-b8e0-4796-b7c7-849cabfbfec9 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:29:45.617086 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-9736f64e-b8e0-4796-b7c7-849cabfbfec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:45.638879 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:29:45.718858 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1320/2633] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:29:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:29:45.734866 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ffe13-e081-4672-8622-0a8112599a3c admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:45.734866 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-ca5ffe13-e081-4672-8622-0a8112599a3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:45.811596 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ffe13-e081-4672-8622-0a8112599a3c admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:45.815142 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d46e89-5669-4f44-8ee1-ea17f16ad6a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:45.816312 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d46e89-5669-4f44-8ee1-ea17f16ad6a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:45.816596 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d46e89-5669-4f44-8ee1-ea17f16ad6a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:45.816932 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d46e89-5669-4f44-8ee1-ea17f16ad6a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:45.826618 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d46e89-5669-4f44-8ee1-ea17f16ad6a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:45.828069 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d46e89-5669-4f44-8ee1-ea17f16ad6a8 service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:45.839666 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1314/2634] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:29:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:29:46.015702 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9736f64e-b8e0-4796-b7c7-849cabfbfec9 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:46.017313 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-9736f64e-b8e0-4796-b7c7-849cabfbfec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:46.031542 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9736f64e-b8e0-4796-b7c7-849cabfbfec9 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:46.036634 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1d6fed-125a-4327-a92b-9f11f0de5bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:46.037429 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1d6fed-125a-4327-a92b-9f11f0de5bc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:46.037781 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1d6fed-125a-4327-a92b-9f11f0de5bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:46.038167 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1d6fed-125a-4327-a92b-9f11f0de5bc2 admin admin] PATH_INFO: `/v3/projects/77bff747bf344927b1bc5a89717e8db5` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:46.039490 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1d6fed-125a-4327-a92b-9f11f0de5bc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77bff747bf344927b1bc5a89717e8db5)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:46.041965 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1d6fed-125a-4327-a92b-9f11f0de5bc2 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:46.089465 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-6f1d6fed-125a-4327-a92b-9f11f0de5bc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77bff747bf344927b1bc5a89717e8db5', 'request_id': 'req-6f1d6fed-125a-4327-a92b-9f11f0de5bc2'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:46.095183 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-6f1d6fed-125a-4327-a92b-9f11f0de5bc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77bff747bf344927b1bc5a89717e8db5', 'request_id': 'req-6f1d6fed-125a-4327-a92b-9f11f0de5bc2'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:46.101800 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-6f1d6fed-125a-4327-a92b-9f11f0de5bc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77bff747bf344927b1bc5a89717e8db5', 'request_id': 'req-6f1d6fed-125a-4327-a92b-9f11f0de5bc2'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:46.115424 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-6f1d6fed-125a-4327-a92b-9f11f0de5bc2 admin admin] The token cache is being invalidate because project 77bff747bf344927b1bc5a89717e8db5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80105) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:29:46.115707 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-6f1d6fed-125a-4327-a92b-9f11f0de5bc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:46.116334 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-6f1d6fed-125a-4327-a92b-9f11f0de5bc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:46.117967 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1321/2635] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:29:46 2022] DELETE /identity/v3/projects/77bff747bf344927b1bc5a89717e8db5 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:29:46.124438 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aa15c3-adbf-4568-8c4f-2809fcfb58fa None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:46.124727 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aa15c3-adbf-4568-8c4f-2809fcfb58fa None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:46.125001 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aa15c3-adbf-4568-8c4f-2809fcfb58fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:46.145199 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-96aa15c3-adbf-4568-8c4f-2809fcfb58fa None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:29:46.146355 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-96aa15c3-adbf-4568-8c4f-2809fcfb58fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:46.208106 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1315/2636] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:29:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 10:29:46.216960 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad4da4-4d36-4b03-aae6-48d98e70bf5d None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:46.217266 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad4da4-4d36-4b03-aae6-48d98e70bf5d None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:46.217528 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad4da4-4d36-4b03-aae6-48d98e70bf5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:46.238663 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-c3ad4da4-4d36-4b03-aae6-48d98e70bf5d None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:29:46.239871 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-c3ad4da4-4d36-4b03-aae6-48d98e70bf5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:46.247613 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1322/2637] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:29:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:29:46.252033 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aa15c3-adbf-4568-8c4f-2809fcfb58fa None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:46.262481 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aa15c3-adbf-4568-8c4f-2809fcfb58fa None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:46.267424 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8425e4-905c-4837-ad0a-0d0cbdeefee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:46.268026 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8425e4-905c-4837-ad0a-0d0cbdeefee3 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:46.268344 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8425e4-905c-4837-ad0a-0d0cbdeefee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:46.268691 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8425e4-905c-4837-ad0a-0d0cbdeefee3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:46.269363 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8425e4-905c-4837-ad0a-0d0cbdeefee3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:29:46.269760 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8425e4-905c-4837-ad0a-0d0cbdeefee3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:46.271494 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8425e4-905c-4837-ad0a-0d0cbdeefee3 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:46.283597 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1316/2638] 10.222.0.36 () {58 vars in 1153 bytes} [Tue Aug 9 10:29:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:29:46.288458 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ad4da4-4d36-4b03-aae6-48d98e70bf5d None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:46.298522 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ad4da4-4d36-4b03-aae6-48d98e70bf5d None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:46.303991 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d153612-23b9-4ba1-9933-9988f02e2f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:46.304589 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d153612-23b9-4ba1-9933-9988f02e2f8c admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:46.304864 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d153612-23b9-4ba1-9933-9988f02e2f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:46.305137 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d153612-23b9-4ba1-9933-9988f02e2f8c admin admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:46.305794 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d153612-23b9-4ba1-9933-9988f02e2f8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:46.307694 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d153612-23b9-4ba1-9933-9988f02e2f8c admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:46.339574 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1323/2639] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:29:46 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:29:46.340738 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8425e4-905c-4837-ad0a-0d0cbdeefee3 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:46.351823 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8425e4-905c-4837-ad0a-0d0cbdeefee3 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:46.403998 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:29:46.411408 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45752156-38b6-42b0-95b7-ceed04825842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:46.412344 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45752156-38b6-42b0-95b7-ceed04825842 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:46.412854 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45752156-38b6-42b0-95b7-ceed04825842 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:46.413104 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45752156-38b6-42b0-95b7-ceed04825842 admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:46.413757 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45752156-38b6-42b0-95b7-ceed04825842 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:46.416349 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45752156-38b6-42b0-95b7-ceed04825842 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:46.439590 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1317/2640] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:29:46 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:29:46.443818 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d153612-23b9-4ba1-9933-9988f02e2f8c admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:46.454355 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d153612-23b9-4ba1-9933-9988f02e2f8c admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:46.459066 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6292dbe8-fa5c-4061-b5fd-c4ec75e17a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:46.459672 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6292dbe8-fa5c-4061-b5fd-c4ec75e17a02 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:46.459948 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6292dbe8-fa5c-4061-b5fd-c4ec75e17a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:46.460217 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6292dbe8-fa5c-4061-b5fd-c4ec75e17a02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:46.460882 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6292dbe8-fa5c-4061-b5fd-c4ec75e17a02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:46.462506 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6292dbe8-fa5c-4061-b5fd-c4ec75e17a02 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:46.476798 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1324/2641] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:29:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:29:46.477966 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45752156-38b6-42b0-95b7-ceed04825842 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:46.488518 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45752156-38b6-42b0-95b7-ceed04825842 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:46.493169 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2b6606-87d3-4ea0-8f5e-bfdba3a446c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:46.493768 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2b6606-87d3-4ea0-8f5e-bfdba3a446c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:46.494146 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2b6606-87d3-4ea0-8f5e-bfdba3a446c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:46.494420 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2b6606-87d3-4ea0-8f5e-bfdba3a446c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:46.495061 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2b6606-87d3-4ea0-8f5e-bfdba3a446c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:46.496675 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2b6606-87d3-4ea0-8f5e-bfdba3a446c3 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:46.511978 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1318/2642] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:29:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 10:29:46.513262 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6292dbe8-fa5c-4061-b5fd-c4ec75e17a02 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:46.523933 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6292dbe8-fa5c-4061-b5fd-c4ec75e17a02 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:46.528765 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e256eb-3c6b-44b9-ab49-e1328b4cf31c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:46.529409 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e256eb-3c6b-44b9-ab49-e1328b4cf31c admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:46.529682 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e256eb-3c6b-44b9-ab49-e1328b4cf31c admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:46.529988 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e256eb-3c6b-44b9-ab49-e1328b4cf31c admin admin] PATH_INFO: `/v3/projects/7c30224de88f4d41999346193e4e7ab9/users/7821ddf3db39402cbb243eef34829c45/roles/a9895331e9694fa8b2b50908bb057bcb` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:46.546708 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e256eb-3c6b-44b9-ab49-e1328b4cf31c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c30224de88f4d41999346193e4e7ab9, user_id=7821ddf3db39402cbb243eef34829c45, role_id=a9895331e9694fa8b2b50908bb057bcb)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:46.549634 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e256eb-3c6b-44b9-ab49-e1328b4cf31c admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:46.563647 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1325/2643] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:29:46 2022] PUT /identity/v3/projects/7c30224de88f4d41999346193e4e7ab9/users/7821ddf3db39402cbb243eef34829c45/roles/a9895331e9694fa8b2b50908bb057bcb => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:29:46.568639 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0269bb-8088-4e2d-a344-69609fceeca0 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:46.568993 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0269bb-8088-4e2d-a344-69609fceeca0 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:46.569356 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0269bb-8088-4e2d-a344-69609fceeca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:46.589992 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-ea0269bb-8088-4e2d-a344-69609fceeca0 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:29:46.591199 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-ea0269bb-8088-4e2d-a344-69609fceeca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:46.651593 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1319/2644] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:29:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:29:46.662371 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e256eb-3c6b-44b9-ab49-e1328b4cf31c admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:46.664168 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-73e256eb-3c6b-44b9-ab49-e1328b4cf31c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:46.713149 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:29:46.727873 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e256eb-3c6b-44b9-ab49-e1328b4cf31c admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:46.731635 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492a916d-977e-482f-8939-089352e1853c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:46.732332 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492a916d-977e-482f-8939-089352e1853c service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:46.732616 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492a916d-977e-482f-8939-089352e1853c service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:46.732895 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492a916d-977e-482f-8939-089352e1853c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:46.742497 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492a916d-977e-482f-8939-089352e1853c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:46.743997 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492a916d-977e-482f-8939-089352e1853c service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:46.754947 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1326/2645] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:29:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:29:51.784708 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053be37b-b52a-4765-8312-ba35e11448bf None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:51.785218 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053be37b-b52a-4765-8312-ba35e11448bf None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:51.785218 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053be37b-b52a-4765-8312-ba35e11448bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:51.822688 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-053be37b-b52a-4765-8312-ba35e11448bf None None] MFA Rules not processed for user `7821ddf3db39402cbb243eef34829c45`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:29:51.824112 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-053be37b-b52a-4765-8312-ba35e11448bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:51.933421 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1320/2646] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:29:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:29:51.934286 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492a916d-977e-482f-8939-089352e1853c service neutron] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:51.950658 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492a916d-977e-482f-8939-089352e1853c service neutron] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:51.962214 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb685489-e004-42cb-90a9-28c475e3784a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:51.962920 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb685489-e004-42cb-90a9-28c475e3784a admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:51.963197 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb685489-e004-42cb-90a9-28c475e3784a admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:51.963455 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb685489-e004-42cb-90a9-28c475e3784a admin admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:51.964087 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb685489-e004-42cb-90a9-28c475e3784a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:51.966050 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb685489-e004-42cb-90a9-28c475e3784a admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:52.000605 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1327/2647] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:29:51 2022] POST /identity/v3/projects => generated 373 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:29:52.005550 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053be37b-b52a-4765-8312-ba35e11448bf None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:52.022303 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053be37b-b52a-4765-8312-ba35e11448bf None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:52.091085 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e6c79b-c158-467d-a3fe-c026c8d17dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:52.091085 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6c79b-c158-467d-a3fe-c026c8d17dc2 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:52.091085 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6c79b-c158-467d-a3fe-c026c8d17dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:52.091085 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6c79b-c158-467d-a3fe-c026c8d17dc2 admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:52.091616 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e6c79b-c158-467d-a3fe-c026c8d17dc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:52.094014 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e6c79b-c158-467d-a3fe-c026c8d17dc2 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:52.106631 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:29:52.120447 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1321/2648] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:29:52 2022] POST /identity/v3/users => generated 293 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:29:52.124628 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb685489-e004-42cb-90a9-28c475e3784a admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:52.137224 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb685489-e004-42cb-90a9-28c475e3784a admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:52.142478 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9f8046-1b3d-4330-afaf-6cd7778d240d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:52.143278 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9f8046-1b3d-4330-afaf-6cd7778d240d admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:52.143687 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9f8046-1b3d-4330-afaf-6cd7778d240d admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:52.144682 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9f8046-1b3d-4330-afaf-6cd7778d240d admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:52.145452 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9f8046-1b3d-4330-afaf-6cd7778d240d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:52.147202 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9f8046-1b3d-4330-afaf-6cd7778d240d admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:52.164581 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1328/2649] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:29:52 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:29:52.168656 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e6c79b-c158-467d-a3fe-c026c8d17dc2 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:52.179363 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e6c79b-c158-467d-a3fe-c026c8d17dc2 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:52.184689 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23263f01-3c95-4583-b4ef-1a017c47ff41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:52.185554 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23263f01-3c95-4583-b4ef-1a017c47ff41 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:52.185830 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23263f01-3c95-4583-b4ef-1a017c47ff41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:52.186131 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23263f01-3c95-4583-b4ef-1a017c47ff41 admin admin] PATH_INFO: `/v3/projects/fc7a83c19bb545228268d19084c66a1a/users/aff294ffdd1e47e1841d07913c968c19/roles/89ca30cbbb634be8a96e9921aa56626b` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:52.205255 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23263f01-3c95-4583-b4ef-1a017c47ff41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc7a83c19bb545228268d19084c66a1a, user_id=aff294ffdd1e47e1841d07913c968c19, role_id=89ca30cbbb634be8a96e9921aa56626b)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:52.208881 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23263f01-3c95-4583-b4ef-1a017c47ff41 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:52.226474 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1322/2650] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:29:52 2022] PUT /identity/v3/projects/fc7a83c19bb545228268d19084c66a1a/users/aff294ffdd1e47e1841d07913c968c19/roles/89ca30cbbb634be8a96e9921aa56626b => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:29:52.230383 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9f8046-1b3d-4330-afaf-6cd7778d240d admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:52.241806 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9f8046-1b3d-4330-afaf-6cd7778d240d admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:52.316433 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621e81af-5849-4afd-93b5-b25551d5dcdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:52.317254 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621e81af-5849-4afd-93b5-b25551d5dcdc admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:52.317595 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621e81af-5849-4afd-93b5-b25551d5dcdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:52.317952 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621e81af-5849-4afd-93b5-b25551d5dcdc admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:52.318865 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621e81af-5849-4afd-93b5-b25551d5dcdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:52.320792 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621e81af-5849-4afd-93b5-b25551d5dcdc admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:52.334902 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1329/2651] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:29:52 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 10:29:52.339414 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23263f01-3c95-4583-b4ef-1a017c47ff41 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:52.351232 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23263f01-3c95-4583-b4ef-1a017c47ff41 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:52.356375 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f557b740-e376-4527-a048-6b0fb43e9634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:52.357180 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f557b740-e376-4527-a048-6b0fb43e9634 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:52.357605 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f557b740-e376-4527-a048-6b0fb43e9634 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:52.357993 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f557b740-e376-4527-a048-6b0fb43e9634 admin admin] PATH_INFO: `/v3/projects/fc7a83c19bb545228268d19084c66a1a/users/aff294ffdd1e47e1841d07913c968c19/roles/89ca30cbbb634be8a96e9921aa56626b` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:52.360706 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f557b740-e376-4527-a048-6b0fb43e9634 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc7a83c19bb545228268d19084c66a1a, user_id=aff294ffdd1e47e1841d07913c968c19, role_id=89ca30cbbb634be8a96e9921aa56626b)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:52.364447 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f557b740-e376-4527-a048-6b0fb43e9634 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:52.379245 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1323/2652] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:29:52 2022] PUT /identity/v3/projects/fc7a83c19bb545228268d19084c66a1a/users/aff294ffdd1e47e1841d07913c968c19/roles/89ca30cbbb634be8a96e9921aa56626b => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:29:56.414215 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621e81af-5849-4afd-93b5-b25551d5dcdc admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:56.416613 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-621e81af-5849-4afd-93b5-b25551d5dcdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:56.431758 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621e81af-5849-4afd-93b5-b25551d5dcdc admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:56.507194 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09118d2-b6ab-4e85-8b9e-16f8df5107be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:56.507845 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09118d2-b6ab-4e85-8b9e-16f8df5107be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:56.508309 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09118d2-b6ab-4e85-8b9e-16f8df5107be admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:56.508593 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09118d2-b6ab-4e85-8b9e-16f8df5107be admin admin] PATH_INFO: `/v3/users/50c628027e2b45878fe96044681301d0` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:56.510067 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09118d2-b6ab-4e85-8b9e-16f8df5107be admin admin] RBAC: Authorizing `identity:delete_user(user_id=50c628027e2b45878fe96044681301d0)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:56.512027 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09118d2-b6ab-4e85-8b9e-16f8df5107be admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:56.575662 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-c09118d2-b6ab-4e85-8b9e-16f8df5107be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50c628027e2b45878fe96044681301d0'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:56.579210 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:29:56.614340 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-c09118d2-b6ab-4e85-8b9e-16f8df5107be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50c628027e2b45878fe96044681301d0'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:56.627312 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-c09118d2-b6ab-4e85-8b9e-16f8df5107be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50c628027e2b45878fe96044681301d0'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:56.628265 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-c09118d2-b6ab-4e85-8b9e-16f8df5107be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50c628027e2b45878fe96044681301d0'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:56.639931 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-c09118d2-b6ab-4e85-8b9e-16f8df5107be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50c628027e2b45878fe96044681301d0'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:56.649882 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1330/2653] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:29:56 2022] DELETE /identity/v3/users/50c628027e2b45878fe96044681301d0 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:29:56.654352 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0077f4c6-d125-4150-8e10-b8a394bf03a0 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:56.654851 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0077f4c6-d125-4150-8e10-b8a394bf03a0 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:56.654946 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0077f4c6-d125-4150-8e10-b8a394bf03a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:56.682505 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-0077f4c6-d125-4150-8e10-b8a394bf03a0 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:29:56.683754 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-0077f4c6-d125-4150-8e10-b8a394bf03a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:56.776190 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1324/2654] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:29:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:29:56.787154 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09118d2-b6ab-4e85-8b9e-16f8df5107be admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:56.789344 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-c09118d2-b6ab-4e85-8b9e-16f8df5107be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:56.912198 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09118d2-b6ab-4e85-8b9e-16f8df5107be admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:56.918224 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6457b99-9264-460d-8149-2daa52c3f277 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:56.918884 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6457b99-9264-460d-8149-2daa52c3f277 service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:56.919173 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6457b99-9264-460d-8149-2daa52c3f277 service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:56.919445 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6457b99-9264-460d-8149-2daa52c3f277 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:56.937727 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6457b99-9264-460d-8149-2daa52c3f277 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:56.939412 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6457b99-9264-460d-8149-2daa52c3f277 service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:56.964315 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1331/2655] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:29:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:29:57.325637 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0077f4c6-d125-4150-8e10-b8a394bf03a0 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:57.327488 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-0077f4c6-d125-4150-8e10-b8a394bf03a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:57.341392 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0077f4c6-d125-4150-8e10-b8a394bf03a0 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:57.347433 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8623e6d5-cb71-4c23-b22a-cda0b34ace9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:57.348389 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8623e6d5-cb71-4c23-b22a-cda0b34ace9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:57.348818 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8623e6d5-cb71-4c23-b22a-cda0b34ace9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:57.349188 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8623e6d5-cb71-4c23-b22a-cda0b34ace9d admin admin] PATH_INFO: `/v3/projects/4eb3dcc49a164fc087cc557a6cae6ffb` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:57.350462 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8623e6d5-cb71-4c23-b22a-cda0b34ace9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4eb3dcc49a164fc087cc557a6cae6ffb)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:57.352586 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8623e6d5-cb71-4c23-b22a-cda0b34ace9d admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:57.417313 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-8623e6d5-cb71-4c23-b22a-cda0b34ace9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4eb3dcc49a164fc087cc557a6cae6ffb', 'request_id': 'req-8623e6d5-cb71-4c23-b22a-cda0b34ace9d'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:57.426351 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-8623e6d5-cb71-4c23-b22a-cda0b34ace9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4eb3dcc49a164fc087cc557a6cae6ffb', 'request_id': 'req-8623e6d5-cb71-4c23-b22a-cda0b34ace9d'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:57.437564 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-8623e6d5-cb71-4c23-b22a-cda0b34ace9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4eb3dcc49a164fc087cc557a6cae6ffb', 'request_id': 'req-8623e6d5-cb71-4c23-b22a-cda0b34ace9d'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:57.476805 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-8623e6d5-cb71-4c23-b22a-cda0b34ace9d admin admin] The token cache is being invalidate because project 4eb3dcc49a164fc087cc557a6cae6ffb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:29:57.478313 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-8623e6d5-cb71-4c23-b22a-cda0b34ace9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:57.479204 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-8623e6d5-cb71-4c23-b22a-cda0b34ace9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:57.481177 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1325/2656] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:29:57 2022] DELETE /identity/v3/projects/4eb3dcc49a164fc087cc557a6cae6ffb => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:29:57.486448 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673eb6df-9abb-49cb-8901-b58d429bd163 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:57.487003 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673eb6df-9abb-49cb-8901-b58d429bd163 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:57.487111 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673eb6df-9abb-49cb-8901-b58d429bd163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:57.511221 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-673eb6df-9abb-49cb-8901-b58d429bd163 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:29:57.512508 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-673eb6df-9abb-49cb-8901-b58d429bd163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:57.615531 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1332/2657] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:29:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:29:57.625123 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2495b-b1b6-4f6f-aef5-0ec3b2a10d97 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:57.625511 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2495b-b1b6-4f6f-aef5-0ec3b2a10d97 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:57.625869 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2495b-b1b6-4f6f-aef5-0ec3b2a10d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:57.659333 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-07f2495b-b1b6-4f6f-aef5-0ec3b2a10d97 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:29:57.660864 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-07f2495b-b1b6-4f6f-aef5-0ec3b2a10d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:57.672677 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1326/2658] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:29:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:29:57.676880 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673eb6df-9abb-49cb-8901-b58d429bd163 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:57.687171 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673eb6df-9abb-49cb-8901-b58d429bd163 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:57.693435 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b9f32e-ead1-4a7f-98fc-12de11e437ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:57.693709 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b9f32e-ead1-4a7f-98fc-12de11e437ea admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:57.694028 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b9f32e-ead1-4a7f-98fc-12de11e437ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:57.694301 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b9f32e-ead1-4a7f-98fc-12de11e437ea admin admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:57.695023 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b9f32e-ead1-4a7f-98fc-12de11e437ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:29:57.696041 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b9f32e-ead1-4a7f-98fc-12de11e437ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:57.698290 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b9f32e-ead1-4a7f-98fc-12de11e437ea admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:57.720152 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1333/2659] 10.222.0.36 () {58 vars in 1153 bytes} [Tue Aug 9 10:29:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:29:57.725120 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f2495b-b1b6-4f6f-aef5-0ec3b2a10d97 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:57.736641 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f2495b-b1b6-4f6f-aef5-0ec3b2a10d97 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:57.754958 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6190b8bf-f86b-4107-ad2e-b9df0c672463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:57.755875 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6190b8bf-f86b-4107-ad2e-b9df0c672463 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:57.756394 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6190b8bf-f86b-4107-ad2e-b9df0c672463 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:57.756674 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6190b8bf-f86b-4107-ad2e-b9df0c672463 admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:57.757373 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6190b8bf-f86b-4107-ad2e-b9df0c672463 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:57.761274 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6190b8bf-f86b-4107-ad2e-b9df0c672463 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:57.846642 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1327/2660] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:29:57 2022] POST /identity/v3/projects => generated 371 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:29:57.848042 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b9f32e-ead1-4a7f-98fc-12de11e437ea admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:57.866434 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b9f32e-ead1-4a7f-98fc-12de11e437ea admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:58.016155 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:29:58.031414 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70efdd97-e6c5-429a-9bf0-c10ac8d46635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:58.032422 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70efdd97-e6c5-429a-9bf0-c10ac8d46635 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:58.032882 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70efdd97-e6c5-429a-9bf0-c10ac8d46635 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:58.033313 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70efdd97-e6c5-429a-9bf0-c10ac8d46635 admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:58.034962 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70efdd97-e6c5-429a-9bf0-c10ac8d46635 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:58.037909 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70efdd97-e6c5-429a-9bf0-c10ac8d46635 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:58.071297 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1334/2661] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:29:57 2022] POST /identity/v3/users => generated 286 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:29:58.076517 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6190b8bf-f86b-4107-ad2e-b9df0c672463 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:58.090924 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6190b8bf-f86b-4107-ad2e-b9df0c672463 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:58.098519 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3318a1-f6a7-47a5-ba93-37123480467f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:58.099364 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3318a1-f6a7-47a5-ba93-37123480467f admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:58.099807 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3318a1-f6a7-47a5-ba93-37123480467f admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:58.100150 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3318a1-f6a7-47a5-ba93-37123480467f admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:58.101053 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3318a1-f6a7-47a5-ba93-37123480467f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:58.104291 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3318a1-f6a7-47a5-ba93-37123480467f admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:58.121622 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1328/2662] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:29:58 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:29:58.126451 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70efdd97-e6c5-429a-9bf0-c10ac8d46635 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:58.141649 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70efdd97-e6c5-429a-9bf0-c10ac8d46635 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:58.147821 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f336ef-2808-418c-bd98-0f41a6508477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:58.149382 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f336ef-2808-418c-bd98-0f41a6508477 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:58.149770 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f336ef-2808-418c-bd98-0f41a6508477 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:58.150151 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f336ef-2808-418c-bd98-0f41a6508477 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:58.150933 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f336ef-2808-418c-bd98-0f41a6508477 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:58.153595 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f336ef-2808-418c-bd98-0f41a6508477 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:58.175302 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1335/2663] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:29:58 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:29:58.175778 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3318a1-f6a7-47a5-ba93-37123480467f admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:58.185814 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:29:58.194973 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3318a1-f6a7-47a5-ba93-37123480467f admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:58.200935 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec2b2e1-9751-4fc4-954d-f34e60c2f5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:58.201645 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf7d2f3-de29-4248-9f31-57323c11cf4a None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:58.201803 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec2b2e1-9751-4fc4-954d-f34e60c2f5f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:58.202253 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec2b2e1-9751-4fc4-954d-f34e60c2f5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:58.202622 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec2b2e1-9751-4fc4-954d-f34e60c2f5f9 admin admin] PATH_INFO: `/v3/projects/c2fd3608834e4e44a7e20a0cefdd2219/users/ed948ab0aaf54f829c12f230eab0cfe3/roles/a9895331e9694fa8b2b50908bb057bcb` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:58.202768 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf7d2f3-de29-4248-9f31-57323c11cf4a None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:58.203060 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf7d2f3-de29-4248-9f31-57323c11cf4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:58.226432 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec2b2e1-9751-4fc4-954d-f34e60c2f5f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2fd3608834e4e44a7e20a0cefdd2219, user_id=ed948ab0aaf54f829c12f230eab0cfe3, role_id=a9895331e9694fa8b2b50908bb057bcb)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:58.229406 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec2b2e1-9751-4fc4-954d-f34e60c2f5f9 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:58.244396 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-edf7d2f3-de29-4248-9f31-57323c11cf4a None None] MFA Rules not processed for user `aff294ffdd1e47e1841d07913c968c19`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:29:58.245631 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-edf7d2f3-de29-4248-9f31-57323c11cf4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:58.250759 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1329/2664] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:29:58 2022] PUT /identity/v3/projects/c2fd3608834e4e44a7e20a0cefdd2219/users/ed948ab0aaf54f829c12f230eab0cfe3/roles/a9895331e9694fa8b2b50908bb057bcb => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 10:29:58.262659 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c9f4f-fc11-40ba-a81c-bc59c896d5b8 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:58.263233 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c9f4f-fc11-40ba-a81c-bc59c896d5b8 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:58.263515 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c9f4f-fc11-40ba-a81c-bc59c896d5b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:58.296861 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-c16c9f4f-fc11-40ba-a81c-bc59c896d5b8 None None] MFA Rules not processed for user `ed948ab0aaf54f829c12f230eab0cfe3`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:29:58.298253 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-c16c9f4f-fc11-40ba-a81c-bc59c896d5b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:58.356662 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1336/2665] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:29:58 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:29:58.370573 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf7d2f3-de29-4248-9f31-57323c11cf4a None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:58.372088 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-edf7d2f3-de29-4248-9f31-57323c11cf4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:58.385468 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1330/2666] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:29:58 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:29:58.397495 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16c9f4f-fc11-40ba-a81c-bc59c896d5b8 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:58.399653 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-c16c9f4f-fc11-40ba-a81c-bc59c896d5b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:58.466811 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16c9f4f-fc11-40ba-a81c-bc59c896d5b8 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:58.469310 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf7d2f3-de29-4248-9f31-57323c11cf4a None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:58.470482 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd85f93-7a23-4896-8a01-72a59773e1b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6c687a38524de0bf23d87ae91d3b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:58.471229 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd85f93-7a23-4896-8a01-72a59773e1b6 service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:58.471504 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd85f93-7a23-4896-8a01-72a59773e1b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:58.471776 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd85f93-7a23-4896-8a01-72a59773e1b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:58.475281 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76b9367-8ec7-4d5c-92e0-359a7e1eda45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb863beaaa9f495c8b64655996c061f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:58.475878 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b9367-8ec7-4d5c-92e0-359a7e1eda45 service nova] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:58.476152 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b9367-8ec7-4d5c-92e0-359a7e1eda45 service nova] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:58.476418 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b9367-8ec7-4d5c-92e0-359a7e1eda45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:58.479043 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-d76b9367-8ec7-4d5c-92e0-359a7e1eda45 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:58.480715 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd85f93-7a23-4896-8a01-72a59773e1b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:58.482133 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd85f93-7a23-4896-8a01-72a59773e1b6 service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:58.492734 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1331/2667] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:29:58 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 10:29:58.520479 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd85f93-7a23-4896-8a01-72a59773e1b6 service cinder] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:58.551857 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76b9367-8ec7-4d5c-92e0-359a7e1eda45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:58.553555 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76b9367-8ec7-4d5c-92e0-359a7e1eda45 service nova] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:58.557438 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:29:58.567366 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1337/2668] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:29:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 10:29:58.595956 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd85f93-7a23-4896-8a01-72a59773e1b6 service cinder] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:58.601570 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae3a7db-0254-49e3-b2d7-05cc9f05ca72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:58.602515 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae3a7db-0254-49e3-b2d7-05cc9f05ca72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:58.602626 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae3a7db-0254-49e3-b2d7-05cc9f05ca72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:58.602978 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae3a7db-0254-49e3-b2d7-05cc9f05ca72 admin admin] PATH_INFO: `/v3/users/ed948ab0aaf54f829c12f230eab0cfe3` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:58.604207 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae3a7db-0254-49e3-b2d7-05cc9f05ca72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed948ab0aaf54f829c12f230eab0cfe3)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:58.606437 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae3a7db-0254-49e3-b2d7-05cc9f05ca72 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:58.624422 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:29:58.662976 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-bae3a7db-0254-49e3-b2d7-05cc9f05ca72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed948ab0aaf54f829c12f230eab0cfe3'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:58.675552 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-bae3a7db-0254-49e3-b2d7-05cc9f05ca72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed948ab0aaf54f829c12f230eab0cfe3'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:58.683026 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-bae3a7db-0254-49e3-b2d7-05cc9f05ca72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed948ab0aaf54f829c12f230eab0cfe3'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:58.683826 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-bae3a7db-0254-49e3-b2d7-05cc9f05ca72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed948ab0aaf54f829c12f230eab0cfe3'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:58.695268 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-bae3a7db-0254-49e3-b2d7-05cc9f05ca72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed948ab0aaf54f829c12f230eab0cfe3'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:58.703349 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1332/2669] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:29:58 2022] DELETE /identity/v3/users/ed948ab0aaf54f829c12f230eab0cfe3 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 10:29:58.708746 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcca970-ac1e-4a67-8582-b104c7ee168c None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:58.709098 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcca970-ac1e-4a67-8582-b104c7ee168c None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:58.709460 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcca970-ac1e-4a67-8582-b104c7ee168c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:58.734640 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-dfcca970-ac1e-4a67-8582-b104c7ee168c None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:29:58.735871 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-dfcca970-ac1e-4a67-8582-b104c7ee168c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:58.807428 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1338/2670] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:29:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 10:29:58.819247 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae3a7db-0254-49e3-b2d7-05cc9f05ca72 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:58.820760 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-bae3a7db-0254-49e3-b2d7-05cc9f05ca72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:58.879851 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae3a7db-0254-49e3-b2d7-05cc9f05ca72 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:58.883512 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50c314f-ecc2-4dcd-a97d-cf243b4df4dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:58.884152 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c314f-ecc2-4dcd-a97d-cf243b4df4dc service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:58.884428 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c314f-ecc2-4dcd-a97d-cf243b4df4dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:58.884695 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c314f-ecc2-4dcd-a97d-cf243b4df4dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:58.894897 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50c314f-ecc2-4dcd-a97d-cf243b4df4dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:58.896385 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50c314f-ecc2-4dcd-a97d-cf243b4df4dc service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:58.906993 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1333/2671] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:29:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:29:58.961947 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9dbcae-6ac0-48bd-a09b-e5d449fc1d57 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:58.962108 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9dbcae-6ac0-48bd-a09b-e5d449fc1d57 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:58.962378 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9dbcae-6ac0-48bd-a09b-e5d449fc1d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:58.983227 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-9a9dbcae-6ac0-48bd-a09b-e5d449fc1d57 None None] MFA Rules not processed for user `91866320797b424a9d7062ff028e015f`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:29:58.984442 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-9a9dbcae-6ac0-48bd-a09b-e5d449fc1d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:59.065412 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1339/2672] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:29:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:29:59.343795 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50c314f-ecc2-4dcd-a97d-cf243b4df4dc service neutron] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:59.345281 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-e50c314f-ecc2-4dcd-a97d-cf243b4df4dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:59.360812 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50c314f-ecc2-4dcd-a97d-cf243b4df4dc service neutron] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:59.366578 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd86a54-273b-493b-ab50-5a60cd2cd97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:59.367325 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd86a54-273b-493b-ab50-5a60cd2cd97a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:59.367680 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd86a54-273b-493b-ab50-5a60cd2cd97a admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:59.368016 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd86a54-273b-493b-ab50-5a60cd2cd97a admin admin] PATH_INFO: `/v3/projects/c2fd3608834e4e44a7e20a0cefdd2219` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:59.369316 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd86a54-273b-493b-ab50-5a60cd2cd97a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2fd3608834e4e44a7e20a0cefdd2219)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:59.371700 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd86a54-273b-493b-ab50-5a60cd2cd97a admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:59.430827 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-ebd86a54-273b-493b-ab50-5a60cd2cd97a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2fd3608834e4e44a7e20a0cefdd2219', 'request_id': 'req-ebd86a54-273b-493b-ab50-5a60cd2cd97a'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:59.437586 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-ebd86a54-273b-493b-ab50-5a60cd2cd97a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2fd3608834e4e44a7e20a0cefdd2219', 'request_id': 'req-ebd86a54-273b-493b-ab50-5a60cd2cd97a'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:59.446163 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-ebd86a54-273b-493b-ab50-5a60cd2cd97a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2fd3608834e4e44a7e20a0cefdd2219', 'request_id': 'req-ebd86a54-273b-493b-ab50-5a60cd2cd97a'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:59.461928 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-ebd86a54-273b-493b-ab50-5a60cd2cd97a admin admin] The token cache is being invalidate because project c2fd3608834e4e44a7e20a0cefdd2219 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:29:59.462284 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-ebd86a54-273b-493b-ab50-5a60cd2cd97a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:59.463017 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-ebd86a54-273b-493b-ab50-5a60cd2cd97a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:29:59.464640 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1334/2673] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:29:59 2022] DELETE /identity/v3/projects/c2fd3608834e4e44a7e20a0cefdd2219 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:29:59.469563 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bfd267-cb75-4237-a855-4125fd18608b None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:59.469950 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bfd267-cb75-4237-a855-4125fd18608b None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:59.470296 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bfd267-cb75-4237-a855-4125fd18608b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:59.505256 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-23bfd267-cb75-4237-a855-4125fd18608b None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:29:59.506419 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-23bfd267-cb75-4237-a855-4125fd18608b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:59.606811 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611385db-22c7-4c6b-8947-5ca29eb65a34 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:59.607016 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611385db-22c7-4c6b-8947-5ca29eb65a34 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:59.607201 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1340/2674] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:29:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:29:59.607625 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611385db-22c7-4c6b-8947-5ca29eb65a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:59.630549 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-611385db-22c7-4c6b-8947-5ca29eb65a34 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:29:59.631916 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-611385db-22c7-4c6b-8947-5ca29eb65a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:29:59.650244 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1335/2675] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:29:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:29:59.654258 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bfd267-cb75-4237-a855-4125fd18608b None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:59.669359 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bfd267-cb75-4237-a855-4125fd18608b None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:59.678000 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d59e1f-57cd-4c0f-a6d0-ed22c3dd60eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:59.678678 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d59e1f-57cd-4c0f-a6d0-ed22c3dd60eb admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:59.678954 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d59e1f-57cd-4c0f-a6d0-ed22c3dd60eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:59.679224 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d59e1f-57cd-4c0f-a6d0-ed22c3dd60eb admin admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:59.679870 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d59e1f-57cd-4c0f-a6d0-ed22c3dd60eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:29:59.680174 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d59e1f-57cd-4c0f-a6d0-ed22c3dd60eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:59.681864 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d59e1f-57cd-4c0f-a6d0-ed22c3dd60eb admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:59.697824 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1341/2676] 10.222.0.36 () {58 vars in 1153 bytes} [Tue Aug 9 10:29:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:29:59.702225 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611385db-22c7-4c6b-8947-5ca29eb65a34 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:59.716221 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611385db-22c7-4c6b-8947-5ca29eb65a34 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:59.722917 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b7aae-1083-47fd-a3cf-08d5e115a507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:59.723595 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b7aae-1083-47fd-a3cf-08d5e115a507 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:59.723973 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b7aae-1083-47fd-a3cf-08d5e115a507 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:59.724146 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b7aae-1083-47fd-a3cf-08d5e115a507 admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:59.724770 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76b7aae-1083-47fd-a3cf-08d5e115a507 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:59.727273 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76b7aae-1083-47fd-a3cf-08d5e115a507 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:29:59.736751 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:29:59.800013 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1336/2677] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:29:59 2022] POST /identity/v3/projects => generated 375 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 10:29:59.804020 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d59e1f-57cd-4c0f-a6d0-ed22c3dd60eb admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:29:59.821419 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d59e1f-57cd-4c0f-a6d0-ed22c3dd60eb admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:29:59.880538 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:29:59.974501 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e0dbcd-5a74-4c51-831c-4aa0d739c8bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:29:59.975121 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e0dbcd-5a74-4c51-831c-4aa0d739c8bd admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:29:59.975399 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e0dbcd-5a74-4c51-831c-4aa0d739c8bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:29:59.975669 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e0dbcd-5a74-4c51-831c-4aa0d739c8bd admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:29:59.976840 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e0dbcd-5a74-4c51-831c-4aa0d739c8bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:29:59.978849 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e0dbcd-5a74-4c51-831c-4aa0d739c8bd admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:00.014958 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1342/2678] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:29:59 2022] POST /identity/v3/users => generated 288 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:30:00.019668 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b7aae-1083-47fd-a3cf-08d5e115a507 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:00.035477 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b7aae-1083-47fd-a3cf-08d5e115a507 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:00.057581 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12137c4b-0913-4b6a-a865-bcf0a173acc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:00.058499 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12137c4b-0913-4b6a-a865-bcf0a173acc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:00.058935 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12137c4b-0913-4b6a-a865-bcf0a173acc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:00.059553 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12137c4b-0913-4b6a-a865-bcf0a173acc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:00.060481 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12137c4b-0913-4b6a-a865-bcf0a173acc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:00.064370 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12137c4b-0913-4b6a-a865-bcf0a173acc9 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:00.089911 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1337/2679] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:30:00 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:30:00.092763 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e0dbcd-5a74-4c51-831c-4aa0d739c8bd admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:00.107089 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e0dbcd-5a74-4c51-831c-4aa0d739c8bd admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:00.113575 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15689cd-4e35-4f2c-9340-20b54c9d3ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:00.114243 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15689cd-4e35-4f2c-9340-20b54c9d3ee4 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:00.114520 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15689cd-4e35-4f2c-9340-20b54c9d3ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:00.114769 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15689cd-4e35-4f2c-9340-20b54c9d3ee4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:00.115416 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15689cd-4e35-4f2c-9340-20b54c9d3ee4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:00.117777 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15689cd-4e35-4f2c-9340-20b54c9d3ee4 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:00.135033 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12137c4b-0913-4b6a-a865-bcf0a173acc9 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:00.142212 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1343/2680] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:30:00 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:30:00.148222 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12137c4b-0913-4b6a-a865-bcf0a173acc9 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:00.155615 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ebc57d-d176-48db-9ab7-1f069fa3f8e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:00.156912 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ebc57d-d176-48db-9ab7-1f069fa3f8e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:00.157290 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ebc57d-d176-48db-9ab7-1f069fa3f8e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:00.157625 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ebc57d-d176-48db-9ab7-1f069fa3f8e3 admin admin] PATH_INFO: `/v3/projects/ba67972819a84c798dcac83193ad43ac/users/b9368fac042d48b5b7e9fb697aa7502c/roles/a9895331e9694fa8b2b50908bb057bcb` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:00.177531 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ebc57d-d176-48db-9ab7-1f069fa3f8e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba67972819a84c798dcac83193ad43ac, user_id=b9368fac042d48b5b7e9fb697aa7502c, role_id=a9895331e9694fa8b2b50908bb057bcb)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:00.180196 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ebc57d-d176-48db-9ab7-1f069fa3f8e3 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:00.199489 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1338/2681] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:30:00 2022] PUT /identity/v3/projects/ba67972819a84c798dcac83193ad43ac/users/b9368fac042d48b5b7e9fb697aa7502c/roles/a9895331e9694fa8b2b50908bb057bcb => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:30:00.212000 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa26ee91-e1c1-4fad-b12f-c83fcd928113 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:00.212354 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa26ee91-e1c1-4fad-b12f-c83fcd928113 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:00.212626 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa26ee91-e1c1-4fad-b12f-c83fcd928113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:00.266971 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-fa26ee91-e1c1-4fad-b12f-c83fcd928113 None None] MFA Rules not processed for user `b9368fac042d48b5b7e9fb697aa7502c`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:30:00.269183 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-fa26ee91-e1c1-4fad-b12f-c83fcd928113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:30:00.365053 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1344/2682] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:30:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:30:00.373462 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ebc57d-d176-48db-9ab7-1f069fa3f8e3 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:00.377826 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-a0ebc57d-d176-48db-9ab7-1f069fa3f8e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:30:00.466743 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc69b9-7951-4e2e-a57c-3b6059f01bcd None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:00.467144 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc69b9-7951-4e2e-a57c-3b6059f01bcd None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:00.467453 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc69b9-7951-4e2e-a57c-3b6059f01bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:00.476300 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ebc57d-d176-48db-9ab7-1f069fa3f8e3 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:00.480525 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed9c6dd-432c-4ce9-b5c1-6c550e281ee5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6c687a38524de0bf23d87ae91d3b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:00.481184 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed9c6dd-432c-4ce9-b5c1-6c550e281ee5 service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:00.481467 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed9c6dd-432c-4ce9-b5c1-6c550e281ee5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:00.481733 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed9c6dd-432c-4ce9-b5c1-6c550e281ee5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:00.487840 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-d7cc69b9-7951-4e2e-a57c-3b6059f01bcd None None] MFA Rules not processed for user `7821ddf3db39402cbb243eef34829c45`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:30:00.489053 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-d7cc69b9-7951-4e2e-a57c-3b6059f01bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:30:00.494619 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed9c6dd-432c-4ce9-b5c1-6c550e281ee5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:00.496660 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed9c6dd-432c-4ce9-b5c1-6c550e281ee5 service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:00.510221 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1339/2683] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:30:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:30:00.564451 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1345/2684] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:30:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:30:10.504543 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=46,keystone:INSERT=2 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:30:10.555321 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=77,keystone:INSERT=3 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:30:11.138985 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed9c6dd-432c-4ce9-b5c1-6c550e281ee5 service cinder] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:11.203810 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed9c6dd-432c-4ce9-b5c1-6c550e281ee5 service cinder] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:11.208336 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188a6ede-092f-4cb9-92ff-dff3b7dfac78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:11.208947 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188a6ede-092f-4cb9-92ff-dff3b7dfac78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:11.209221 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188a6ede-092f-4cb9-92ff-dff3b7dfac78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:11.209488 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188a6ede-092f-4cb9-92ff-dff3b7dfac78 admin admin] PATH_INFO: `/v3/users/b9368fac042d48b5b7e9fb697aa7502c` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:11.210622 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188a6ede-092f-4cb9-92ff-dff3b7dfac78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9368fac042d48b5b7e9fb697aa7502c)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:11.212553 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188a6ede-092f-4cb9-92ff-dff3b7dfac78 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:11.262075 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-188a6ede-092f-4cb9-92ff-dff3b7dfac78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9368fac042d48b5b7e9fb697aa7502c'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:11.275995 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-188a6ede-092f-4cb9-92ff-dff3b7dfac78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9368fac042d48b5b7e9fb697aa7502c'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:11.284268 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-188a6ede-092f-4cb9-92ff-dff3b7dfac78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9368fac042d48b5b7e9fb697aa7502c'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:11.284861 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-188a6ede-092f-4cb9-92ff-dff3b7dfac78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9368fac042d48b5b7e9fb697aa7502c'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:11.293055 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-188a6ede-092f-4cb9-92ff-dff3b7dfac78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9368fac042d48b5b7e9fb697aa7502c'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:11.299024 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1340/2685] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:30:11 2022] DELETE /identity/v3/users/b9368fac042d48b5b7e9fb697aa7502c => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:30:11.303663 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9762c430-1329-42e4-8c69-73b142a0f6af None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:11.308041 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9762c430-1329-42e4-8c69-73b142a0f6af None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:11.308378 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9762c430-1329-42e4-8c69-73b142a0f6af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:11.331880 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-9762c430-1329-42e4-8c69-73b142a0f6af None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:30:11.333159 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-9762c430-1329-42e4-8c69-73b142a0f6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:30:11.412163 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1346/2686] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:30:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:30:11.421978 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188a6ede-092f-4cb9-92ff-dff3b7dfac78 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:11.423419 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-188a6ede-092f-4cb9-92ff-dff3b7dfac78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:30:11.488010 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188a6ede-092f-4cb9-92ff-dff3b7dfac78 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:11.495630 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a423789-5e77-4d34-b53f-153a337a1e1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:11.496282 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a423789-5e77-4d34-b53f-153a337a1e1b service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:11.496632 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a423789-5e77-4d34-b53f-153a337a1e1b service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:11.496947 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a423789-5e77-4d34-b53f-153a337a1e1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:11.508516 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a423789-5e77-4d34-b53f-153a337a1e1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:11.509996 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a423789-5e77-4d34-b53f-153a337a1e1b service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:11.527935 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1341/2687] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:30:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:30:12.051430 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9762c430-1329-42e4-8c69-73b142a0f6af None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:12.053070 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-9762c430-1329-42e4-8c69-73b142a0f6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:30:12.076139 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9762c430-1329-42e4-8c69-73b142a0f6af None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:12.082812 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e544420-c6a6-41ac-b52e-b930762ff47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:12.083666 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e544420-c6a6-41ac-b52e-b930762ff47e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:12.083950 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e544420-c6a6-41ac-b52e-b930762ff47e admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:12.084282 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e544420-c6a6-41ac-b52e-b930762ff47e admin admin] PATH_INFO: `/v3/projects/ba67972819a84c798dcac83193ad43ac` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:12.085579 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e544420-c6a6-41ac-b52e-b930762ff47e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba67972819a84c798dcac83193ad43ac)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:12.088046 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e544420-c6a6-41ac-b52e-b930762ff47e admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:12.157297 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-0e544420-c6a6-41ac-b52e-b930762ff47e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba67972819a84c798dcac83193ad43ac', 'request_id': 'req-0e544420-c6a6-41ac-b52e-b930762ff47e'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:12.163765 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-0e544420-c6a6-41ac-b52e-b930762ff47e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba67972819a84c798dcac83193ad43ac', 'request_id': 'req-0e544420-c6a6-41ac-b52e-b930762ff47e'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:12.172194 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-0e544420-c6a6-41ac-b52e-b930762ff47e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba67972819a84c798dcac83193ad43ac', 'request_id': 'req-0e544420-c6a6-41ac-b52e-b930762ff47e'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:12.188972 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-0e544420-c6a6-41ac-b52e-b930762ff47e admin admin] The token cache is being invalidate because project ba67972819a84c798dcac83193ad43ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80105) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:30:12.189381 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-0e544420-c6a6-41ac-b52e-b930762ff47e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:12.190053 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-0e544420-c6a6-41ac-b52e-b930762ff47e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:12.193954 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1347/2688] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:30:12 2022] DELETE /identity/v3/projects/ba67972819a84c798dcac83193ad43ac => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:30:14.938402 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a423789-5e77-4d34-b53f-153a337a1e1b service neutron] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:14.939895 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-5a423789-5e77-4d34-b53f-153a337a1e1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:30:14.951654 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a423789-5e77-4d34-b53f-153a337a1e1b service neutron] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:14.974044 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:30:15.008082 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3888e7-a03c-4c2d-8a3f-ee5576d6c638 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:15.008668 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3888e7-a03c-4c2d-8a3f-ee5576d6c638 service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:15.008944 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3888e7-a03c-4c2d-8a3f-ee5576d6c638 service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:15.009214 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3888e7-a03c-4c2d-8a3f-ee5576d6c638 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:15.010947 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-4f3888e7-a03c-4c2d-8a3f-ee5576d6c638 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:30:15.087214 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3888e7-a03c-4c2d-8a3f-ee5576d6c638 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:15.088662 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3888e7-a03c-4c2d-8a3f-ee5576d6c638 service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:15.099554 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1342/2689] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:30:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:30:15.849109 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c842a-2c43-44d7-9f56-acb770726a41 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:15.849625 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c842a-2c43-44d7-9f56-acb770726a41 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:15.849625 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c842a-2c43-44d7-9f56-acb770726a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:15.871371 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-788c842a-2c43-44d7-9f56-acb770726a41 None None] MFA Rules not processed for user `cedc4d6c59c44c6d8fb7179070db5e91`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:30:15.872601 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-788c842a-2c43-44d7-9f56-acb770726a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:30:15.988141 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1348/2690] 10.222.0.36 () {58 vars in 1009 bytes} [Tue Aug 9 10:30:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:30:15.993570 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3888e7-a03c-4c2d-8a3f-ee5576d6c638 service neutron] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:15.995080 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-4f3888e7-a03c-4c2d-8a3f-ee5576d6c638 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:30:16.113898 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3888e7-a03c-4c2d-8a3f-ee5576d6c638 service neutron] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:16.126407 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28561067-b5d2-4197-8807-3e9e01128227 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '841c5dbaae774944b637c533ebd75b29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:16.127378 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28561067-b5d2-4197-8807-3e9e01128227 service swift] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:16.127378 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28561067-b5d2-4197-8807-3e9e01128227 service swift] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:16.127762 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28561067-b5d2-4197-8807-3e9e01128227 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:16.139149 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28561067-b5d2-4197-8807-3e9e01128227 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:16.140712 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28561067-b5d2-4197-8807-3e9e01128227 service swift] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:16.151672 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1343/2691] 10.222.0.36 () {60 vars in 1384 bytes} [Tue Aug 9 10:30:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 09 10:30:20.209483 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788c842a-2c43-44d7-9f56-acb770726a41 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:20.211274 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-788c842a-2c43-44d7-9f56-acb770726a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:30:20.312145 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:30:20.323192 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28561067-b5d2-4197-8807-3e9e01128227 service swift] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:20.324842 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-28561067-b5d2-4197-8807-3e9e01128227 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:30:20.350613 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28561067-b5d2-4197-8807-3e9e01128227 service swift] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:20.357790 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10329853-e668-4e04-a502-4753ef822a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:20.359310 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10329853-e668-4e04-a502-4753ef822a45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:20.364054 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10329853-e668-4e04-a502-4753ef822a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:20.364542 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10329853-e668-4e04-a502-4753ef822a45 admin admin] PATH_INFO: `/v3/users/74925532a3b64d21b4e861ec70bc4345` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:20.368951 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10329853-e668-4e04-a502-4753ef822a45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74925532a3b64d21b4e861ec70bc4345)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:20.373648 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10329853-e668-4e04-a502-4753ef822a45 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:20.397990 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788c842a-2c43-44d7-9f56-acb770726a41 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:20.415733 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0ef1f6-ce9e-47e7-95d5-5ef816670733 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4d3b6a332394adf9e1b81ee9c171c48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:20.417552 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ef1f6-ce9e-47e7-95d5-5ef816670733 service placement] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:20.418804 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ef1f6-ce9e-47e7-95d5-5ef816670733 service placement] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:20.420333 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ef1f6-ce9e-47e7-95d5-5ef816670733 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:20.424629 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-fc0ef1f6-ce9e-47e7-95d5-5ef816670733 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:30:20.464307 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0ef1f6-ce9e-47e7-95d5-5ef816670733 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:20.466119 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0ef1f6-ce9e-47e7-95d5-5ef816670733 service placement] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:20.478990 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-10329853-e668-4e04-a502-4753ef822a45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74925532a3b64d21b4e861ec70bc4345'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:20.487715 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1349/2692] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:30:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:30:20.502361 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:30:20.512120 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-10329853-e668-4e04-a502-4753ef822a45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74925532a3b64d21b4e861ec70bc4345'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:20.524918 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-10329853-e668-4e04-a502-4753ef822a45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74925532a3b64d21b4e861ec70bc4345'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:20.526034 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-10329853-e668-4e04-a502-4753ef822a45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74925532a3b64d21b4e861ec70bc4345'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:20.537654 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-10329853-e668-4e04-a502-4753ef822a45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74925532a3b64d21b4e861ec70bc4345'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:20.545090 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1344/2693] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:30:20 2022] DELETE /identity/v3/users/74925532a3b64d21b4e861ec70bc4345 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:30:20.926953 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0ef1f6-ce9e-47e7-95d5-5ef816670733 service placement] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:20.967695 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0ef1f6-ce9e-47e7-95d5-5ef816670733 service placement] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:21.051891 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6fcba5-bd89-41a1-8d99-a7b0be60cc41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:21.052439 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6fcba5-bd89-41a1-8d99-a7b0be60cc41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:21.052727 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6fcba5-bd89-41a1-8d99-a7b0be60cc41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:21.053036 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6fcba5-bd89-41a1-8d99-a7b0be60cc41 admin admin] PATH_INFO: `/v3/projects/c3c303dd98424308a19f65b08ee35c91` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:21.054214 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6fcba5-bd89-41a1-8d99-a7b0be60cc41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3c303dd98424308a19f65b08ee35c91)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:21.056110 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6fcba5-bd89-41a1-8d99-a7b0be60cc41 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:21.117811 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-8a6fcba5-bd89-41a1-8d99-a7b0be60cc41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3c303dd98424308a19f65b08ee35c91', 'request_id': 'req-8a6fcba5-bd89-41a1-8d99-a7b0be60cc41'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:21.140037 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-8a6fcba5-bd89-41a1-8d99-a7b0be60cc41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3c303dd98424308a19f65b08ee35c91', 'request_id': 'req-8a6fcba5-bd89-41a1-8d99-a7b0be60cc41'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:21.149182 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-8a6fcba5-bd89-41a1-8d99-a7b0be60cc41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3c303dd98424308a19f65b08ee35c91', 'request_id': 'req-8a6fcba5-bd89-41a1-8d99-a7b0be60cc41'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:21.166377 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-8a6fcba5-bd89-41a1-8d99-a7b0be60cc41 admin admin] The token cache is being invalidate because project c3c303dd98424308a19f65b08ee35c91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80105) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:30:21.167036 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-8a6fcba5-bd89-41a1-8d99-a7b0be60cc41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:21.167888 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-8a6fcba5-bd89-41a1-8d99-a7b0be60cc41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:21.170078 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1350/2694] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:30:20 2022] DELETE /identity/v3/projects/c3c303dd98424308a19f65b08ee35c91 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:30:21.176150 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370e70d1-8d49-4c39-805e-0eb2cfe4e540 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:21.176435 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370e70d1-8d49-4c39-805e-0eb2cfe4e540 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:21.176699 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370e70d1-8d49-4c39-805e-0eb2cfe4e540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:21.218055 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-370e70d1-8d49-4c39-805e-0eb2cfe4e540 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:30:21.219573 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-370e70d1-8d49-4c39-805e-0eb2cfe4e540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:30:21.330344 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1345/2695] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:30:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 10:30:21.335024 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb39af-a0fe-46bd-9bd1-75d3499fff3d None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:21.335437 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb39af-a0fe-46bd-9bd1-75d3499fff3d None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:21.335603 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb39af-a0fe-46bd-9bd1-75d3499fff3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:21.362390 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-81eb39af-a0fe-46bd-9bd1-75d3499fff3d None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:30:21.363708 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-81eb39af-a0fe-46bd-9bd1-75d3499fff3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:30:21.373775 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1351/2696] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:30:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:30:21.376570 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370e70d1-8d49-4c39-805e-0eb2cfe4e540 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:21.390241 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370e70d1-8d49-4c39-805e-0eb2cfe4e540 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:21.397413 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4bd6d2-51be-4dbd-a8f7-7263a831c494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:21.399020 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4bd6d2-51be-4dbd-a8f7-7263a831c494 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:21.399951 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4bd6d2-51be-4dbd-a8f7-7263a831c494 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:21.400739 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4bd6d2-51be-4dbd-a8f7-7263a831c494 admin admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:21.401763 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4bd6d2-51be-4dbd-a8f7-7263a831c494 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:30:21.402234 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4bd6d2-51be-4dbd-a8f7-7263a831c494 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:21.404372 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4bd6d2-51be-4dbd-a8f7-7263a831c494 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:21.419476 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1346/2697] 10.222.0.36 () {58 vars in 1153 bytes} [Tue Aug 9 10:30:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:30:21.424614 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eb39af-a0fe-46bd-9bd1-75d3499fff3d None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:21.439178 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eb39af-a0fe-46bd-9bd1-75d3499fff3d None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:21.445753 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a06c16d-2086-4b6f-bb6b-ba450537a498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:21.446746 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a06c16d-2086-4b6f-bb6b-ba450537a498 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:21.447297 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a06c16d-2086-4b6f-bb6b-ba450537a498 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:21.447630 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a06c16d-2086-4b6f-bb6b-ba450537a498 admin admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:21.448484 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a06c16d-2086-4b6f-bb6b-ba450537a498 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:21.451125 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a06c16d-2086-4b6f-bb6b-ba450537a498 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:21.489392 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1352/2698] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:30:21 2022] POST /identity/v3/projects => generated 403 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:30:21.493503 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4bd6d2-51be-4dbd-a8f7-7263a831c494 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:21.504195 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4bd6d2-51be-4dbd-a8f7-7263a831c494 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:21.584337 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc0612c-d265-43a7-bd4b-7665565dd0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:21.585232 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc0612c-d265-43a7-bd4b-7665565dd0ed admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:21.585693 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc0612c-d265-43a7-bd4b-7665565dd0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:21.586244 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc0612c-d265-43a7-bd4b-7665565dd0ed admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:21.586999 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc0612c-d265-43a7-bd4b-7665565dd0ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:21.589776 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc0612c-d265-43a7-bd4b-7665565dd0ed admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:21.621995 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1347/2699] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:30:21 2022] POST /identity/v3/users => generated 302 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:30:21.623598 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a06c16d-2086-4b6f-bb6b-ba450537a498 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:21.644525 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a06c16d-2086-4b6f-bb6b-ba450537a498 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:21.649968 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c17b9b-c3b0-4d97-96bd-56883fa4875e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:21.650580 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c17b9b-c3b0-4d97-96bd-56883fa4875e admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:21.650865 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c17b9b-c3b0-4d97-96bd-56883fa4875e admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:21.651137 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c17b9b-c3b0-4d97-96bd-56883fa4875e admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:21.651781 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c17b9b-c3b0-4d97-96bd-56883fa4875e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:21.653379 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c17b9b-c3b0-4d97-96bd-56883fa4875e admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:21.668256 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1353/2700] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:30:21 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:30:21.670449 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc0612c-d265-43a7-bd4b-7665565dd0ed admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:21.687508 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc0612c-d265-43a7-bd4b-7665565dd0ed admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:21.694312 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a279b55e-558f-4321-b185-12f50c4b8ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:21.695172 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a279b55e-558f-4321-b185-12f50c4b8ee7 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:21.695647 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a279b55e-558f-4321-b185-12f50c4b8ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:21.696113 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a279b55e-558f-4321-b185-12f50c4b8ee7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:21.696981 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a279b55e-558f-4321-b185-12f50c4b8ee7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:21.698926 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a279b55e-558f-4321-b185-12f50c4b8ee7 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:21.716526 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1348/2701] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:30:21 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:30:21.719638 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c17b9b-c3b0-4d97-96bd-56883fa4875e admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:21.733878 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c17b9b-c3b0-4d97-96bd-56883fa4875e admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:21.740988 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af75fc71-b0b8-4781-b67a-5f80fc20eb15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:21.741914 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af75fc71-b0b8-4781-b67a-5f80fc20eb15 admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:21.748836 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af75fc71-b0b8-4781-b67a-5f80fc20eb15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:21.750110 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af75fc71-b0b8-4781-b67a-5f80fc20eb15 admin admin] PATH_INFO: `/v3/projects/591a9048d66042ae89834755cbaa9584/users/5e43b2577e3e4f9bbfd804c130f54271/roles/a9895331e9694fa8b2b50908bb057bcb` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:21.759841 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:30:21.787146 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af75fc71-b0b8-4781-b67a-5f80fc20eb15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=591a9048d66042ae89834755cbaa9584, user_id=5e43b2577e3e4f9bbfd804c130f54271, role_id=a9895331e9694fa8b2b50908bb057bcb)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:21.790288 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af75fc71-b0b8-4781-b67a-5f80fc20eb15 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:21.816983 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1354/2702] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:30:21 2022] PUT /identity/v3/projects/591a9048d66042ae89834755cbaa9584/users/5e43b2577e3e4f9bbfd804c130f54271/roles/a9895331e9694fa8b2b50908bb057bcb => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:30:21.829086 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb9c62-6e74-4ec0-82ad-19da5c065ba2 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:21.829888 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb9c62-6e74-4ec0-82ad-19da5c065ba2 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:21.829888 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb9c62-6e74-4ec0-82ad-19da5c065ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:21.884987 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-53fb9c62-6e74-4ec0-82ad-19da5c065ba2 None None] MFA Rules not processed for user `5e43b2577e3e4f9bbfd804c130f54271`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:30:21.886292 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-53fb9c62-6e74-4ec0-82ad-19da5c065ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:30:21.940381 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:30:21.992320 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1349/2703] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:30:21 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:30:21.996109 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af75fc71-b0b8-4781-b67a-5f80fc20eb15 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:22.117707 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af75fc71-b0b8-4781-b67a-5f80fc20eb15 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:22.122839 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e366fd-597b-451f-80f6-7c74c6601232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:22.123457 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e366fd-597b-451f-80f6-7c74c6601232 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:22.123733 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e366fd-597b-451f-80f6-7c74c6601232 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:22.124000 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e366fd-597b-451f-80f6-7c74c6601232 admin admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:22.124622 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e366fd-597b-451f-80f6-7c74c6601232 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:22.127666 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e366fd-597b-451f-80f6-7c74c6601232 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:22.163830 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1355/2704] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:30:21 2022] POST /identity/v3/projects => generated 405 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:30:22.164975 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fb9c62-6e74-4ec0-82ad-19da5c065ba2 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:22.187041 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fb9c62-6e74-4ec0-82ad-19da5c065ba2 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:22.262754 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189f88ac-244d-48e4-b692-b0cb46388a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:22.263406 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f88ac-244d-48e4-b692-b0cb46388a06 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:22.263679 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f88ac-244d-48e4-b692-b0cb46388a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:22.264272 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f88ac-244d-48e4-b692-b0cb46388a06 admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:22.264817 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189f88ac-244d-48e4-b692-b0cb46388a06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:22.268233 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189f88ac-244d-48e4-b692-b0cb46388a06 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:22.308772 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1350/2705] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:30:22 2022] POST /identity/v3/users => generated 309 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 10:30:22.312120 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e366fd-597b-451f-80f6-7c74c6601232 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:22.325397 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e366fd-597b-451f-80f6-7c74c6601232 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:22.338207 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6ab8cd-7933-46e3-b7ec-dc1d5c2fee6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:22.339297 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6ab8cd-7933-46e3-b7ec-dc1d5c2fee6f admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:22.339587 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6ab8cd-7933-46e3-b7ec-dc1d5c2fee6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:22.339853 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6ab8cd-7933-46e3-b7ec-dc1d5c2fee6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:22.340975 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6ab8cd-7933-46e3-b7ec-dc1d5c2fee6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:22.342685 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6ab8cd-7933-46e3-b7ec-dc1d5c2fee6f admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:22.365384 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189f88ac-244d-48e4-b692-b0cb46388a06 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:22.365909 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1356/2706] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:30:22 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:30:22.378567 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189f88ac-244d-48e4-b692-b0cb46388a06 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:22.386664 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f91d3d-46b7-4253-bcac-f27e66634ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:22.387371 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f91d3d-46b7-4253-bcac-f27e66634ec0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:22.387744 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f91d3d-46b7-4253-bcac-f27e66634ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:22.388057 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f91d3d-46b7-4253-bcac-f27e66634ec0 admin admin] PATH_INFO: `/v3/projects/8f35fe57f44c4231ae9c791bc2d834ed/users/01839f653e8f4ecf92c2955a9e072406/roles/89ca30cbbb634be8a96e9921aa56626b` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:22.414168 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f91d3d-46b7-4253-bcac-f27e66634ec0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f35fe57f44c4231ae9c791bc2d834ed, user_id=01839f653e8f4ecf92c2955a9e072406, role_id=89ca30cbbb634be8a96e9921aa56626b)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:22.416314 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f91d3d-46b7-4253-bcac-f27e66634ec0 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:22.432573 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1351/2707] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:30:22 2022] PUT /identity/v3/projects/8f35fe57f44c4231ae9c791bc2d834ed/users/01839f653e8f4ecf92c2955a9e072406/roles/89ca30cbbb634be8a96e9921aa56626b => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:30:22.436309 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6ab8cd-7933-46e3-b7ec-dc1d5c2fee6f admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:22.447997 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6ab8cd-7933-46e3-b7ec-dc1d5c2fee6f admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:22.542584 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a6ed5c-e1e8-4dec-98c2-bf209597588d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:22.543425 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a6ed5c-e1e8-4dec-98c2-bf209597588d admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:22.543782 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a6ed5c-e1e8-4dec-98c2-bf209597588d admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:22.544040 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a6ed5c-e1e8-4dec-98c2-bf209597588d admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:22.544814 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a6ed5c-e1e8-4dec-98c2-bf209597588d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:22.547088 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a6ed5c-e1e8-4dec-98c2-bf209597588d admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:22.560837 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1357/2708] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:30:22 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:30:22.564907 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f91d3d-46b7-4253-bcac-f27e66634ec0 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:22.580334 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f91d3d-46b7-4253-bcac-f27e66634ec0 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:22.591987 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1417edc4-45d0-42fa-ab74-7886cb314e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:22.592904 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1417edc4-45d0-42fa-ab74-7886cb314e65 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:22.593362 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1417edc4-45d0-42fa-ab74-7886cb314e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:22.593730 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1417edc4-45d0-42fa-ab74-7886cb314e65 admin admin] PATH_INFO: `/v3/projects/8f35fe57f44c4231ae9c791bc2d834ed/users/01839f653e8f4ecf92c2955a9e072406/roles/89ca30cbbb634be8a96e9921aa56626b` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:22.597136 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1417edc4-45d0-42fa-ab74-7886cb314e65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f35fe57f44c4231ae9c791bc2d834ed, user_id=01839f653e8f4ecf92c2955a9e072406, role_id=89ca30cbbb634be8a96e9921aa56626b)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:22.600165 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1417edc4-45d0-42fa-ab74-7886cb314e65 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:22.617855 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1352/2709] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:30:22 2022] PUT /identity/v3/projects/8f35fe57f44c4231ae9c791bc2d834ed/users/01839f653e8f4ecf92c2955a9e072406/roles/89ca30cbbb634be8a96e9921aa56626b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:30:22.628699 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f5b7f-abc0-4150-9115-9b50fe99b2f4 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:22.629231 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f5b7f-abc0-4150-9115-9b50fe99b2f4 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:22.629571 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f5b7f-abc0-4150-9115-9b50fe99b2f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:22.665009 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-5d6f5b7f-abc0-4150-9115-9b50fe99b2f4 None None] MFA Rules not processed for user `01839f653e8f4ecf92c2955a9e072406`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:30:22.666286 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-5d6f5b7f-abc0-4150-9115-9b50fe99b2f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:30:22.731324 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:30:22.762475 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1358/2710] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:30:22 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:30:22.774950 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1417edc4-45d0-42fa-ab74-7886cb314e65 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:22.776821 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-1417edc4-45d0-42fa-ab74-7886cb314e65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:30:22.842368 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1417edc4-45d0-42fa-ab74-7886cb314e65 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:22.847003 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c27ae9-10e3-4e16-9744-37994d42308e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6c687a38524de0bf23d87ae91d3b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:22.847693 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c27ae9-10e3-4e16-9744-37994d42308e service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:22.848039 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c27ae9-10e3-4e16-9744-37994d42308e service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:22.848401 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c27ae9-10e3-4e16-9744-37994d42308e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:22.859715 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c27ae9-10e3-4e16-9744-37994d42308e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:22.861431 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c27ae9-10e3-4e16-9744-37994d42308e service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:22.873536 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1353/2711] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:30:22 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 10:30:23.065344 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f5b7f-abc0-4150-9115-9b50fe99b2f4 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:23.146345 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f5b7f-abc0-4150-9115-9b50fe99b2f4 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:23.154506 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fa90c4-154e-488a-99c9-76c18a7d2d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:23.155216 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fa90c4-154e-488a-99c9-76c18a7d2d21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:23.155659 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fa90c4-154e-488a-99c9-76c18a7d2d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:23.155936 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fa90c4-154e-488a-99c9-76c18a7d2d21 admin admin] PATH_INFO: `/v3/users/5e43b2577e3e4f9bbfd804c130f54271` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:23.157669 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fa90c4-154e-488a-99c9-76c18a7d2d21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e43b2577e3e4f9bbfd804c130f54271)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:23.160543 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fa90c4-154e-488a-99c9-76c18a7d2d21 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:23.249319 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-37fa90c4-154e-488a-99c9-76c18a7d2d21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e43b2577e3e4f9bbfd804c130f54271'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:23.265378 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-37fa90c4-154e-488a-99c9-76c18a7d2d21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e43b2577e3e4f9bbfd804c130f54271'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:23.275823 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-37fa90c4-154e-488a-99c9-76c18a7d2d21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e43b2577e3e4f9bbfd804c130f54271'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:23.275823 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-37fa90c4-154e-488a-99c9-76c18a7d2d21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e43b2577e3e4f9bbfd804c130f54271'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:23.285025 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-37fa90c4-154e-488a-99c9-76c18a7d2d21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e43b2577e3e4f9bbfd804c130f54271'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:23.291914 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1359/2712] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:30:23 2022] DELETE /identity/v3/users/5e43b2577e3e4f9bbfd804c130f54271 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:30:23.296402 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f5fa7-8093-4b49-b676-bc0e454acd9b None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:23.296684 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f5fa7-8093-4b49-b676-bc0e454acd9b None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:23.296958 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f5fa7-8093-4b49-b676-bc0e454acd9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:23.321411 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-972f5fa7-8093-4b49-b676-bc0e454acd9b None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:30:23.331797 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-972f5fa7-8093-4b49-b676-bc0e454acd9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:30:23.353450 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:30:23.413454 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1354/2713] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:30:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:30:23.424522 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fa90c4-154e-488a-99c9-76c18a7d2d21 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:23.426794 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-37fa90c4-154e-488a-99c9-76c18a7d2d21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:30:23.512412 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fa90c4-154e-488a-99c9-76c18a7d2d21 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:23.517199 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c563df19-23ce-43bc-a464-955cd6e33e10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:23.518261 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c563df19-23ce-43bc-a464-955cd6e33e10 service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:23.518641 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c563df19-23ce-43bc-a464-955cd6e33e10 service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:23.519007 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c563df19-23ce-43bc-a464-955cd6e33e10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:23.533467 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c563df19-23ce-43bc-a464-955cd6e33e10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:23.535258 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c563df19-23ce-43bc-a464-955cd6e33e10 service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:23.546829 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1360/2714] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:30:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:30:24.046342 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972f5fa7-8093-4b49-b676-bc0e454acd9b None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:24.049053 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-972f5fa7-8093-4b49-b676-bc0e454acd9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:30:24.065547 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972f5fa7-8093-4b49-b676-bc0e454acd9b None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:24.070459 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcea2a6a-137c-4da7-91b7-746f839281c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:24.071095 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea2a6a-137c-4da7-91b7-746f839281c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:24.071371 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea2a6a-137c-4da7-91b7-746f839281c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:24.071661 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea2a6a-137c-4da7-91b7-746f839281c2 admin admin] PATH_INFO: `/v3/projects/591a9048d66042ae89834755cbaa9584` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:24.072906 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcea2a6a-137c-4da7-91b7-746f839281c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=591a9048d66042ae89834755cbaa9584)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:24.074971 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcea2a6a-137c-4da7-91b7-746f839281c2 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:24.172035 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-dcea2a6a-137c-4da7-91b7-746f839281c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '591a9048d66042ae89834755cbaa9584', 'request_id': 'req-dcea2a6a-137c-4da7-91b7-746f839281c2'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:24.179990 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-dcea2a6a-137c-4da7-91b7-746f839281c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '591a9048d66042ae89834755cbaa9584', 'request_id': 'req-dcea2a6a-137c-4da7-91b7-746f839281c2'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:24.187664 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-dcea2a6a-137c-4da7-91b7-746f839281c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '591a9048d66042ae89834755cbaa9584', 'request_id': 'req-dcea2a6a-137c-4da7-91b7-746f839281c2'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:24.205946 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-dcea2a6a-137c-4da7-91b7-746f839281c2 admin admin] The token cache is being invalidate because project 591a9048d66042ae89834755cbaa9584 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:30:24.206415 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-dcea2a6a-137c-4da7-91b7-746f839281c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:24.207725 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-dcea2a6a-137c-4da7-91b7-746f839281c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:24.209881 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1355/2715] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:30:24 2022] DELETE /identity/v3/projects/591a9048d66042ae89834755cbaa9584 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:30:24.215512 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c563df19-23ce-43bc-a464-955cd6e33e10 service neutron] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:24.223695 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:30:24.236387 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c563df19-23ce-43bc-a464-955cd6e33e10 service neutron] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:24.334037 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22664bdb-4f79-49b0-b335-06cd8d7cd044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:24.336450 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22664bdb-4f79-49b0-b335-06cd8d7cd044 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:24.336450 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22664bdb-4f79-49b0-b335-06cd8d7cd044 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:24.336834 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22664bdb-4f79-49b0-b335-06cd8d7cd044 admin admin] PATH_INFO: `/v3/users/01839f653e8f4ecf92c2955a9e072406` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:24.338354 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22664bdb-4f79-49b0-b335-06cd8d7cd044 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01839f653e8f4ecf92c2955a9e072406)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:24.342906 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22664bdb-4f79-49b0-b335-06cd8d7cd044 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:24.407311 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-22664bdb-4f79-49b0-b335-06cd8d7cd044 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01839f653e8f4ecf92c2955a9e072406'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:24.420810 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-22664bdb-4f79-49b0-b335-06cd8d7cd044 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01839f653e8f4ecf92c2955a9e072406'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:24.430792 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-22664bdb-4f79-49b0-b335-06cd8d7cd044 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01839f653e8f4ecf92c2955a9e072406'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:24.433038 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-22664bdb-4f79-49b0-b335-06cd8d7cd044 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01839f653e8f4ecf92c2955a9e072406'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:24.444970 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-22664bdb-4f79-49b0-b335-06cd8d7cd044 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01839f653e8f4ecf92c2955a9e072406'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:24.457987 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1361/2716] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:30:24 2022] DELETE /identity/v3/users/01839f653e8f4ecf92c2955a9e072406 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:30:24.801131 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcea2a6a-137c-4da7-91b7-746f839281c2 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:24.802692 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-dcea2a6a-137c-4da7-91b7-746f839281c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:30:24.835039 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcea2a6a-137c-4da7-91b7-746f839281c2 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:24.905914 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c42958-eae8-4b3a-906a-5da400bd7d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:24.906927 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c42958-eae8-4b3a-906a-5da400bd7d79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:24.907240 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c42958-eae8-4b3a-906a-5da400bd7d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:24.907799 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c42958-eae8-4b3a-906a-5da400bd7d79 admin admin] PATH_INFO: `/v3/projects/8f35fe57f44c4231ae9c791bc2d834ed` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:24.908960 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c42958-eae8-4b3a-906a-5da400bd7d79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f35fe57f44c4231ae9c791bc2d834ed)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:24.910893 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c42958-eae8-4b3a-906a-5da400bd7d79 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:24.964778 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-88c42958-eae8-4b3a-906a-5da400bd7d79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f35fe57f44c4231ae9c791bc2d834ed', 'request_id': 'req-88c42958-eae8-4b3a-906a-5da400bd7d79'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:24.966388 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:30:24.974455 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-88c42958-eae8-4b3a-906a-5da400bd7d79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f35fe57f44c4231ae9c791bc2d834ed', 'request_id': 'req-88c42958-eae8-4b3a-906a-5da400bd7d79'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:24.983818 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-88c42958-eae8-4b3a-906a-5da400bd7d79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f35fe57f44c4231ae9c791bc2d834ed', 'request_id': 'req-88c42958-eae8-4b3a-906a-5da400bd7d79'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:24.999789 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-88c42958-eae8-4b3a-906a-5da400bd7d79 admin admin] The token cache is being invalidate because project 8f35fe57f44c4231ae9c791bc2d834ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:30:25.000331 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-88c42958-eae8-4b3a-906a-5da400bd7d79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:25.001345 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-88c42958-eae8-4b3a-906a-5da400bd7d79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:25.003715 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1356/2717] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:30:24 2022] DELETE /identity/v3/projects/8f35fe57f44c4231ae9c791bc2d834ed => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:30:25.009290 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd649600-d647-4f80-931f-5b13a5800d27 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:25.009795 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd649600-d647-4f80-931f-5b13a5800d27 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:25.010254 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd649600-d647-4f80-931f-5b13a5800d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:25.035572 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-bd649600-d647-4f80-931f-5b13a5800d27 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:30:25.036853 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-bd649600-d647-4f80-931f-5b13a5800d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:30:25.115396 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1362/2718] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:30:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:30:25.124376 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c90cbd8-57d3-489e-bb85-aa5a1b21243e None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:25.124937 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c90cbd8-57d3-489e-bb85-aa5a1b21243e None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:25.125374 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c90cbd8-57d3-489e-bb85-aa5a1b21243e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:25.159536 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-5c90cbd8-57d3-489e-bb85-aa5a1b21243e None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:30:25.160971 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-5c90cbd8-57d3-489e-bb85-aa5a1b21243e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:30:25.170989 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1357/2719] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:30:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 10:30:25.175448 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd649600-d647-4f80-931f-5b13a5800d27 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:25.186728 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd649600-d647-4f80-931f-5b13a5800d27 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:25.193715 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a873b93-e6c0-4976-885e-7e341dbb2cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:25.194595 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a873b93-e6c0-4976-885e-7e341dbb2cd3 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:25.195418 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a873b93-e6c0-4976-885e-7e341dbb2cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:25.195876 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a873b93-e6c0-4976-885e-7e341dbb2cd3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:25.196678 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a873b93-e6c0-4976-885e-7e341dbb2cd3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:30:25.197936 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a873b93-e6c0-4976-885e-7e341dbb2cd3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:25.199010 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a873b93-e6c0-4976-885e-7e341dbb2cd3 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:25.223443 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c90cbd8-57d3-489e-bb85-aa5a1b21243e None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:25.224191 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1363/2720] 10.222.0.36 () {58 vars in 1153 bytes} [Tue Aug 9 10:30:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:30:25.234116 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c90cbd8-57d3-489e-bb85-aa5a1b21243e None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:25.239608 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b56b0d2-21f3-47f4-bc88-bc0975c36761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:25.240449 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b56b0d2-21f3-47f4-bc88-bc0975c36761 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:25.240795 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b56b0d2-21f3-47f4-bc88-bc0975c36761 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:25.241133 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b56b0d2-21f3-47f4-bc88-bc0975c36761 admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:25.241761 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b56b0d2-21f3-47f4-bc88-bc0975c36761 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:25.243694 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b56b0d2-21f3-47f4-bc88-bc0975c36761 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:25.278799 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1358/2721] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:30:25 2022] POST /identity/v3/projects => generated 393 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 10:30:25.283835 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a873b93-e6c0-4976-885e-7e341dbb2cd3 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:25.303419 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a873b93-e6c0-4976-885e-7e341dbb2cd3 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:25.310600 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:30:25.391513 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba497629-1513-46ba-bb9f-d7a287415b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:25.392158 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba497629-1513-46ba-bb9f-d7a287415b6d admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:25.392441 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba497629-1513-46ba-bb9f-d7a287415b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:25.392763 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba497629-1513-46ba-bb9f-d7a287415b6d admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:25.393411 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba497629-1513-46ba-bb9f-d7a287415b6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:25.395362 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba497629-1513-46ba-bb9f-d7a287415b6d admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:25.422669 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1364/2722] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:30:25 2022] POST /identity/v3/users => generated 297 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:30:25.427213 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b56b0d2-21f3-47f4-bc88-bc0975c36761 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:25.437866 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b56b0d2-21f3-47f4-bc88-bc0975c36761 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:25.443479 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc58439-3692-4710-bdbb-024d28f43246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:25.444149 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc58439-3692-4710-bdbb-024d28f43246 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:25.444428 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc58439-3692-4710-bdbb-024d28f43246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:25.444700 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc58439-3692-4710-bdbb-024d28f43246 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:25.445337 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc58439-3692-4710-bdbb-024d28f43246 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:25.447188 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc58439-3692-4710-bdbb-024d28f43246 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:25.458919 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1359/2723] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:30:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:30:25.462960 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba497629-1513-46ba-bb9f-d7a287415b6d admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:25.475915 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba497629-1513-46ba-bb9f-d7a287415b6d admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:25.481185 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4519a7-ca63-449c-9288-d232cb7f1161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:25.481973 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4519a7-ca63-449c-9288-d232cb7f1161 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:25.482339 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4519a7-ca63-449c-9288-d232cb7f1161 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:25.482714 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4519a7-ca63-449c-9288-d232cb7f1161 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:25.483497 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4519a7-ca63-449c-9288-d232cb7f1161 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:25.485156 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4519a7-ca63-449c-9288-d232cb7f1161 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:25.497898 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1365/2724] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:30:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:30:25.502733 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc58439-3692-4710-bdbb-024d28f43246 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:25.523691 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc58439-3692-4710-bdbb-024d28f43246 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:25.529048 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce9399e-0b63-410b-aa6d-69f151a92bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:25.529918 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce9399e-0b63-410b-aa6d-69f151a92bce admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:25.530203 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce9399e-0b63-410b-aa6d-69f151a92bce admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:25.530476 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce9399e-0b63-410b-aa6d-69f151a92bce admin admin] PATH_INFO: `/v3/projects/e24299322a6a4606b4252d2085cdc841/users/98a24305b60342ce9bbd5547c6650f69/roles/a9895331e9694fa8b2b50908bb057bcb` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:25.547717 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce9399e-0b63-410b-aa6d-69f151a92bce admin admin] RBAC: Authorizing `identity:create_grant(project_id=e24299322a6a4606b4252d2085cdc841, user_id=98a24305b60342ce9bbd5547c6650f69, role_id=a9895331e9694fa8b2b50908bb057bcb)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:25.551075 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce9399e-0b63-410b-aa6d-69f151a92bce admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:25.567623 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1360/2725] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:30:25 2022] PUT /identity/v3/projects/e24299322a6a4606b4252d2085cdc841/users/98a24305b60342ce9bbd5547c6650f69/roles/a9895331e9694fa8b2b50908bb057bcb => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:30:25.578354 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d867f-f11f-4ebf-bed9-cca3688595e9 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:25.578771 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d867f-f11f-4ebf-bed9-cca3688595e9 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:25.579264 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d867f-f11f-4ebf-bed9-cca3688595e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:25.609412 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-485d867f-f11f-4ebf-bed9-cca3688595e9 None None] MFA Rules not processed for user `98a24305b60342ce9bbd5547c6650f69`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:30:25.611439 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-485d867f-f11f-4ebf-bed9-cca3688595e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:30:25.704978 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1366/2726] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:30:25 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 10:30:25.709010 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce9399e-0b63-410b-aa6d-69f151a92bce admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:25.816691 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce9399e-0b63-410b-aa6d-69f151a92bce admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:25.823604 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd71232b-acdb-45c4-b691-fd8f2bf2367c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:25.824370 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd71232b-acdb-45c4-b691-fd8f2bf2367c admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:25.824911 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd71232b-acdb-45c4-b691-fd8f2bf2367c admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:25.825274 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd71232b-acdb-45c4-b691-fd8f2bf2367c admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:25.826116 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd71232b-acdb-45c4-b691-fd8f2bf2367c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:25.828810 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd71232b-acdb-45c4-b691-fd8f2bf2367c admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:25.872706 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1361/2727] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:30:25 2022] POST /identity/v3/projects => generated 393 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:30:25.877872 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485d867f-f11f-4ebf-bed9-cca3688595e9 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:25.897249 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485d867f-f11f-4ebf-bed9-cca3688595e9 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:25.993296 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f088e367-5b69-48cc-9586-1ce189c14015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:25.994043 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f088e367-5b69-48cc-9586-1ce189c14015 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:25.994401 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f088e367-5b69-48cc-9586-1ce189c14015 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:25.994751 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f088e367-5b69-48cc-9586-1ce189c14015 admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:25.995447 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f088e367-5b69-48cc-9586-1ce189c14015 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:25.997447 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f088e367-5b69-48cc-9586-1ce189c14015 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:26.028118 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1367/2728] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:30:25 2022] POST /identity/v3/users => generated 303 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:30:26.032060 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd71232b-acdb-45c4-b691-fd8f2bf2367c admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:26.044109 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd71232b-acdb-45c4-b691-fd8f2bf2367c admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:26.054120 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0531ff94-591e-4420-8e22-e64fe0b6a009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:26.055003 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531ff94-591e-4420-8e22-e64fe0b6a009 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:26.056319 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531ff94-591e-4420-8e22-e64fe0b6a009 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:26.059440 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531ff94-591e-4420-8e22-e64fe0b6a009 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:26.060851 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0531ff94-591e-4420-8e22-e64fe0b6a009 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:26.064508 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0531ff94-591e-4420-8e22-e64fe0b6a009 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:26.079356 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1362/2729] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:30:26 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:30:26.084210 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f088e367-5b69-48cc-9586-1ce189c14015 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:26.101625 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f088e367-5b69-48cc-9586-1ce189c14015 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:26.107184 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01820008-f7f9-438a-8d50-194c0f3cfa9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:26.107921 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01820008-f7f9-438a-8d50-194c0f3cfa9b admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:26.108268 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01820008-f7f9-438a-8d50-194c0f3cfa9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:26.108536 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01820008-f7f9-438a-8d50-194c0f3cfa9b admin admin] PATH_INFO: `/v3/projects/3d3b14181009483e924320b5abab3e4f/users/8561c6605e3b4edfaf2e8e5ba7f0f850/roles/89ca30cbbb634be8a96e9921aa56626b` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:26.111582 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:30:26.145174 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01820008-f7f9-438a-8d50-194c0f3cfa9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d3b14181009483e924320b5abab3e4f, user_id=8561c6605e3b4edfaf2e8e5ba7f0f850, role_id=89ca30cbbb634be8a96e9921aa56626b)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:26.148083 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01820008-f7f9-438a-8d50-194c0f3cfa9b admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:26.171310 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1368/2730] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:30:26 2022] PUT /identity/v3/projects/3d3b14181009483e924320b5abab3e4f/users/8561c6605e3b4edfaf2e8e5ba7f0f850/roles/89ca30cbbb634be8a96e9921aa56626b => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 10:30:26.175689 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0531ff94-591e-4420-8e22-e64fe0b6a009 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:26.194828 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0531ff94-591e-4420-8e22-e64fe0b6a009 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:26.299500 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:30:26.325096 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7604542b-800e-4190-8df5-57f220a729b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:26.325913 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7604542b-800e-4190-8df5-57f220a729b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:26.326300 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7604542b-800e-4190-8df5-57f220a729b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:26.326695 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7604542b-800e-4190-8df5-57f220a729b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:26.327460 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7604542b-800e-4190-8df5-57f220a729b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:26.329827 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7604542b-800e-4190-8df5-57f220a729b1 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:26.353713 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1363/2731] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:30:26 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:30:26.355521 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01820008-f7f9-438a-8d50-194c0f3cfa9b admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:26.378577 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01820008-f7f9-438a-8d50-194c0f3cfa9b admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:26.391312 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc0e8c7-07c7-47ed-9197-16961739f1b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:26.392032 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc0e8c7-07c7-47ed-9197-16961739f1b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:26.392311 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc0e8c7-07c7-47ed-9197-16961739f1b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:26.392582 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc0e8c7-07c7-47ed-9197-16961739f1b5 admin admin] PATH_INFO: `/v3/projects/3d3b14181009483e924320b5abab3e4f/users/8561c6605e3b4edfaf2e8e5ba7f0f850/roles/89ca30cbbb634be8a96e9921aa56626b` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:26.398828 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc0e8c7-07c7-47ed-9197-16961739f1b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d3b14181009483e924320b5abab3e4f, user_id=8561c6605e3b4edfaf2e8e5ba7f0f850, role_id=89ca30cbbb634be8a96e9921aa56626b)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:26.402067 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc0e8c7-07c7-47ed-9197-16961739f1b5 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:26.431349 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1369/2732] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:30:26 2022] PUT /identity/v3/projects/3d3b14181009483e924320b5abab3e4f/users/8561c6605e3b4edfaf2e8e5ba7f0f850/roles/89ca30cbbb634be8a96e9921aa56626b => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:30:26.434110 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05308d89-2faa-4366-aa61-14a458f53d71 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:26.434577 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05308d89-2faa-4366-aa61-14a458f53d71 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:26.435158 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05308d89-2faa-4366-aa61-14a458f53d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:26.480083 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-05308d89-2faa-4366-aa61-14a458f53d71 None None] MFA Rules not processed for user `8561c6605e3b4edfaf2e8e5ba7f0f850`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:30:26.481328 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-05308d89-2faa-4366-aa61-14a458f53d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:30:26.566144 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1364/2733] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:30:26 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:30:26.574421 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc0e8c7-07c7-47ed-9197-16961739f1b5 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:26.576270 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-1fc0e8c7-07c7-47ed-9197-16961739f1b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:30:26.644770 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc0e8c7-07c7-47ed-9197-16961739f1b5 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:26.650794 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06661fd5-8a02-4060-bd7f-0242ba7950c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6c687a38524de0bf23d87ae91d3b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:26.651399 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06661fd5-8a02-4060-bd7f-0242ba7950c0 service cinder] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:26.651675 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06661fd5-8a02-4060-bd7f-0242ba7950c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:26.651962 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06661fd5-8a02-4060-bd7f-0242ba7950c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:26.662530 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06661fd5-8a02-4060-bd7f-0242ba7950c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:26.664093 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06661fd5-8a02-4060-bd7f-0242ba7950c0 service cinder] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:26.677797 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1370/2734] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:30:26 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:30:26.732076 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05308d89-2faa-4366-aa61-14a458f53d71 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:26.733569 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-05308d89-2faa-4366-aa61-14a458f53d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:30:26.746740 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05308d89-2faa-4366-aa61-14a458f53d71 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:26.752452 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea1d110-b4ec-4e44-a89d-142e7638372d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6c687a38524de0bf23d87ae91d3b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:26.753070 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea1d110-b4ec-4e44-a89d-142e7638372d service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:26.753336 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea1d110-b4ec-4e44-a89d-142e7638372d service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:26.753671 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea1d110-b4ec-4e44-a89d-142e7638372d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:26.821283 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea1d110-b4ec-4e44-a89d-142e7638372d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:26.823320 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea1d110-b4ec-4e44-a89d-142e7638372d service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:26.834034 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1365/2735] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:30:26 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:30:27.879598 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06661fd5-8a02-4060-bd7f-0242ba7950c0 service cinder] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:27.881180 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-06661fd5-8a02-4060-bd7f-0242ba7950c0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:30:27.959908 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06661fd5-8a02-4060-bd7f-0242ba7950c0 service cinder] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:27.965578 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf836398-af02-456f-bff5-0079bbbee7f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:27.966338 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf836398-af02-456f-bff5-0079bbbee7f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:27.966756 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf836398-af02-456f-bff5-0079bbbee7f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:27.967164 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf836398-af02-456f-bff5-0079bbbee7f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:27.971187 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-bf836398-af02-456f-bff5-0079bbbee7f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:30:28.059538 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf836398-af02-456f-bff5-0079bbbee7f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:28.061038 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf836398-af02-456f-bff5-0079bbbee7f2 service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:28.071589 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1371/2736] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:30:27 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:30:30.546959 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea1d110-b4ec-4e44-a89d-142e7638372d service cinder] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:30.548582 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-2ea1d110-b4ec-4e44-a89d-142e7638372d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:30:30.697145 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea1d110-b4ec-4e44-a89d-142e7638372d service cinder] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:30.727619 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eb7060-5061-49b7-9076-7829f2aea187 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb863beaaa9f495c8b64655996c061f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:30.728278 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb7060-5061-49b7-9076-7829f2aea187 service nova] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:30.728575 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb7060-5061-49b7-9076-7829f2aea187 service nova] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:30.728838 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb7060-5061-49b7-9076-7829f2aea187 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:30.736347 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-a4eb7060-5061-49b7-9076-7829f2aea187 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:30:30.753099 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:30:30.762465 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eb7060-5061-49b7-9076-7829f2aea187 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:30.764112 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eb7060-5061-49b7-9076-7829f2aea187 service nova] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:30.787113 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1366/2737] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:30:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:30:30.976972 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf836398-af02-456f-bff5-0079bbbee7f2 service neutron] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:31.032049 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:30:31.154390 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf836398-af02-456f-bff5-0079bbbee7f2 service neutron] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:31.172800 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c567764-1070-47d0-8963-caa1ed212100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:31.173550 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c567764-1070-47d0-8963-caa1ed212100 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:31.173872 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c567764-1070-47d0-8963-caa1ed212100 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:31.174194 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c567764-1070-47d0-8963-caa1ed212100 admin admin] PATH_INFO: `/v3/users/98a24305b60342ce9bbd5547c6650f69` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:31.175370 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c567764-1070-47d0-8963-caa1ed212100 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98a24305b60342ce9bbd5547c6650f69)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:31.177663 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c567764-1070-47d0-8963-caa1ed212100 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:31.274877 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-8c567764-1070-47d0-8963-caa1ed212100 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98a24305b60342ce9bbd5547c6650f69'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:31.292100 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-8c567764-1070-47d0-8963-caa1ed212100 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98a24305b60342ce9bbd5547c6650f69'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:31.303271 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-8c567764-1070-47d0-8963-caa1ed212100 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98a24305b60342ce9bbd5547c6650f69'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:31.304029 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-8c567764-1070-47d0-8963-caa1ed212100 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98a24305b60342ce9bbd5547c6650f69'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:31.317675 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-8c567764-1070-47d0-8963-caa1ed212100 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98a24305b60342ce9bbd5547c6650f69'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:31.333539 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1372/2738] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:30:30 2022] DELETE /identity/v3/users/98a24305b60342ce9bbd5547c6650f69 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:30:31.335265 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf865619-71e7-4da8-8389-f9bf08f90875 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:31.338066 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf865619-71e7-4da8-8389-f9bf08f90875 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:31.338066 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf865619-71e7-4da8-8389-f9bf08f90875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:31.385097 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-cf865619-71e7-4da8-8389-f9bf08f90875 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:30:31.388814 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-cf865619-71e7-4da8-8389-f9bf08f90875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:30:31.513551 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1367/2739] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:30:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:30:31.522253 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c567764-1070-47d0-8963-caa1ed212100 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:31.523794 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-8c567764-1070-47d0-8963-caa1ed212100 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:30:31.686780 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c567764-1070-47d0-8963-caa1ed212100 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:31.693718 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0aa8bb-8929-46d2-b4e4-875e412109cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:31.695007 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0aa8bb-8929-46d2-b4e4-875e412109cf service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:31.695771 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0aa8bb-8929-46d2-b4e4-875e412109cf service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:31.696371 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0aa8bb-8929-46d2-b4e4-875e412109cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:31.709975 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0aa8bb-8929-46d2-b4e4-875e412109cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:31.711948 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0aa8bb-8929-46d2-b4e4-875e412109cf service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:31.746841 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1373/2740] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:30:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:30:32.122849 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf865619-71e7-4da8-8389-f9bf08f90875 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:32.134996 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-cf865619-71e7-4da8-8389-f9bf08f90875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:30:32.161572 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf865619-71e7-4da8-8389-f9bf08f90875 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:32.167153 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f0a85b-b10a-4563-9793-cd409b6323dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:32.167799 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f0a85b-b10a-4563-9793-cd409b6323dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:32.170854 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f0a85b-b10a-4563-9793-cd409b6323dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:32.171339 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f0a85b-b10a-4563-9793-cd409b6323dc admin admin] PATH_INFO: `/v3/projects/e24299322a6a4606b4252d2085cdc841` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:32.179326 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f0a85b-b10a-4563-9793-cd409b6323dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=e24299322a6a4606b4252d2085cdc841)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:32.181624 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f0a85b-b10a-4563-9793-cd409b6323dc admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:32.267394 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-f7f0a85b-b10a-4563-9793-cd409b6323dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e24299322a6a4606b4252d2085cdc841', 'request_id': 'req-f7f0a85b-b10a-4563-9793-cd409b6323dc'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:32.276384 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-f7f0a85b-b10a-4563-9793-cd409b6323dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e24299322a6a4606b4252d2085cdc841', 'request_id': 'req-f7f0a85b-b10a-4563-9793-cd409b6323dc'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:32.288049 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-f7f0a85b-b10a-4563-9793-cd409b6323dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e24299322a6a4606b4252d2085cdc841', 'request_id': 'req-f7f0a85b-b10a-4563-9793-cd409b6323dc'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:32.331005 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-f7f0a85b-b10a-4563-9793-cd409b6323dc admin admin] The token cache is being invalidate because project e24299322a6a4606b4252d2085cdc841 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:30:32.331328 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-f7f0a85b-b10a-4563-9793-cd409b6323dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:32.333171 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-f7f0a85b-b10a-4563-9793-cd409b6323dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:32.335331 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1368/2741] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:30:32 2022] DELETE /identity/v3/projects/e24299322a6a4606b4252d2085cdc841 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:30:32.339336 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0aa8bb-8929-46d2-b4e4-875e412109cf service neutron] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:32.359157 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0aa8bb-8929-46d2-b4e4-875e412109cf service neutron] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:32.440320 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:30:32.476172 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308ab5c4-24c3-42e5-90cf-d808b0904329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:32.477265 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ab5c4-24c3-42e5-90cf-d808b0904329 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:32.477629 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ab5c4-24c3-42e5-90cf-d808b0904329 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:32.478108 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ab5c4-24c3-42e5-90cf-d808b0904329 admin admin] PATH_INFO: `/v3/users/8561c6605e3b4edfaf2e8e5ba7f0f850` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:32.479891 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308ab5c4-24c3-42e5-90cf-d808b0904329 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8561c6605e3b4edfaf2e8e5ba7f0f850)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:32.482541 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308ab5c4-24c3-42e5-90cf-d808b0904329 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:32.556396 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-308ab5c4-24c3-42e5-90cf-d808b0904329 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8561c6605e3b4edfaf2e8e5ba7f0f850'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:32.573186 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-308ab5c4-24c3-42e5-90cf-d808b0904329 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8561c6605e3b4edfaf2e8e5ba7f0f850'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:32.585768 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-308ab5c4-24c3-42e5-90cf-d808b0904329 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8561c6605e3b4edfaf2e8e5ba7f0f850'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:32.586592 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-308ab5c4-24c3-42e5-90cf-d808b0904329 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8561c6605e3b4edfaf2e8e5ba7f0f850'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:32.598330 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-308ab5c4-24c3-42e5-90cf-d808b0904329 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8561c6605e3b4edfaf2e8e5ba7f0f850'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:32.619415 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1374/2742] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:30:32 2022] DELETE /identity/v3/users/8561c6605e3b4edfaf2e8e5ba7f0f850 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:30:32.994217 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f0a85b-b10a-4563-9793-cd409b6323dc admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:32.996643 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-f7f0a85b-b10a-4563-9793-cd409b6323dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:30:33.041130 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f0a85b-b10a-4563-9793-cd409b6323dc admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:33.127593 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e13803-4003-4d8b-8b73-30c2ca499e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:33.128846 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e13803-4003-4d8b-8b73-30c2ca499e29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:33.129137 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e13803-4003-4d8b-8b73-30c2ca499e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:33.129413 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e13803-4003-4d8b-8b73-30c2ca499e29 admin admin] PATH_INFO: `/v3/projects/3d3b14181009483e924320b5abab3e4f` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:33.130834 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e13803-4003-4d8b-8b73-30c2ca499e29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d3b14181009483e924320b5abab3e4f)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:33.133087 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e13803-4003-4d8b-8b73-30c2ca499e29 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:33.162787 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:30:33.203440 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-f2e13803-4003-4d8b-8b73-30c2ca499e29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d3b14181009483e924320b5abab3e4f', 'request_id': 'req-f2e13803-4003-4d8b-8b73-30c2ca499e29'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:33.211733 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-f2e13803-4003-4d8b-8b73-30c2ca499e29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d3b14181009483e924320b5abab3e4f', 'request_id': 'req-f2e13803-4003-4d8b-8b73-30c2ca499e29'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:33.225241 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-f2e13803-4003-4d8b-8b73-30c2ca499e29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d3b14181009483e924320b5abab3e4f', 'request_id': 'req-f2e13803-4003-4d8b-8b73-30c2ca499e29'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:33.255427 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-f2e13803-4003-4d8b-8b73-30c2ca499e29 admin admin] The token cache is being invalidate because project 3d3b14181009483e924320b5abab3e4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:30:33.255894 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-f2e13803-4003-4d8b-8b73-30c2ca499e29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:33.256668 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-f2e13803-4003-4d8b-8b73-30c2ca499e29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:33.258687 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1369/2743] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:30:32 2022] DELETE /identity/v3/projects/3d3b14181009483e924320b5abab3e4f => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:30:33.263716 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c091a5e-5492-4f4b-9708-61b35aa3762d None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:33.264579 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c091a5e-5492-4f4b-9708-61b35aa3762d None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:33.264864 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c091a5e-5492-4f4b-9708-61b35aa3762d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:33.295987 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-3c091a5e-5492-4f4b-9708-61b35aa3762d None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:30:33.298792 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-3c091a5e-5492-4f4b-9708-61b35aa3762d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:30:33.404009 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1375/2744] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:30:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:30:33.404709 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12661db6-5235-46c1-bf9e-d040a4ad7c3f None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:33.404709 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12661db6-5235-46c1-bf9e-d040a4ad7c3f None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:33.404901 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12661db6-5235-46c1-bf9e-d040a4ad7c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:33.436721 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-12661db6-5235-46c1-bf9e-d040a4ad7c3f None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:30:33.437949 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-12661db6-5235-46c1-bf9e-d040a4ad7c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:30:33.451257 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1370/2745] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:30:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:30:33.458529 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c091a5e-5492-4f4b-9708-61b35aa3762d None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:33.477456 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c091a5e-5492-4f4b-9708-61b35aa3762d None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:33.497062 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699c7ed9-5766-4a6d-8109-5cb2024f047b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:33.497695 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699c7ed9-5766-4a6d-8109-5cb2024f047b admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:33.498012 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699c7ed9-5766-4a6d-8109-5cb2024f047b admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:33.498286 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699c7ed9-5766-4a6d-8109-5cb2024f047b admin admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:33.498952 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699c7ed9-5766-4a6d-8109-5cb2024f047b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:30:33.499253 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699c7ed9-5766-4a6d-8109-5cb2024f047b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:33.504273 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699c7ed9-5766-4a6d-8109-5cb2024f047b admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:33.527573 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1376/2746] 10.222.0.36 () {58 vars in 1153 bytes} [Tue Aug 9 10:30:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:30:33.534592 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12661db6-5235-46c1-bf9e-d040a4ad7c3f None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:33.545758 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12661db6-5235-46c1-bf9e-d040a4ad7c3f None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:33.558146 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f793091-636e-4ebd-a935-0c96566268e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:33.559141 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f793091-636e-4ebd-a935-0c96566268e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:33.559524 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f793091-636e-4ebd-a935-0c96566268e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:33.559901 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f793091-636e-4ebd-a935-0c96566268e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:33.560818 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f793091-636e-4ebd-a935-0c96566268e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:33.565420 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f793091-636e-4ebd-a935-0c96566268e6 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:33.614665 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1371/2747] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:30:33 2022] POST /identity/v3/projects => generated 401 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:30:33.615819 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699c7ed9-5766-4a6d-8109-5cb2024f047b admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:33.629381 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699c7ed9-5766-4a6d-8109-5cb2024f047b admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:33.693442 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:30:33.713548 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22fc4e4-ac31-4f79-b87c-6281b66ae9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:33.714784 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22fc4e4-ac31-4f79-b87c-6281b66ae9c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:33.715467 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22fc4e4-ac31-4f79-b87c-6281b66ae9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:33.715916 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22fc4e4-ac31-4f79-b87c-6281b66ae9c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:33.716802 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22fc4e4-ac31-4f79-b87c-6281b66ae9c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:33.718950 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22fc4e4-ac31-4f79-b87c-6281b66ae9c0 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:33.749896 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1377/2748] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:30:33 2022] POST /identity/v3/users => generated 301 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 10:30:33.752178 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f793091-636e-4ebd-a935-0c96566268e6 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:33.766503 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f793091-636e-4ebd-a935-0c96566268e6 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:33.772231 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc72a7f-74db-4615-ae65-b0e51480699b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:33.772874 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc72a7f-74db-4615-ae65-b0e51480699b admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:33.773442 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc72a7f-74db-4615-ae65-b0e51480699b admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:33.773754 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc72a7f-74db-4615-ae65-b0e51480699b admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:33.774473 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc72a7f-74db-4615-ae65-b0e51480699b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:33.776185 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc72a7f-74db-4615-ae65-b0e51480699b admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:33.793297 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1372/2749] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:30:33 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:30:33.797085 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22fc4e4-ac31-4f79-b87c-6281b66ae9c0 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:33.812874 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22fc4e4-ac31-4f79-b87c-6281b66ae9c0 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:33.823612 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e155fe-ddeb-4731-9a2e-c1a48d4bb005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:33.823612 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e155fe-ddeb-4731-9a2e-c1a48d4bb005 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:33.823612 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e155fe-ddeb-4731-9a2e-c1a48d4bb005 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:33.823612 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e155fe-ddeb-4731-9a2e-c1a48d4bb005 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:33.826449 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e155fe-ddeb-4731-9a2e-c1a48d4bb005 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:33.826449 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e155fe-ddeb-4731-9a2e-c1a48d4bb005 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:33.842649 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1378/2750] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:30:33 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:30:33.847415 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc72a7f-74db-4615-ae65-b0e51480699b admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:33.858673 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc72a7f-74db-4615-ae65-b0e51480699b admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:33.866561 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d58ae14-1faa-4bd4-8092-263f14484d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:33.867306 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d58ae14-1faa-4bd4-8092-263f14484d6d admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:33.867692 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d58ae14-1faa-4bd4-8092-263f14484d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:33.867969 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d58ae14-1faa-4bd4-8092-263f14484d6d admin admin] PATH_INFO: `/v3/projects/81b0ba7e7f5940faa003a92b25d5c458/users/312cc3ff8ace43b79e2c04eef2746250/roles/a9895331e9694fa8b2b50908bb057bcb` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:33.893902 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d58ae14-1faa-4bd4-8092-263f14484d6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=81b0ba7e7f5940faa003a92b25d5c458, user_id=312cc3ff8ace43b79e2c04eef2746250, role_id=a9895331e9694fa8b2b50908bb057bcb)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:33.894519 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d58ae14-1faa-4bd4-8092-263f14484d6d admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:33.931375 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1373/2751] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:30:33 2022] PUT /identity/v3/projects/81b0ba7e7f5940faa003a92b25d5c458/users/312cc3ff8ace43b79e2c04eef2746250/roles/a9895331e9694fa8b2b50908bb057bcb => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:30:33.933545 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8a995e-5a2d-4fe9-a4e2-9c11fab25419 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:33.933828 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8a995e-5a2d-4fe9-a4e2-9c11fab25419 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:33.934481 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8a995e-5a2d-4fe9-a4e2-9c11fab25419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:33.981575 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-9d8a995e-5a2d-4fe9-a4e2-9c11fab25419 None None] MFA Rules not processed for user `312cc3ff8ace43b79e2c04eef2746250`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:30:33.982856 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-9d8a995e-5a2d-4fe9-a4e2-9c11fab25419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:30:34.076370 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1379/2752] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:30:33 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 10:30:34.081073 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d58ae14-1faa-4bd4-8092-263f14484d6d admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:34.183317 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d58ae14-1faa-4bd4-8092-263f14484d6d admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:34.189542 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2ab97a-7d26-4fd9-8c1c-436b5c26996c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:34.190510 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ab97a-7d26-4fd9-8c1c-436b5c26996c admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:34.194273 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ab97a-7d26-4fd9-8c1c-436b5c26996c admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:34.194554 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ab97a-7d26-4fd9-8c1c-436b5c26996c admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:34.195201 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2ab97a-7d26-4fd9-8c1c-436b5c26996c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:34.197389 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2ab97a-7d26-4fd9-8c1c-436b5c26996c admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:34.234724 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1374/2753] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:30:34 2022] POST /identity/v3/projects => generated 401 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:30:34.244401 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8a995e-5a2d-4fe9-a4e2-9c11fab25419 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:34.257827 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8a995e-5a2d-4fe9-a4e2-9c11fab25419 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:34.367657 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580e3cbd-36bb-4486-b618-49f3791d725f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:34.368289 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580e3cbd-36bb-4486-b618-49f3791d725f admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:34.368570 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580e3cbd-36bb-4486-b618-49f3791d725f admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:34.368907 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580e3cbd-36bb-4486-b618-49f3791d725f admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:34.371008 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580e3cbd-36bb-4486-b618-49f3791d725f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:34.374316 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580e3cbd-36bb-4486-b618-49f3791d725f admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:34.413040 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2ab97a-7d26-4fd9-8c1c-436b5c26996c admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:34.418764 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1380/2754] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:30:34 2022] POST /identity/v3/users => generated 307 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:30:34.425262 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2ab97a-7d26-4fd9-8c1c-436b5c26996c admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:34.433914 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e0e98b-7755-4696-b96c-541bed9ede0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:34.435177 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e0e98b-7755-4696-b96c-541bed9ede0b admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:34.435779 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e0e98b-7755-4696-b96c-541bed9ede0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:34.436417 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e0e98b-7755-4696-b96c-541bed9ede0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:34.437574 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e0e98b-7755-4696-b96c-541bed9ede0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:34.439779 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e0e98b-7755-4696-b96c-541bed9ede0b admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:34.460680 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1375/2755] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:30:34 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:30:34.463015 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580e3cbd-36bb-4486-b618-49f3791d725f admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:34.479027 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580e3cbd-36bb-4486-b618-49f3791d725f admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:34.490907 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2db013-8705-46b4-9ba9-d9ce34949d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:34.493407 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2db013-8705-46b4-9ba9-d9ce34949d09 admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:34.493910 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2db013-8705-46b4-9ba9-d9ce34949d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:34.494318 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2db013-8705-46b4-9ba9-d9ce34949d09 admin admin] PATH_INFO: `/v3/projects/761a62e2dcd24693a6418d4819660f92/users/26838fdb4e364c7d9e493a0a18f9657b/roles/89ca30cbbb634be8a96e9921aa56626b` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:34.512010 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2db013-8705-46b4-9ba9-d9ce34949d09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=761a62e2dcd24693a6418d4819660f92, user_id=26838fdb4e364c7d9e493a0a18f9657b, role_id=89ca30cbbb634be8a96e9921aa56626b)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:34.516963 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2db013-8705-46b4-9ba9-d9ce34949d09 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:34.534607 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1381/2756] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:30:34 2022] PUT /identity/v3/projects/761a62e2dcd24693a6418d4819660f92/users/26838fdb4e364c7d9e493a0a18f9657b/roles/89ca30cbbb634be8a96e9921aa56626b => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 10:30:34.538530 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e0e98b-7755-4696-b96c-541bed9ede0b admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:34.558658 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e0e98b-7755-4696-b96c-541bed9ede0b admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:34.583497 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:30:34.670046 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c6d562-d8f0-49ff-85ab-66a0559053e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:34.670903 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c6d562-d8f0-49ff-85ab-66a0559053e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:34.671187 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c6d562-d8f0-49ff-85ab-66a0559053e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:34.671583 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c6d562-d8f0-49ff-85ab-66a0559053e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:34.674083 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c6d562-d8f0-49ff-85ab-66a0559053e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:34.676385 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c6d562-d8f0-49ff-85ab-66a0559053e8 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:34.700231 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2db013-8705-46b4-9ba9-d9ce34949d09 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:34.700707 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1376/2757] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:30:34 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:30:34.713656 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2db013-8705-46b4-9ba9-d9ce34949d09 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:34.723512 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f63555f-2d4c-40ed-b810-1feb7382a0a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:34.724195 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63555f-2d4c-40ed-b810-1feb7382a0a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:34.724500 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63555f-2d4c-40ed-b810-1feb7382a0a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:34.724748 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63555f-2d4c-40ed-b810-1feb7382a0a8 admin admin] PATH_INFO: `/v3/projects/761a62e2dcd24693a6418d4819660f92/users/26838fdb4e364c7d9e493a0a18f9657b/roles/89ca30cbbb634be8a96e9921aa56626b` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:34.727139 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f63555f-2d4c-40ed-b810-1feb7382a0a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=761a62e2dcd24693a6418d4819660f92, user_id=26838fdb4e364c7d9e493a0a18f9657b, role_id=89ca30cbbb634be8a96e9921aa56626b)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:34.731553 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f63555f-2d4c-40ed-b810-1feb7382a0a8 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:34.747105 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1382/2758] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:30:34 2022] PUT /identity/v3/projects/761a62e2dcd24693a6418d4819660f92/users/26838fdb4e364c7d9e493a0a18f9657b/roles/89ca30cbbb634be8a96e9921aa56626b => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:30:34.760308 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cffb72-db49-40e7-9e43-609fcba1e64c None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:34.761488 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cffb72-db49-40e7-9e43-609fcba1e64c None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:34.761488 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cffb72-db49-40e7-9e43-609fcba1e64c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:34.796576 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-d1cffb72-db49-40e7-9e43-609fcba1e64c None None] MFA Rules not processed for user `26838fdb4e364c7d9e493a0a18f9657b`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:30:34.798401 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-d1cffb72-db49-40e7-9e43-609fcba1e64c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:30:34.904896 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1377/2759] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:30:34 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:30:34.919085 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f63555f-2d4c-40ed-b810-1feb7382a0a8 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:34.922092 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-2f63555f-2d4c-40ed-b810-1feb7382a0a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:30:34.946764 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:30:35.012361 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f63555f-2d4c-40ed-b810-1feb7382a0a8 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:35.019132 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5957906e-06f2-4424-8bc2-1126592fcdd3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6c687a38524de0bf23d87ae91d3b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:35.019781 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5957906e-06f2-4424-8bc2-1126592fcdd3 service cinder] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:35.020062 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5957906e-06f2-4424-8bc2-1126592fcdd3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:35.020410 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5957906e-06f2-4424-8bc2-1126592fcdd3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:35.033032 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5957906e-06f2-4424-8bc2-1126592fcdd3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:35.034562 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5957906e-06f2-4424-8bc2-1126592fcdd3 service cinder] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:35.044923 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1383/2760] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:30:34 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:30:35.133313 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cffb72-db49-40e7-9e43-609fcba1e64c None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:35.143775 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cffb72-db49-40e7-9e43-609fcba1e64c None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:35.147547 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a896f-68d2-4976-9b0f-861e9635970c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6c687a38524de0bf23d87ae91d3b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:35.148670 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a896f-68d2-4976-9b0f-861e9635970c service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:35.148963 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a896f-68d2-4976-9b0f-861e9635970c service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:35.149239 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a896f-68d2-4976-9b0f-861e9635970c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:35.207932 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1a896f-68d2-4976-9b0f-861e9635970c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:35.209533 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1a896f-68d2-4976-9b0f-861e9635970c service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:35.218922 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1378/2761] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:30:35 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:30:35.850972 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e69fe53-a72e-4174-b772-52c1227f9469 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:35.851434 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e69fe53-a72e-4174-b772-52c1227f9469 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:35.851709 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e69fe53-a72e-4174-b772-52c1227f9469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:35.872398 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-8e69fe53-a72e-4174-b772-52c1227f9469 None None] MFA Rules not processed for user `cedc4d6c59c44c6d8fb7179070db5e91`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:30:35.873621 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-8e69fe53-a72e-4174-b772-52c1227f9469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:30:35.932055 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1384/2762] 10.222.0.36 () {58 vars in 967 bytes} [Tue Aug 9 10:30:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:30:35.945710 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a896f-68d2-4976-9b0f-861e9635970c service cinder] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:35.947145 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-1a1a896f-68d2-4976-9b0f-861e9635970c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:30:35.993837 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:30:36.025639 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a896f-68d2-4976-9b0f-861e9635970c service cinder] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:36.030837 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4ee281-5168-45eb-b551-696088d47036 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '841c5dbaae774944b637c533ebd75b29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:36.031468 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ee281-5168-45eb-b551-696088d47036 service swift] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:36.032286 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ee281-5168-45eb-b551-696088d47036 service swift] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:36.033158 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ee281-5168-45eb-b551-696088d47036 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:36.041708 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4ee281-5168-45eb-b551-696088d47036 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:36.043346 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4ee281-5168-45eb-b551-696088d47036 service swift] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:36.054143 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1379/2763] 10.222.0.36 () {60 vars in 1384 bytes} [Tue Aug 9 10:30:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 09 10:30:38.192711 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e69fe53-a72e-4174-b772-52c1227f9469 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:38.192711 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-8e69fe53-a72e-4174-b772-52c1227f9469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:30:38.308436 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e69fe53-a72e-4174-b772-52c1227f9469 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:38.314357 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35cdae7-9d3a-43e6-8bad-afe7f969d3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:38.315402 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35cdae7-9d3a-43e6-8bad-afe7f969d3cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:38.315689 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35cdae7-9d3a-43e6-8bad-afe7f969d3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:38.315951 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35cdae7-9d3a-43e6-8bad-afe7f969d3cb admin admin] PATH_INFO: `/v3/users/91866320797b424a9d7062ff028e015f` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:38.317378 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35cdae7-9d3a-43e6-8bad-afe7f969d3cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=91866320797b424a9d7062ff028e015f)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:38.319850 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35cdae7-9d3a-43e6-8bad-afe7f969d3cb admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:38.391556 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-c35cdae7-9d3a-43e6-8bad-afe7f969d3cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91866320797b424a9d7062ff028e015f'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:38.403104 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:30:38.406819 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-c35cdae7-9d3a-43e6-8bad-afe7f969d3cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91866320797b424a9d7062ff028e015f'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:38.419492 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-c35cdae7-9d3a-43e6-8bad-afe7f969d3cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91866320797b424a9d7062ff028e015f'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:38.420230 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-c35cdae7-9d3a-43e6-8bad-afe7f969d3cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91866320797b424a9d7062ff028e015f'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:38.435067 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-c35cdae7-9d3a-43e6-8bad-afe7f969d3cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91866320797b424a9d7062ff028e015f'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:38.443370 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1385/2764] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:30:38 2022] DELETE /identity/v3/users/91866320797b424a9d7062ff028e015f => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:30:38.634942 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4ee281-5168-45eb-b551-696088d47036 service swift] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:38.652498 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4ee281-5168-45eb-b551-696088d47036 service swift] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:38.726821 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67cb24a-4e58-41b5-9c7b-d3d67bd5f46d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:38.727536 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67cb24a-4e58-41b5-9c7b-d3d67bd5f46d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:38.727817 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67cb24a-4e58-41b5-9c7b-d3d67bd5f46d admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:38.728089 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67cb24a-4e58-41b5-9c7b-d3d67bd5f46d admin admin] PATH_INFO: `/v3/projects/627c4f2031444838ba32b31752eb89ee` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:38.729281 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67cb24a-4e58-41b5-9c7b-d3d67bd5f46d admin admin] RBAC: Authorizing `identity:delete_project(project_id=627c4f2031444838ba32b31752eb89ee)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:38.731199 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67cb24a-4e58-41b5-9c7b-d3d67bd5f46d admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:38.782541 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-b67cb24a-4e58-41b5-9c7b-d3d67bd5f46d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '627c4f2031444838ba32b31752eb89ee', 'request_id': 'req-b67cb24a-4e58-41b5-9c7b-d3d67bd5f46d'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:38.788376 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-b67cb24a-4e58-41b5-9c7b-d3d67bd5f46d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '627c4f2031444838ba32b31752eb89ee', 'request_id': 'req-b67cb24a-4e58-41b5-9c7b-d3d67bd5f46d'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:38.794661 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-b67cb24a-4e58-41b5-9c7b-d3d67bd5f46d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '627c4f2031444838ba32b31752eb89ee', 'request_id': 'req-b67cb24a-4e58-41b5-9c7b-d3d67bd5f46d'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:38.813522 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-b67cb24a-4e58-41b5-9c7b-d3d67bd5f46d admin admin] The token cache is being invalidate because project 627c4f2031444838ba32b31752eb89ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:30:38.814003 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-b67cb24a-4e58-41b5-9c7b-d3d67bd5f46d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:38.814895 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-b67cb24a-4e58-41b5-9c7b-d3d67bd5f46d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:38.817032 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1380/2765] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:30:38 2022] DELETE /identity/v3/projects/627c4f2031444838ba32b31752eb89ee => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:30:38.821782 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c6f9e9-1a5b-4157-a8cc-4704aa9769ec None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:38.822326 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c6f9e9-1a5b-4157-a8cc-4704aa9769ec None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:38.822667 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c6f9e9-1a5b-4157-a8cc-4704aa9769ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:38.843514 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-22c6f9e9-1a5b-4157-a8cc-4704aa9769ec None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:30:38.845317 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-22c6f9e9-1a5b-4157-a8cc-4704aa9769ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:30:38.910820 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1386/2766] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:30:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:30:38.918511 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a70d2-b941-46dd-b9cb-ce20b1e926f7 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:38.918999 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a70d2-b941-46dd-b9cb-ce20b1e926f7 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:38.919427 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a70d2-b941-46dd-b9cb-ce20b1e926f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:38.940585 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-d85a70d2-b941-46dd-b9cb-ce20b1e926f7 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:30:38.941798 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-d85a70d2-b941-46dd-b9cb-ce20b1e926f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:30:38.949815 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1381/2767] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:30:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:30:38.954507 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c6f9e9-1a5b-4157-a8cc-4704aa9769ec None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:38.964370 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c6f9e9-1a5b-4157-a8cc-4704aa9769ec None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:38.969806 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b08a94b-b886-4011-a929-2c0db4eecac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:38.970492 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b08a94b-b886-4011-a929-2c0db4eecac3 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:38.970798 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b08a94b-b886-4011-a929-2c0db4eecac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:38.971069 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b08a94b-b886-4011-a929-2c0db4eecac3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:38.971715 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b08a94b-b886-4011-a929-2c0db4eecac3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:30:38.972018 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b08a94b-b886-4011-a929-2c0db4eecac3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:38.973666 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b08a94b-b886-4011-a929-2c0db4eecac3 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:38.986063 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1387/2768] 10.222.0.36 () {58 vars in 1153 bytes} [Tue Aug 9 10:30:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 09 10:30:38.990331 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85a70d2-b941-46dd-b9cb-ce20b1e926f7 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:38.999519 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85a70d2-b941-46dd-b9cb-ce20b1e926f7 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:39.004853 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f8256b-7aae-4dba-9918-8ee1def06532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:39.005444 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f8256b-7aae-4dba-9918-8ee1def06532 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:39.005718 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f8256b-7aae-4dba-9918-8ee1def06532 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:39.006023 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f8256b-7aae-4dba-9918-8ee1def06532 admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:39.006651 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f8256b-7aae-4dba-9918-8ee1def06532 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:39.008580 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f8256b-7aae-4dba-9918-8ee1def06532 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:39.045940 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1382/2769] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:30:38 2022] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:30:39.050623 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b08a94b-b886-4011-a929-2c0db4eecac3 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:39.061037 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b08a94b-b886-4011-a929-2c0db4eecac3 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:39.119771 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f1257e-916c-42e6-85f2-9ff058b7773a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:39.120310 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f1257e-916c-42e6-85f2-9ff058b7773a admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:39.120589 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f1257e-916c-42e6-85f2-9ff058b7773a admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:39.120862 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f1257e-916c-42e6-85f2-9ff058b7773a admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:39.121476 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f1257e-916c-42e6-85f2-9ff058b7773a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:39.123397 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f1257e-916c-42e6-85f2-9ff058b7773a admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:39.144167 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1388/2770] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:30:39 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:30:39.148552 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f8256b-7aae-4dba-9918-8ee1def06532 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:39.159399 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f8256b-7aae-4dba-9918-8ee1def06532 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:39.163977 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd74250-feb5-4dab-808b-747cd914e5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:39.164570 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd74250-feb5-4dab-808b-747cd914e5a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:39.164850 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd74250-feb5-4dab-808b-747cd914e5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:39.165121 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd74250-feb5-4dab-808b-747cd914e5a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:39.165760 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd74250-feb5-4dab-808b-747cd914e5a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:39.167370 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd74250-feb5-4dab-808b-747cd914e5a7 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:39.177080 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1383/2771] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:30:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:30:39.181017 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f1257e-916c-42e6-85f2-9ff058b7773a admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:39.191167 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f1257e-916c-42e6-85f2-9ff058b7773a admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:39.195748 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08363ada-e699-4938-850e-b285255868d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:39.196340 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08363ada-e699-4938-850e-b285255868d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:39.196619 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08363ada-e699-4938-850e-b285255868d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:39.196889 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08363ada-e699-4938-850e-b285255868d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:39.197533 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08363ada-e699-4938-850e-b285255868d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:39.199149 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08363ada-e699-4938-850e-b285255868d5 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:39.210151 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1389/2772] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:30:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:30:39.214235 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd74250-feb5-4dab-808b-747cd914e5a7 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:39.225018 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd74250-feb5-4dab-808b-747cd914e5a7 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:39.229659 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0338862a-b8bf-4017-bbc1-6e828d1e7ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:39.230329 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338862a-b8bf-4017-bbc1-6e828d1e7ed1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:39.230612 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338862a-b8bf-4017-bbc1-6e828d1e7ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:39.230889 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338862a-b8bf-4017-bbc1-6e828d1e7ed1 admin admin] PATH_INFO: `/v3/projects/af8d90679cf54ab4ae1840c7ea2b6507/users/53bc8f8fcced45d2ba44040c2d0a366d/roles/a9895331e9694fa8b2b50908bb057bcb` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:39.245436 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0338862a-b8bf-4017-bbc1-6e828d1e7ed1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af8d90679cf54ab4ae1840c7ea2b6507, user_id=53bc8f8fcced45d2ba44040c2d0a366d, role_id=a9895331e9694fa8b2b50908bb057bcb)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:39.248119 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0338862a-b8bf-4017-bbc1-6e828d1e7ed1 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:39.250330 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:30:39.262552 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1384/2773] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:30:39 2022] PUT /identity/v3/projects/af8d90679cf54ab4ae1840c7ea2b6507/users/53bc8f8fcced45d2ba44040c2d0a366d/roles/a9895331e9694fa8b2b50908bb057bcb => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:30:39.268254 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8cabc1-5365-44e1-aaa2-eba39de7f16d None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:39.268537 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8cabc1-5365-44e1-aaa2-eba39de7f16d None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:39.268816 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8cabc1-5365-44e1-aaa2-eba39de7f16d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:39.289221 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-fb8cabc1-5365-44e1-aaa2-eba39de7f16d None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:30:39.290442 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-fb8cabc1-5365-44e1-aaa2-eba39de7f16d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:30:39.333350 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:30:39.355651 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1390/2774] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:30:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 10:30:39.365329 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0338862a-b8bf-4017-bbc1-6e828d1e7ed1 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:39.367151 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-0338862a-b8bf-4017-bbc1-6e828d1e7ed1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:30:39.430304 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0338862a-b8bf-4017-bbc1-6e828d1e7ed1 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:39.434358 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7194a6e6-0897-4e2f-b4ab-7faba3bab92d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:39.435011 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7194a6e6-0897-4e2f-b4ab-7faba3bab92d service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:39.435341 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7194a6e6-0897-4e2f-b4ab-7faba3bab92d service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:39.435619 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7194a6e6-0897-4e2f-b4ab-7faba3bab92d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:39.445362 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8cabc1-5365-44e1-aaa2-eba39de7f16d None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:39.446785 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-fb8cabc1-5365-44e1-aaa2-eba39de7f16d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:30:39.446909 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7194a6e6-0897-4e2f-b4ab-7faba3bab92d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:39.448234 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7194a6e6-0897-4e2f-b4ab-7faba3bab92d service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:39.458473 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1385/2775] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:30:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:30:39.460060 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8cabc1-5365-44e1-aaa2-eba39de7f16d None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:39.464670 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3a9b2b-da53-47c9-ad3b-46e7b065e004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:39.465296 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a9b2b-da53-47c9-ad3b-46e7b065e004 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:39.465577 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a9b2b-da53-47c9-ad3b-46e7b065e004 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:39.465904 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a9b2b-da53-47c9-ad3b-46e7b065e004 admin admin] PATH_INFO: `/v3/users/312cc3ff8ace43b79e2c04eef2746250` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:39.467031 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3a9b2b-da53-47c9-ad3b-46e7b065e004 admin admin] RBAC: Authorizing `identity:delete_user(user_id=312cc3ff8ace43b79e2c04eef2746250)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:39.468984 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3a9b2b-da53-47c9-ad3b-46e7b065e004 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:39.519706 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-6f3a9b2b-da53-47c9-ad3b-46e7b065e004 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '312cc3ff8ace43b79e2c04eef2746250'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:39.533419 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-6f3a9b2b-da53-47c9-ad3b-46e7b065e004 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '312cc3ff8ace43b79e2c04eef2746250'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:39.540902 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-6f3a9b2b-da53-47c9-ad3b-46e7b065e004 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '312cc3ff8ace43b79e2c04eef2746250'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:39.541667 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-6f3a9b2b-da53-47c9-ad3b-46e7b065e004 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '312cc3ff8ace43b79e2c04eef2746250'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:39.549378 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-6f3a9b2b-da53-47c9-ad3b-46e7b065e004 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '312cc3ff8ace43b79e2c04eef2746250'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:39.556558 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1391/2776] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:30:39 2022] DELETE /identity/v3/users/312cc3ff8ace43b79e2c04eef2746250 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 10:30:39.561080 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f8dd8d-fd57-4541-9bda-c7106492b5ff None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:39.561385 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f8dd8d-fd57-4541-9bda-c7106492b5ff None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:39.561658 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f8dd8d-fd57-4541-9bda-c7106492b5ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:39.582571 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-55f8dd8d-fd57-4541-9bda-c7106492b5ff None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:30:39.583783 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-55f8dd8d-fd57-4541-9bda-c7106492b5ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:30:39.649823 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1386/2777] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:30:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:30:39.659769 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3a9b2b-da53-47c9-ad3b-46e7b065e004 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:39.661212 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-6f3a9b2b-da53-47c9-ad3b-46e7b065e004 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:30:39.727046 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3a9b2b-da53-47c9-ad3b-46e7b065e004 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:39.731106 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19cb59f-043f-426a-9a10-84db5ab87fb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:39.731792 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19cb59f-043f-426a-9a10-84db5ab87fb0 service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:39.732141 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19cb59f-043f-426a-9a10-84db5ab87fb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:39.732482 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19cb59f-043f-426a-9a10-84db5ab87fb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:39.742646 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19cb59f-043f-426a-9a10-84db5ab87fb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:39.744110 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19cb59f-043f-426a-9a10-84db5ab87fb0 service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:39.755784 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1392/2778] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:30:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:30:40.192204 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f8dd8d-fd57-4541-9bda-c7106492b5ff None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:40.193736 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-55f8dd8d-fd57-4541-9bda-c7106492b5ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:30:40.213871 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f8dd8d-fd57-4541-9bda-c7106492b5ff None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:40.219860 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8839717e-ac4a-4abf-bf0c-3d8ad18aaf3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:40.220587 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8839717e-ac4a-4abf-bf0c-3d8ad18aaf3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:40.220712 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8839717e-ac4a-4abf-bf0c-3d8ad18aaf3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:40.220975 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8839717e-ac4a-4abf-bf0c-3d8ad18aaf3d admin admin] PATH_INFO: `/v3/projects/81b0ba7e7f5940faa003a92b25d5c458` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:40.222376 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8839717e-ac4a-4abf-bf0c-3d8ad18aaf3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=81b0ba7e7f5940faa003a92b25d5c458)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:40.224235 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8839717e-ac4a-4abf-bf0c-3d8ad18aaf3d admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:40.262994 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f7d6d-4a43-474a-92d5-ab5b76db6154 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:40.263480 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f7d6d-4a43-474a-92d5-ab5b76db6154 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:40.264531 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f7d6d-4a43-474a-92d5-ab5b76db6154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:40.292670 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-8839717e-ac4a-4abf-bf0c-3d8ad18aaf3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81b0ba7e7f5940faa003a92b25d5c458', 'request_id': 'req-8839717e-ac4a-4abf-bf0c-3d8ad18aaf3d'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:40.301833 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-8839717e-ac4a-4abf-bf0c-3d8ad18aaf3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81b0ba7e7f5940faa003a92b25d5c458', 'request_id': 'req-8839717e-ac4a-4abf-bf0c-3d8ad18aaf3d'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:40.314097 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-8839717e-ac4a-4abf-bf0c-3d8ad18aaf3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81b0ba7e7f5940faa003a92b25d5c458', 'request_id': 'req-8839717e-ac4a-4abf-bf0c-3d8ad18aaf3d'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:40.316979 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-8f6f7d6d-4a43-474a-92d5-ab5b76db6154 None None] MFA Rules not processed for user `53bc8f8fcced45d2ba44040c2d0a366d`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:30:40.319323 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-8f6f7d6d-4a43-474a-92d5-ab5b76db6154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:30:40.336364 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-8839717e-ac4a-4abf-bf0c-3d8ad18aaf3d admin admin] The token cache is being invalidate because project 81b0ba7e7f5940faa003a92b25d5c458 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:30:40.338955 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-8839717e-ac4a-4abf-bf0c-3d8ad18aaf3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:40.338955 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-8839717e-ac4a-4abf-bf0c-3d8ad18aaf3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:40.344915 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1387/2779] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:30:40 2022] DELETE /identity/v3/projects/81b0ba7e7f5940faa003a92b25d5c458 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 10:30:40.348688 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8839717e-ac4a-4abf-bf0c-3d8ad18aaf3d admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:40.350721 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-8839717e-ac4a-4abf-bf0c-3d8ad18aaf3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:30:40.387996 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:30:40.400201 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:30:40.434615 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1393/2780] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:30:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 10:30:40.446816 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6f7d6d-4a43-474a-92d5-ab5b76db6154 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:40.448530 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-8f6f7d6d-4a43-474a-92d5-ab5b76db6154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:30:40.459180 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8839717e-ac4a-4abf-bf0c-3d8ad18aaf3d admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:40.464778 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a431cd7d-e8d4-44e3-9bc5-46288b49b28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:40.465976 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a431cd7d-e8d4-44e3-9bc5-46288b49b28a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:40.466609 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a431cd7d-e8d4-44e3-9bc5-46288b49b28a admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:40.467109 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a431cd7d-e8d4-44e3-9bc5-46288b49b28a admin admin] PATH_INFO: `/v3/users/26838fdb4e364c7d9e493a0a18f9657b` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:40.469279 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a431cd7d-e8d4-44e3-9bc5-46288b49b28a admin admin] RBAC: Authorizing `identity:delete_user(user_id=26838fdb4e364c7d9e493a0a18f9657b)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:40.471533 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a431cd7d-e8d4-44e3-9bc5-46288b49b28a admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:40.521519 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6f7d6d-4a43-474a-92d5-ab5b76db6154 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:40.525787 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebe7273-a675-4565-84c8-8004279a53a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6c687a38524de0bf23d87ae91d3b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:40.526488 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe7273-a675-4565-84c8-8004279a53a1 service cinder] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:40.526829 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe7273-a675-4565-84c8-8004279a53a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:40.527165 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe7273-a675-4565-84c8-8004279a53a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:40.534093 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a431cd7d-e8d4-44e3-9bc5-46288b49b28a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26838fdb4e364c7d9e493a0a18f9657b'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:40.537377 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebe7273-a675-4565-84c8-8004279a53a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:40.539076 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebe7273-a675-4565-84c8-8004279a53a1 service cinder] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:40.548837 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a431cd7d-e8d4-44e3-9bc5-46288b49b28a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26838fdb4e364c7d9e493a0a18f9657b'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:40.550365 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1394/2781] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:30:40 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 09 10:30:40.559098 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a431cd7d-e8d4-44e3-9bc5-46288b49b28a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26838fdb4e364c7d9e493a0a18f9657b'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:40.560508 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a431cd7d-e8d4-44e3-9bc5-46288b49b28a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26838fdb4e364c7d9e493a0a18f9657b'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:40.572508 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a431cd7d-e8d4-44e3-9bc5-46288b49b28a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26838fdb4e364c7d9e493a0a18f9657b'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:40.583002 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1388/2782] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:30:40 2022] DELETE /identity/v3/users/26838fdb4e364c7d9e493a0a18f9657b => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:30:40.884168 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebe7273-a675-4565-84c8-8004279a53a1 service cinder] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:40.901093 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebe7273-a675-4565-84c8-8004279a53a1 service cinder] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:40.968663 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedf0182-32ca-417b-9224-05b08a52decc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:40.969953 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf0182-32ca-417b-9224-05b08a52decc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:40.970191 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf0182-32ca-417b-9224-05b08a52decc admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:40.970625 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf0182-32ca-417b-9224-05b08a52decc admin admin] PATH_INFO: `/v3/projects/761a62e2dcd24693a6418d4819660f92` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:40.971839 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedf0182-32ca-417b-9224-05b08a52decc admin admin] RBAC: Authorizing `identity:delete_project(project_id=761a62e2dcd24693a6418d4819660f92)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:40.973883 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedf0182-32ca-417b-9224-05b08a52decc admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:41.029052 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-fedf0182-32ca-417b-9224-05b08a52decc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '761a62e2dcd24693a6418d4819660f92', 'request_id': 'req-fedf0182-32ca-417b-9224-05b08a52decc'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:41.036767 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-fedf0182-32ca-417b-9224-05b08a52decc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '761a62e2dcd24693a6418d4819660f92', 'request_id': 'req-fedf0182-32ca-417b-9224-05b08a52decc'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:41.043814 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-fedf0182-32ca-417b-9224-05b08a52decc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '761a62e2dcd24693a6418d4819660f92', 'request_id': 'req-fedf0182-32ca-417b-9224-05b08a52decc'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:41.057045 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-fedf0182-32ca-417b-9224-05b08a52decc admin admin] The token cache is being invalidate because project 761a62e2dcd24693a6418d4819660f92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80105) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:30:41.057341 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-fedf0182-32ca-417b-9224-05b08a52decc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:41.058036 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-fedf0182-32ca-417b-9224-05b08a52decc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:41.059747 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1395/2783] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:30:40 2022] DELETE /identity/v3/projects/761a62e2dcd24693a6418d4819660f92 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:30:41.064768 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290758bd-2cab-441c-ae42-2df31583e346 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:41.065260 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290758bd-2cab-441c-ae42-2df31583e346 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:41.065385 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290758bd-2cab-441c-ae42-2df31583e346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:41.084574 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-290758bd-2cab-441c-ae42-2df31583e346 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:30:41.085780 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-290758bd-2cab-441c-ae42-2df31583e346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:30:41.146155 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1389/2784] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:30:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:30:41.154258 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d61b84-dd99-49ee-aaac-8e025105ed76 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:41.154546 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d61b84-dd99-49ee-aaac-8e025105ed76 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:41.154824 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d61b84-dd99-49ee-aaac-8e025105ed76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:41.174526 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-88d61b84-dd99-49ee-aaac-8e025105ed76 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:30:41.175730 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-88d61b84-dd99-49ee-aaac-8e025105ed76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:30:41.183590 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1396/2785] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:30:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:30:41.188502 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290758bd-2cab-441c-ae42-2df31583e346 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:41.198013 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290758bd-2cab-441c-ae42-2df31583e346 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:41.202606 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0c2391-fd8b-4c75-993b-a09cbb5a59de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:41.203218 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c2391-fd8b-4c75-993b-a09cbb5a59de admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:41.204386 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c2391-fd8b-4c75-993b-a09cbb5a59de admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:41.204689 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c2391-fd8b-4c75-993b-a09cbb5a59de admin admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:41.205327 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0c2391-fd8b-4c75-993b-a09cbb5a59de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:30:41.205675 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0c2391-fd8b-4c75-993b-a09cbb5a59de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:41.208118 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0c2391-fd8b-4c75-993b-a09cbb5a59de admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:41.221075 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1390/2786] 10.222.0.36 () {58 vars in 1153 bytes} [Tue Aug 9 10:30:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:30:41.225452 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d61b84-dd99-49ee-aaac-8e025105ed76 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:41.236059 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d61b84-dd99-49ee-aaac-8e025105ed76 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:41.240720 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c8a6ca-2cc9-4e2e-8143-8e722d4b2019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:41.241323 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c8a6ca-2cc9-4e2e-8143-8e722d4b2019 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:41.241626 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c8a6ca-2cc9-4e2e-8143-8e722d4b2019 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:41.241924 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c8a6ca-2cc9-4e2e-8143-8e722d4b2019 admin admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:41.242582 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c8a6ca-2cc9-4e2e-8143-8e722d4b2019 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:41.244467 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c8a6ca-2cc9-4e2e-8143-8e722d4b2019 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:41.261363 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:30:41.275554 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1397/2787] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:30:41 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:30:41.279559 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0c2391-fd8b-4c75-993b-a09cbb5a59de admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:41.290242 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0c2391-fd8b-4c75-993b-a09cbb5a59de admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:41.318185 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:30:41.353265 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d8ea37-d822-47f8-82e6-c0a507b8884c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:41.353891 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d8ea37-d822-47f8-82e6-c0a507b8884c admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:41.354173 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d8ea37-d822-47f8-82e6-c0a507b8884c admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:41.354442 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d8ea37-d822-47f8-82e6-c0a507b8884c admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:41.355058 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d8ea37-d822-47f8-82e6-c0a507b8884c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:41.356961 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d8ea37-d822-47f8-82e6-c0a507b8884c admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:41.379474 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1391/2788] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:30:41 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:30:41.383708 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c8a6ca-2cc9-4e2e-8143-8e722d4b2019 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:41.394401 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c8a6ca-2cc9-4e2e-8143-8e722d4b2019 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:41.399219 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad63d3e7-1491-4599-87e9-bee4695760d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:41.399800 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad63d3e7-1491-4599-87e9-bee4695760d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:41.400074 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad63d3e7-1491-4599-87e9-bee4695760d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:41.400343 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad63d3e7-1491-4599-87e9-bee4695760d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:41.400969 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad63d3e7-1491-4599-87e9-bee4695760d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:41.402576 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad63d3e7-1491-4599-87e9-bee4695760d4 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:41.412841 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1398/2789] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:30:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:30:41.416527 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d8ea37-d822-47f8-82e6-c0a507b8884c admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:41.427374 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d8ea37-d822-47f8-82e6-c0a507b8884c admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:41.432256 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47da5781-9ec9-40ae-bcfa-4fe56ec5a930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:41.432842 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47da5781-9ec9-40ae-bcfa-4fe56ec5a930 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:41.433117 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47da5781-9ec9-40ae-bcfa-4fe56ec5a930 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:41.433386 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47da5781-9ec9-40ae-bcfa-4fe56ec5a930 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:41.434048 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47da5781-9ec9-40ae-bcfa-4fe56ec5a930 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:41.435625 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47da5781-9ec9-40ae-bcfa-4fe56ec5a930 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:41.446169 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1392/2790] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:30:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:30:41.450142 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad63d3e7-1491-4599-87e9-bee4695760d4 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:41.460530 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad63d3e7-1491-4599-87e9-bee4695760d4 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:41.465210 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc0d089-a6c4-43d7-8f8e-07f880a10ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:41.465877 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc0d089-a6c4-43d7-8f8e-07f880a10ce4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:41.466184 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc0d089-a6c4-43d7-8f8e-07f880a10ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:41.466515 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc0d089-a6c4-43d7-8f8e-07f880a10ce4 admin admin] PATH_INFO: `/v3/projects/8fce12265dc640cc8a9400e407b03363/users/36094d84c1564fdea0487872e7c124e5/roles/a9895331e9694fa8b2b50908bb057bcb` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:41.481860 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc0d089-a6c4-43d7-8f8e-07f880a10ce4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fce12265dc640cc8a9400e407b03363, user_id=36094d84c1564fdea0487872e7c124e5, role_id=a9895331e9694fa8b2b50908bb057bcb)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:41.484500 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc0d089-a6c4-43d7-8f8e-07f880a10ce4 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:41.498248 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1399/2791] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:30:41 2022] PUT /identity/v3/projects/8fce12265dc640cc8a9400e407b03363/users/36094d84c1564fdea0487872e7c124e5/roles/a9895331e9694fa8b2b50908bb057bcb => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:30:41.508730 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb33bc3-c05a-4988-b2fb-c2ed1d2ee1aa None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:41.509023 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb33bc3-c05a-4988-b2fb-c2ed1d2ee1aa None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:41.509298 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb33bc3-c05a-4988-b2fb-c2ed1d2ee1aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:41.537976 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-bfb33bc3-c05a-4988-b2fb-c2ed1d2ee1aa None None] MFA Rules not processed for user `36094d84c1564fdea0487872e7c124e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:30:41.539056 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-bfb33bc3-c05a-4988-b2fb-c2ed1d2ee1aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:30:41.602257 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1393/2792] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:30:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:30:41.606702 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc0d089-a6c4-43d7-8f8e-07f880a10ce4 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:41.669450 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc0d089-a6c4-43d7-8f8e-07f880a10ce4 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:41.674980 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a666faf-eff9-414c-b6e4-348597315697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:41.675575 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a666faf-eff9-414c-b6e4-348597315697 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:41.675850 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a666faf-eff9-414c-b6e4-348597315697 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:41.676120 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a666faf-eff9-414c-b6e4-348597315697 admin admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:41.676740 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a666faf-eff9-414c-b6e4-348597315697 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:41.678644 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a666faf-eff9-414c-b6e4-348597315697 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:41.704794 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1400/2793] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:30:41 2022] POST /identity/v3/projects => generated 387 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:30:41.708926 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb33bc3-c05a-4988-b2fb-c2ed1d2ee1aa None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:41.722217 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb33bc3-c05a-4988-b2fb-c2ed1d2ee1aa None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:41.777598 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab7006c-9a01-4b96-a106-a7edd1cf6d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:41.778238 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab7006c-9a01-4b96-a106-a7edd1cf6d9f admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:41.778519 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab7006c-9a01-4b96-a106-a7edd1cf6d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:41.778789 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab7006c-9a01-4b96-a106-a7edd1cf6d9f admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:41.779408 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab7006c-9a01-4b96-a106-a7edd1cf6d9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:41.781897 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab7006c-9a01-4b96-a106-a7edd1cf6d9f admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:41.802960 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1394/2794] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:30:41 2022] POST /identity/v3/users => generated 300 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:30:41.806951 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a666faf-eff9-414c-b6e4-348597315697 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:41.817051 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a666faf-eff9-414c-b6e4-348597315697 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:41.821711 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e93767-1cff-4609-b228-38bb53af64ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:41.822343 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e93767-1cff-4609-b228-38bb53af64ad admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:41.822608 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e93767-1cff-4609-b228-38bb53af64ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:41.822886 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e93767-1cff-4609-b228-38bb53af64ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:41.823509 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e93767-1cff-4609-b228-38bb53af64ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:41.825082 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e93767-1cff-4609-b228-38bb53af64ad admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:41.835451 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1401/2795] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:30:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:30:41.839501 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab7006c-9a01-4b96-a106-a7edd1cf6d9f admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:41.850416 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab7006c-9a01-4b96-a106-a7edd1cf6d9f admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:41.854935 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be217dd-7125-40e8-a6a1-cb3ea6eff2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:41.855574 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be217dd-7125-40e8-a6a1-cb3ea6eff2e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:41.855854 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be217dd-7125-40e8-a6a1-cb3ea6eff2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:41.856124 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be217dd-7125-40e8-a6a1-cb3ea6eff2e5 admin admin] PATH_INFO: `/v3/projects/cb1d741d29b540d79c7791a7b7c1473b/users/a08cca31ad474ad49a4363783b228f52/roles/89ca30cbbb634be8a96e9921aa56626b` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:41.871377 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be217dd-7125-40e8-a6a1-cb3ea6eff2e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb1d741d29b540d79c7791a7b7c1473b, user_id=a08cca31ad474ad49a4363783b228f52, role_id=89ca30cbbb634be8a96e9921aa56626b)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:41.874053 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be217dd-7125-40e8-a6a1-cb3ea6eff2e5 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:41.883213 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:30:41.888495 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1395/2796] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:30:41 2022] PUT /identity/v3/projects/cb1d741d29b540d79c7791a7b7c1473b/users/a08cca31ad474ad49a4363783b228f52/roles/89ca30cbbb634be8a96e9921aa56626b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:30:41.892922 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e93767-1cff-4609-b228-38bb53af64ad admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:41.903045 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e93767-1cff-4609-b228-38bb53af64ad admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:41.961975 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e63faf1-0913-4af6-97cc-61295c85a795 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:41.962263 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e63faf1-0913-4af6-97cc-61295c85a795 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:41.962540 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e63faf1-0913-4af6-97cc-61295c85a795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:41.966651 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c5b29c-bfe3-4ec2-9494-9dce2d393972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:41.967293 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c5b29c-bfe3-4ec2-9494-9dce2d393972 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:41.967570 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c5b29c-bfe3-4ec2-9494-9dce2d393972 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:41.967839 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c5b29c-bfe3-4ec2-9494-9dce2d393972 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:41.968625 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c5b29c-bfe3-4ec2-9494-9dce2d393972 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:41.970346 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c5b29c-bfe3-4ec2-9494-9dce2d393972 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:41.980658 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1402/2797] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:30:41 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:30:41.981887 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-9e63faf1-0913-4af6-97cc-61295c85a795 None None] MFA Rules not processed for user `53bc8f8fcced45d2ba44040c2d0a366d`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:30:41.983102 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-9e63faf1-0913-4af6-97cc-61295c85a795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:30:41.985288 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c5b29c-bfe3-4ec2-9494-9dce2d393972 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:41.994960 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c5b29c-bfe3-4ec2-9494-9dce2d393972 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:41.999862 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a29a92-8909-4581-82ba-100fe06e13f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:42.001224 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a29a92-8909-4581-82ba-100fe06e13f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:42.001490 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a29a92-8909-4581-82ba-100fe06e13f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:42.001756 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a29a92-8909-4581-82ba-100fe06e13f1 admin admin] PATH_INFO: `/v3/projects/cb1d741d29b540d79c7791a7b7c1473b/users/a08cca31ad474ad49a4363783b228f52/roles/89ca30cbbb634be8a96e9921aa56626b` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:42.003676 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a29a92-8909-4581-82ba-100fe06e13f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb1d741d29b540d79c7791a7b7c1473b, user_id=a08cca31ad474ad49a4363783b228f52, role_id=89ca30cbbb634be8a96e9921aa56626b)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:42.006338 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a29a92-8909-4581-82ba-100fe06e13f1 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:42.017034 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1403/2798] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:30:41 2022] PUT /identity/v3/projects/cb1d741d29b540d79c7791a7b7c1473b/users/a08cca31ad474ad49a4363783b228f52/roles/89ca30cbbb634be8a96e9921aa56626b => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 10:30:42.028831 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37235b0-2fb0-4596-afdc-8d64d348c094 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:42.029172 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37235b0-2fb0-4596-afdc-8d64d348c094 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:42.029452 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37235b0-2fb0-4596-afdc-8d64d348c094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:42.042316 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1396/2799] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:30:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:30:42.060536 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-f37235b0-2fb0-4596-afdc-8d64d348c094 None None] MFA Rules not processed for user `a08cca31ad474ad49a4363783b228f52`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:30:42.061723 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-f37235b0-2fb0-4596-afdc-8d64d348c094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:30:42.066864 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:30:42.135022 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1404/2800] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:30:42 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 10:30:42.145565 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e63faf1-0913-4af6-97cc-61295c85a795 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:42.147081 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-9e63faf1-0913-4af6-97cc-61295c85a795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:30:42.204904 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e63faf1-0913-4af6-97cc-61295c85a795 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:42.253174 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603b8c14-ac42-44ab-9bbd-96cb028ff2a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6c687a38524de0bf23d87ae91d3b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:42.253786 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b8c14-ac42-44ab-9bbd-96cb028ff2a8 service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:42.254096 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b8c14-ac42-44ab-9bbd-96cb028ff2a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:42.254355 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b8c14-ac42-44ab-9bbd-96cb028ff2a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:42.263676 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603b8c14-ac42-44ab-9bbd-96cb028ff2a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:42.265117 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603b8c14-ac42-44ab-9bbd-96cb028ff2a8 service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:42.275240 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1397/2801] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:30:42 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:30:42.913878 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37235b0-2fb0-4596-afdc-8d64d348c094 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:43.000789 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37235b0-2fb0-4596-afdc-8d64d348c094 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:43.007525 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499e7010-6b95-4108-b171-6460446406d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:43.008267 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e7010-6b95-4108-b171-6460446406d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:43.008545 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e7010-6b95-4108-b171-6460446406d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:43.008816 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e7010-6b95-4108-b171-6460446406d9 admin admin] PATH_INFO: `/v3/users/36094d84c1564fdea0487872e7c124e5` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:43.010089 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499e7010-6b95-4108-b171-6460446406d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36094d84c1564fdea0487872e7c124e5)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:43.012075 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499e7010-6b95-4108-b171-6460446406d9 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:43.065718 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-499e7010-6b95-4108-b171-6460446406d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36094d84c1564fdea0487872e7c124e5'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:43.080405 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-499e7010-6b95-4108-b171-6460446406d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36094d84c1564fdea0487872e7c124e5'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:43.088565 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-499e7010-6b95-4108-b171-6460446406d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36094d84c1564fdea0487872e7c124e5'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:43.089512 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-499e7010-6b95-4108-b171-6460446406d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36094d84c1564fdea0487872e7c124e5'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:43.099418 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-499e7010-6b95-4108-b171-6460446406d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36094d84c1564fdea0487872e7c124e5'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:43.106277 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1405/2802] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:30:42 2022] DELETE /identity/v3/users/36094d84c1564fdea0487872e7c124e5 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:30:43.110907 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2bdadb-3542-4525-a38b-baa2fa980657 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:43.111291 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2bdadb-3542-4525-a38b-baa2fa980657 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:43.111634 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2bdadb-3542-4525-a38b-baa2fa980657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:43.132399 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-7e2bdadb-3542-4525-a38b-baa2fa980657 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:30:43.133610 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-7e2bdadb-3542-4525-a38b-baa2fa980657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:30:43.197704 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1398/2803] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:30:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:30:43.208193 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499e7010-6b95-4108-b171-6460446406d9 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:43.209781 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-499e7010-6b95-4108-b171-6460446406d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:30:43.233342 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:30:43.275968 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499e7010-6b95-4108-b171-6460446406d9 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:43.279627 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea22478-163a-4758-8159-b7a47c232b83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:43.280224 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea22478-163a-4758-8159-b7a47c232b83 service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:43.280501 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea22478-163a-4758-8159-b7a47c232b83 service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:43.280769 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea22478-163a-4758-8159-b7a47c232b83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:43.290628 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea22478-163a-4758-8159-b7a47c232b83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:43.292052 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea22478-163a-4758-8159-b7a47c232b83 service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:43.302285 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1406/2804] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:30:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:30:43.594799 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2bdadb-3542-4525-a38b-baa2fa980657 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:43.596317 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-7e2bdadb-3542-4525-a38b-baa2fa980657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:30:43.605672 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=100 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:30:43.616774 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2bdadb-3542-4525-a38b-baa2fa980657 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:43.621509 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b067cb2e-59e2-4b70-8c43-5c69f1d4d436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:43.622225 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b067cb2e-59e2-4b70-8c43-5c69f1d4d436 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:43.622513 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b067cb2e-59e2-4b70-8c43-5c69f1d4d436 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:43.622828 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b067cb2e-59e2-4b70-8c43-5c69f1d4d436 admin admin] PATH_INFO: `/v3/projects/8fce12265dc640cc8a9400e407b03363` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:43.623917 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b067cb2e-59e2-4b70-8c43-5c69f1d4d436 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fce12265dc640cc8a9400e407b03363)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:43.625805 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b067cb2e-59e2-4b70-8c43-5c69f1d4d436 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:43.673392 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-b067cb2e-59e2-4b70-8c43-5c69f1d4d436 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fce12265dc640cc8a9400e407b03363', 'request_id': 'req-b067cb2e-59e2-4b70-8c43-5c69f1d4d436'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:43.678786 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-b067cb2e-59e2-4b70-8c43-5c69f1d4d436 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fce12265dc640cc8a9400e407b03363', 'request_id': 'req-b067cb2e-59e2-4b70-8c43-5c69f1d4d436'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:43.684755 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-b067cb2e-59e2-4b70-8c43-5c69f1d4d436 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fce12265dc640cc8a9400e407b03363', 'request_id': 'req-b067cb2e-59e2-4b70-8c43-5c69f1d4d436'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:43.696904 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-b067cb2e-59e2-4b70-8c43-5c69f1d4d436 admin admin] The token cache is being invalidate because project 8fce12265dc640cc8a9400e407b03363 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:30:43.697188 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-b067cb2e-59e2-4b70-8c43-5c69f1d4d436 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:43.697800 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-b067cb2e-59e2-4b70-8c43-5c69f1d4d436 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:43.699314 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1399/2805] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:30:43 2022] DELETE /identity/v3/projects/8fce12265dc640cc8a9400e407b03363 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:30:43.703772 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea22478-163a-4758-8159-b7a47c232b83 service neutron] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:43.715754 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea22478-163a-4758-8159-b7a47c232b83 service neutron] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:43.785878 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33683212-3a50-49c6-a7c8-7d3044e0173c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:43.786521 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33683212-3a50-49c6-a7c8-7d3044e0173c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:43.786794 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33683212-3a50-49c6-a7c8-7d3044e0173c admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:43.787060 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33683212-3a50-49c6-a7c8-7d3044e0173c admin admin] PATH_INFO: `/v3/users/a08cca31ad474ad49a4363783b228f52` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:43.788264 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33683212-3a50-49c6-a7c8-7d3044e0173c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a08cca31ad474ad49a4363783b228f52)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:43.790307 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33683212-3a50-49c6-a7c8-7d3044e0173c admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:43.868599 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-33683212-3a50-49c6-a7c8-7d3044e0173c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a08cca31ad474ad49a4363783b228f52'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:43.887737 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-33683212-3a50-49c6-a7c8-7d3044e0173c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a08cca31ad474ad49a4363783b228f52'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:43.896133 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-33683212-3a50-49c6-a7c8-7d3044e0173c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a08cca31ad474ad49a4363783b228f52'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:43.897108 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-33683212-3a50-49c6-a7c8-7d3044e0173c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a08cca31ad474ad49a4363783b228f52'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:43.907500 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-33683212-3a50-49c6-a7c8-7d3044e0173c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a08cca31ad474ad49a4363783b228f52'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:43.914167 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1407/2806] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:30:43 2022] DELETE /identity/v3/users/a08cca31ad474ad49a4363783b228f52 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 10:30:44.240805 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b067cb2e-59e2-4b70-8c43-5c69f1d4d436 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:44.243270 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-b067cb2e-59e2-4b70-8c43-5c69f1d4d436 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:30:44.269571 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b067cb2e-59e2-4b70-8c43-5c69f1d4d436 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:44.333245 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449d7aca-711e-464a-973f-eb3393831f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:44.333953 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d7aca-711e-464a-973f-eb3393831f16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:44.334251 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d7aca-711e-464a-973f-eb3393831f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:44.334522 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d7aca-711e-464a-973f-eb3393831f16 admin admin] PATH_INFO: `/v3/projects/cb1d741d29b540d79c7791a7b7c1473b` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:44.335647 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449d7aca-711e-464a-973f-eb3393831f16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb1d741d29b540d79c7791a7b7c1473b)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:44.337581 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449d7aca-711e-464a-973f-eb3393831f16 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:44.395303 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-449d7aca-711e-464a-973f-eb3393831f16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb1d741d29b540d79c7791a7b7c1473b', 'request_id': 'req-449d7aca-711e-464a-973f-eb3393831f16'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:44.401304 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-449d7aca-711e-464a-973f-eb3393831f16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb1d741d29b540d79c7791a7b7c1473b', 'request_id': 'req-449d7aca-711e-464a-973f-eb3393831f16'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:44.408206 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-449d7aca-711e-464a-973f-eb3393831f16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb1d741d29b540d79c7791a7b7c1473b', 'request_id': 'req-449d7aca-711e-464a-973f-eb3393831f16'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:44.422023 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-449d7aca-711e-464a-973f-eb3393831f16 admin admin] The token cache is being invalidate because project cb1d741d29b540d79c7791a7b7c1473b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:30:44.422305 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-449d7aca-711e-464a-973f-eb3393831f16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:44.422961 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-449d7aca-711e-464a-973f-eb3393831f16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:44.424432 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1400/2807] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:30:44 2022] DELETE /identity/v3/projects/cb1d741d29b540d79c7791a7b7c1473b => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:30:44.429281 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44751425-1a36-40a3-9fd2-2ce5d80d57bf None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:44.429576 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44751425-1a36-40a3-9fd2-2ce5d80d57bf None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:44.429938 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44751425-1a36-40a3-9fd2-2ce5d80d57bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:44.449270 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-44751425-1a36-40a3-9fd2-2ce5d80d57bf None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:30:44.450511 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-44751425-1a36-40a3-9fd2-2ce5d80d57bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:30:44.491659 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:30:44.514366 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1408/2808] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:30:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:30:44.523683 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f00ca-b159-4cf5-a938-a677bdd98e56 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:44.524031 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f00ca-b159-4cf5-a938-a677bdd98e56 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:44.524364 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f00ca-b159-4cf5-a938-a677bdd98e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:44.545460 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-cb7f00ca-b159-4cf5-a938-a677bdd98e56 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:30:44.546763 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-cb7f00ca-b159-4cf5-a938-a677bdd98e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:30:44.556689 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1401/2809] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:30:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:30:44.560699 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44751425-1a36-40a3-9fd2-2ce5d80d57bf None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:44.570649 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44751425-1a36-40a3-9fd2-2ce5d80d57bf None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:44.575331 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fb0d9b-55e3-4237-b471-9b1f80ab63e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:44.575922 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fb0d9b-55e3-4237-b471-9b1f80ab63e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:44.576194 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fb0d9b-55e3-4237-b471-9b1f80ab63e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:44.576461 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fb0d9b-55e3-4237-b471-9b1f80ab63e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:44.577102 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fb0d9b-55e3-4237-b471-9b1f80ab63e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:30:44.577391 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fb0d9b-55e3-4237-b471-9b1f80ab63e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:44.579887 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fb0d9b-55e3-4237-b471-9b1f80ab63e3 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:44.592960 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1409/2810] 10.222.0.36 () {58 vars in 1153 bytes} [Tue Aug 9 10:30:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:30:44.598136 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7f00ca-b159-4cf5-a938-a677bdd98e56 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:44.607836 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7f00ca-b159-4cf5-a938-a677bdd98e56 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:44.612882 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0508d8-a202-431a-b37c-02618712280b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:44.613482 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0508d8-a202-431a-b37c-02618712280b admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:44.613763 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0508d8-a202-431a-b37c-02618712280b admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:44.614065 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0508d8-a202-431a-b37c-02618712280b admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:44.614703 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0508d8-a202-431a-b37c-02618712280b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:44.616649 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0508d8-a202-431a-b37c-02618712280b admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:44.627712 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:30:44.652231 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1402/2811] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:30:44 2022] POST /identity/v3/projects => generated 381 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 10:30:44.653396 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fb0d9b-55e3-4237-b471-9b1f80ab63e3 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:44.663623 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fb0d9b-55e3-4237-b471-9b1f80ab63e3 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:44.724657 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2315190-acd9-4c5b-a69f-39881fde671b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:44.725359 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2315190-acd9-4c5b-a69f-39881fde671b admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:44.725638 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2315190-acd9-4c5b-a69f-39881fde671b admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:44.725939 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2315190-acd9-4c5b-a69f-39881fde671b admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:44.726605 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2315190-acd9-4c5b-a69f-39881fde671b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:44.728516 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2315190-acd9-4c5b-a69f-39881fde671b admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:44.753621 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1410/2812] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:30:44 2022] POST /identity/v3/users => generated 291 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 10:30:44.754842 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0508d8-a202-431a-b37c-02618712280b admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:44.765165 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0508d8-a202-431a-b37c-02618712280b admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:44.769721 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed76c74-7db3-4320-b356-fcd553dcbf55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:44.770347 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed76c74-7db3-4320-b356-fcd553dcbf55 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:44.770629 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed76c74-7db3-4320-b356-fcd553dcbf55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:44.770933 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed76c74-7db3-4320-b356-fcd553dcbf55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:44.771567 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed76c74-7db3-4320-b356-fcd553dcbf55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:44.773422 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed76c74-7db3-4320-b356-fcd553dcbf55 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:44.785265 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1403/2813] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:30:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 10:30:44.789241 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2315190-acd9-4c5b-a69f-39881fde671b admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:44.800559 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2315190-acd9-4c5b-a69f-39881fde671b admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:44.805359 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d108f8-9b2e-44dd-9a66-b048299b2ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:44.806005 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d108f8-9b2e-44dd-9a66-b048299b2ab5 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:44.806284 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d108f8-9b2e-44dd-9a66-b048299b2ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:44.806556 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d108f8-9b2e-44dd-9a66-b048299b2ab5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:44.807194 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d108f8-9b2e-44dd-9a66-b048299b2ab5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:44.808776 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d108f8-9b2e-44dd-9a66-b048299b2ab5 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:44.820332 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1411/2814] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:30:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:30:44.824474 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed76c74-7db3-4320-b356-fcd553dcbf55 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:44.835190 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed76c74-7db3-4320-b356-fcd553dcbf55 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:44.840375 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d96d8e-0d4f-4645-9283-a7d3406d7bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:44.841071 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d96d8e-0d4f-4645-9283-a7d3406d7bea admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:44.841353 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d96d8e-0d4f-4645-9283-a7d3406d7bea admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:44.841628 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d96d8e-0d4f-4645-9283-a7d3406d7bea admin admin] PATH_INFO: `/v3/projects/6d91fbdd59634278834f8ffcd8c50d0b/users/bfb36ee5221642f4b07b836dc15f7665/roles/a9895331e9694fa8b2b50908bb057bcb` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:44.857821 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d96d8e-0d4f-4645-9283-a7d3406d7bea admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d91fbdd59634278834f8ffcd8c50d0b, user_id=bfb36ee5221642f4b07b836dc15f7665, role_id=a9895331e9694fa8b2b50908bb057bcb)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:44.861251 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d96d8e-0d4f-4645-9283-a7d3406d7bea admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:44.874361 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1404/2815] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:30:44 2022] PUT /identity/v3/projects/6d91fbdd59634278834f8ffcd8c50d0b/users/bfb36ee5221642f4b07b836dc15f7665/roles/a9895331e9694fa8b2b50908bb057bcb => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 10:30:44.885397 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9362b74-229c-453f-811c-cc76a0a574e3 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:44.885696 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9362b74-229c-453f-811c-cc76a0a574e3 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:44.885999 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9362b74-229c-453f-811c-cc76a0a574e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:44.914999 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-c9362b74-229c-453f-811c-cc76a0a574e3 None None] MFA Rules not processed for user `bfb36ee5221642f4b07b836dc15f7665`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:30:44.916127 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-c9362b74-229c-453f-811c-cc76a0a574e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:30:44.990656 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1412/2816] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:30:44 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:30:44.995237 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d96d8e-0d4f-4645-9283-a7d3406d7bea admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:45.063072 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d96d8e-0d4f-4645-9283-a7d3406d7bea admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:45.069068 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9608908-c594-4771-b47a-bd1115fdf339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:45.069682 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9608908-c594-4771-b47a-bd1115fdf339 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:45.070012 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9608908-c594-4771-b47a-bd1115fdf339 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:45.070286 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9608908-c594-4771-b47a-bd1115fdf339 admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:45.070925 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9608908-c594-4771-b47a-bd1115fdf339 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:45.073335 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9608908-c594-4771-b47a-bd1115fdf339 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:45.106201 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1405/2817] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:30:44 2022] POST /identity/v3/projects => generated 379 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:30:45.107343 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9362b74-229c-453f-811c-cc76a0a574e3 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:45.118694 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9362b74-229c-453f-811c-cc76a0a574e3 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:45.165665 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:30:45.193692 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b61550-35c0-4285-a041-ca1a38d0cb05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:45.194342 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b61550-35c0-4285-a041-ca1a38d0cb05 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:45.194655 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b61550-35c0-4285-a041-ca1a38d0cb05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:45.194949 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b61550-35c0-4285-a041-ca1a38d0cb05 admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:45.195584 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b61550-35c0-4285-a041-ca1a38d0cb05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:45.197697 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b61550-35c0-4285-a041-ca1a38d0cb05 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:45.224453 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1413/2818] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:30:45 2022] POST /identity/v3/users => generated 296 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 09 10:30:45.228733 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9608908-c594-4771-b47a-bd1115fdf339 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:45.241705 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9608908-c594-4771-b47a-bd1115fdf339 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:45.247987 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a75845-719b-4482-b7d0-194f8dc1db83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:45.249317 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a75845-719b-4482-b7d0-194f8dc1db83 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:45.249658 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a75845-719b-4482-b7d0-194f8dc1db83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:45.250039 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a75845-719b-4482-b7d0-194f8dc1db83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:45.251216 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a75845-719b-4482-b7d0-194f8dc1db83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:45.252821 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a75845-719b-4482-b7d0-194f8dc1db83 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:45.268075 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1406/2819] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:30:45 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:30:45.269247 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b61550-35c0-4285-a041-ca1a38d0cb05 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:45.279680 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b61550-35c0-4285-a041-ca1a38d0cb05 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:45.284332 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c442bc7-ef67-4f98-a4c9-22ca956c9aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:45.284976 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c442bc7-ef67-4f98-a4c9-22ca956c9aea admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:45.285248 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c442bc7-ef67-4f98-a4c9-22ca956c9aea admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:45.285537 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c442bc7-ef67-4f98-a4c9-22ca956c9aea admin admin] PATH_INFO: `/v3/projects/02db82124ccf446ab7e7237c9ae6fe34/users/5274ce87adac4aea90fac58eb6dfd2b1/roles/89ca30cbbb634be8a96e9921aa56626b` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:45.301356 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c442bc7-ef67-4f98-a4c9-22ca956c9aea admin admin] RBAC: Authorizing `identity:create_grant(project_id=02db82124ccf446ab7e7237c9ae6fe34, user_id=5274ce87adac4aea90fac58eb6dfd2b1, role_id=89ca30cbbb634be8a96e9921aa56626b)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:45.304028 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c442bc7-ef67-4f98-a4c9-22ca956c9aea admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:45.320793 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1414/2820] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:30:45 2022] PUT /identity/v3/projects/02db82124ccf446ab7e7237c9ae6fe34/users/5274ce87adac4aea90fac58eb6dfd2b1/roles/89ca30cbbb634be8a96e9921aa56626b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 10:30:45.330694 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a75845-719b-4482-b7d0-194f8dc1db83 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:45.342040 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a75845-719b-4482-b7d0-194f8dc1db83 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:45.400611 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f8e0e5-1262-40f5-93da-d8ec0c9ba18b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:45.401219 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f8e0e5-1262-40f5-93da-d8ec0c9ba18b admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:45.401504 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f8e0e5-1262-40f5-93da-d8ec0c9ba18b admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:45.401775 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f8e0e5-1262-40f5-93da-d8ec0c9ba18b admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:45.402452 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f8e0e5-1262-40f5-93da-d8ec0c9ba18b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:45.404043 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f8e0e5-1262-40f5-93da-d8ec0c9ba18b admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:45.414090 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1407/2821] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:30:45 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:30:45.418210 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c442bc7-ef67-4f98-a4c9-22ca956c9aea admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:45.429133 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c442bc7-ef67-4f98-a4c9-22ca956c9aea admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:45.434473 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc57e357-6519-45d8-b6d5-5b682487c82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:45.435126 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc57e357-6519-45d8-b6d5-5b682487c82f admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:45.435403 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc57e357-6519-45d8-b6d5-5b682487c82f admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:45.435712 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc57e357-6519-45d8-b6d5-5b682487c82f admin admin] PATH_INFO: `/v3/projects/02db82124ccf446ab7e7237c9ae6fe34/users/5274ce87adac4aea90fac58eb6dfd2b1/roles/89ca30cbbb634be8a96e9921aa56626b` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:45.442041 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc57e357-6519-45d8-b6d5-5b682487c82f admin admin] RBAC: Authorizing `identity:create_grant(project_id=02db82124ccf446ab7e7237c9ae6fe34, user_id=5274ce87adac4aea90fac58eb6dfd2b1, role_id=89ca30cbbb634be8a96e9921aa56626b)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:45.444733 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc57e357-6519-45d8-b6d5-5b682487c82f admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:45.458386 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1415/2822] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:30:45 2022] PUT /identity/v3/projects/02db82124ccf446ab7e7237c9ae6fe34/users/5274ce87adac4aea90fac58eb6dfd2b1/roles/89ca30cbbb634be8a96e9921aa56626b => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 10:30:45.471483 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8667271-9669-4b41-84fc-adfe8d7fff06 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:45.471822 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8667271-9669-4b41-84fc-adfe8d7fff06 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:45.472222 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8667271-9669-4b41-84fc-adfe8d7fff06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:45.499811 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-a8667271-9669-4b41-84fc-adfe8d7fff06 None None] MFA Rules not processed for user `5274ce87adac4aea90fac58eb6dfd2b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:30:45.501654 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-a8667271-9669-4b41-84fc-adfe8d7fff06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:30:45.513885 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:30:45.572715 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1408/2823] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:30:45 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 10:30:45.583955 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc57e357-6519-45d8-b6d5-5b682487c82f admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:45.585773 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-dc57e357-6519-45d8-b6d5-5b682487c82f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:30:45.646584 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc57e357-6519-45d8-b6d5-5b682487c82f admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:45.650414 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb9c1a2-fb28-4042-b423-de0b020a8064 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6c687a38524de0bf23d87ae91d3b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:45.651016 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb9c1a2-fb28-4042-b423-de0b020a8064 service cinder] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:45.651314 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb9c1a2-fb28-4042-b423-de0b020a8064 service cinder] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:45.651577 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb9c1a2-fb28-4042-b423-de0b020a8064 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:45.661334 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb9c1a2-fb28-4042-b423-de0b020a8064 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:45.662971 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb9c1a2-fb28-4042-b423-de0b020a8064 service cinder] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:45.673919 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1416/2824] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:30:45 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:30:46.048822 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8667271-9669-4b41-84fc-adfe8d7fff06 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:46.108376 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8667271-9669-4b41-84fc-adfe8d7fff06 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:46.113075 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ede485f-a404-4891-a1ca-1502d7d4a442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:46.113729 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ede485f-a404-4891-a1ca-1502d7d4a442 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:46.114109 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ede485f-a404-4891-a1ca-1502d7d4a442 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:46.114388 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ede485f-a404-4891-a1ca-1502d7d4a442 admin admin] PATH_INFO: `/v3/users/bfb36ee5221642f4b07b836dc15f7665` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:46.115501 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ede485f-a404-4891-a1ca-1502d7d4a442 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfb36ee5221642f4b07b836dc15f7665)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:46.117452 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ede485f-a404-4891-a1ca-1502d7d4a442 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:46.163057 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-3ede485f-a404-4891-a1ca-1502d7d4a442 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfb36ee5221642f4b07b836dc15f7665'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:46.175413 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-3ede485f-a404-4891-a1ca-1502d7d4a442 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfb36ee5221642f4b07b836dc15f7665'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:46.182143 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-3ede485f-a404-4891-a1ca-1502d7d4a442 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfb36ee5221642f4b07b836dc15f7665'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:46.182803 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-3ede485f-a404-4891-a1ca-1502d7d4a442 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfb36ee5221642f4b07b836dc15f7665'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:46.190933 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-3ede485f-a404-4891-a1ca-1502d7d4a442 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfb36ee5221642f4b07b836dc15f7665'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:46.197481 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1409/2825] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:30:46 2022] DELETE /identity/v3/users/bfb36ee5221642f4b07b836dc15f7665 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:30:46.201918 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a68b361-9952-4f3c-a2da-8d3cea2f0319 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:46.202492 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a68b361-9952-4f3c-a2da-8d3cea2f0319 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:46.202492 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a68b361-9952-4f3c-a2da-8d3cea2f0319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:46.221196 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-6a68b361-9952-4f3c-a2da-8d3cea2f0319 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:30:46.222436 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-6a68b361-9952-4f3c-a2da-8d3cea2f0319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:30:46.280305 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1417/2826] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:30:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:30:46.290648 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ede485f-a404-4891-a1ca-1502d7d4a442 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:46.292053 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-3ede485f-a404-4891-a1ca-1502d7d4a442 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:30:46.324025 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:30:46.351088 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ede485f-a404-4891-a1ca-1502d7d4a442 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:46.354814 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d8081d-c570-47f9-92f2-2aaa75dcd3c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:46.355443 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d8081d-c570-47f9-92f2-2aaa75dcd3c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:46.355706 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d8081d-c570-47f9-92f2-2aaa75dcd3c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:46.355971 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d8081d-c570-47f9-92f2-2aaa75dcd3c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:46.365531 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d8081d-c570-47f9-92f2-2aaa75dcd3c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:46.366993 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d8081d-c570-47f9-92f2-2aaa75dcd3c6 service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:46.376378 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1410/2827] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:30:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:30:46.690727 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a68b361-9952-4f3c-a2da-8d3cea2f0319 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:46.692264 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-6a68b361-9952-4f3c-a2da-8d3cea2f0319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:30:46.705658 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a68b361-9952-4f3c-a2da-8d3cea2f0319 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:46.710704 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30031113-8127-49e5-a719-4630da574d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:46.711591 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30031113-8127-49e5-a719-4630da574d83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:46.712027 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30031113-8127-49e5-a719-4630da574d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:46.712370 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30031113-8127-49e5-a719-4630da574d83 admin admin] PATH_INFO: `/v3/projects/6d91fbdd59634278834f8ffcd8c50d0b` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:46.715406 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30031113-8127-49e5-a719-4630da574d83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d91fbdd59634278834f8ffcd8c50d0b)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:46.718419 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30031113-8127-49e5-a719-4630da574d83 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:46.757629 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:30:46.776271 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-30031113-8127-49e5-a719-4630da574d83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d91fbdd59634278834f8ffcd8c50d0b', 'request_id': 'req-30031113-8127-49e5-a719-4630da574d83'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:46.795515 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-30031113-8127-49e5-a719-4630da574d83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d91fbdd59634278834f8ffcd8c50d0b', 'request_id': 'req-30031113-8127-49e5-a719-4630da574d83'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:46.802493 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-30031113-8127-49e5-a719-4630da574d83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d91fbdd59634278834f8ffcd8c50d0b', 'request_id': 'req-30031113-8127-49e5-a719-4630da574d83'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:46.815793 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-30031113-8127-49e5-a719-4630da574d83 admin admin] The token cache is being invalidate because project 6d91fbdd59634278834f8ffcd8c50d0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80105) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:30:46.816525 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-30031113-8127-49e5-a719-4630da574d83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:46.817194 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-30031113-8127-49e5-a719-4630da574d83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:46.818939 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1418/2828] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:30:46 2022] DELETE /identity/v3/projects/6d91fbdd59634278834f8ffcd8c50d0b => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:30:46.822662 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d8081d-c570-47f9-92f2-2aaa75dcd3c6 service neutron] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:46.832390 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d8081d-c570-47f9-92f2-2aaa75dcd3c6 service neutron] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:46.888065 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1291593-3248-4b38-9917-67afab37efc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:46.888969 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1291593-3248-4b38-9917-67afab37efc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:46.889240 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1291593-3248-4b38-9917-67afab37efc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:46.889505 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1291593-3248-4b38-9917-67afab37efc2 admin admin] PATH_INFO: `/v3/users/5274ce87adac4aea90fac58eb6dfd2b1` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:46.890680 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1291593-3248-4b38-9917-67afab37efc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5274ce87adac4aea90fac58eb6dfd2b1)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:46.892580 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1291593-3248-4b38-9917-67afab37efc2 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:46.941209 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-b1291593-3248-4b38-9917-67afab37efc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5274ce87adac4aea90fac58eb6dfd2b1'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:46.952920 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-b1291593-3248-4b38-9917-67afab37efc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5274ce87adac4aea90fac58eb6dfd2b1'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:46.959786 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-b1291593-3248-4b38-9917-67afab37efc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5274ce87adac4aea90fac58eb6dfd2b1'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:46.960541 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-b1291593-3248-4b38-9917-67afab37efc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5274ce87adac4aea90fac58eb6dfd2b1'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:46.968100 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-b1291593-3248-4b38-9917-67afab37efc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5274ce87adac4aea90fac58eb6dfd2b1'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:46.974786 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1411/2829] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:30:46 2022] DELETE /identity/v3/users/5274ce87adac4aea90fac58eb6dfd2b1 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:30:47.245115 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30031113-8127-49e5-a719-4630da574d83 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:47.246578 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-30031113-8127-49e5-a719-4630da574d83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:30:47.264451 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30031113-8127-49e5-a719-4630da574d83 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:47.322255 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e57a01c-9e0f-41a4-958a-07a702e614d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:47.322881 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e57a01c-9e0f-41a4-958a-07a702e614d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:47.323156 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e57a01c-9e0f-41a4-958a-07a702e614d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:47.323426 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e57a01c-9e0f-41a4-958a-07a702e614d2 admin admin] PATH_INFO: `/v3/projects/02db82124ccf446ab7e7237c9ae6fe34` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:47.324589 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e57a01c-9e0f-41a4-958a-07a702e614d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02db82124ccf446ab7e7237c9ae6fe34)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:47.326487 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e57a01c-9e0f-41a4-958a-07a702e614d2 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:47.372536 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-3e57a01c-9e0f-41a4-958a-07a702e614d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02db82124ccf446ab7e7237c9ae6fe34', 'request_id': 'req-3e57a01c-9e0f-41a4-958a-07a702e614d2'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:47.378550 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-3e57a01c-9e0f-41a4-958a-07a702e614d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02db82124ccf446ab7e7237c9ae6fe34', 'request_id': 'req-3e57a01c-9e0f-41a4-958a-07a702e614d2'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:47.384875 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-3e57a01c-9e0f-41a4-958a-07a702e614d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02db82124ccf446ab7e7237c9ae6fe34', 'request_id': 'req-3e57a01c-9e0f-41a4-958a-07a702e614d2'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:47.397545 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-3e57a01c-9e0f-41a4-958a-07a702e614d2 admin admin] The token cache is being invalidate because project 02db82124ccf446ab7e7237c9ae6fe34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80105) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:30:47.397832 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-3e57a01c-9e0f-41a4-958a-07a702e614d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:47.398752 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-3e57a01c-9e0f-41a4-958a-07a702e614d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:47.400220 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1419/2830] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:30:47 2022] DELETE /identity/v3/projects/02db82124ccf446ab7e7237c9ae6fe34 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:30:47.405095 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f1b97-ed6b-46f0-9665-4a9ecff53db1 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:47.405562 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f1b97-ed6b-46f0-9665-4a9ecff53db1 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:47.405689 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f1b97-ed6b-46f0-9665-4a9ecff53db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:47.425519 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-f00f1b97-ed6b-46f0-9665-4a9ecff53db1 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:30:47.426885 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-f00f1b97-ed6b-46f0-9665-4a9ecff53db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:30:47.472559 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:30:47.488657 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1412/2831] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:30:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:30:47.496356 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed4f36-3c4f-4693-a58c-0a71412ececb None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:47.496641 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed4f36-3c4f-4693-a58c-0a71412ececb None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:47.496914 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed4f36-3c4f-4693-a58c-0a71412ececb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:47.516486 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-caed4f36-3c4f-4693-a58c-0a71412ececb None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:30:47.517656 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-caed4f36-3c4f-4693-a58c-0a71412ececb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:30:47.525633 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1420/2832] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:30:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:30:47.529641 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f1b97-ed6b-46f0-9665-4a9ecff53db1 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:47.540200 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f1b97-ed6b-46f0-9665-4a9ecff53db1 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:47.544747 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89421773-1b1c-4b6e-82e1-196a3f72d19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:47.545333 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89421773-1b1c-4b6e-82e1-196a3f72d19a admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:47.545614 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89421773-1b1c-4b6e-82e1-196a3f72d19a admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:47.545916 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89421773-1b1c-4b6e-82e1-196a3f72d19a admin admin] PATH_INFO: `/v3/domains` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:47.546564 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89421773-1b1c-4b6e-82e1-196a3f72d19a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80106) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:30:47.547001 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89421773-1b1c-4b6e-82e1-196a3f72d19a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:47.548697 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89421773-1b1c-4b6e-82e1-196a3f72d19a admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:47.560145 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1413/2833] 10.222.0.36 () {58 vars in 1153 bytes} [Tue Aug 9 10:30:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:30:47.564423 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caed4f36-3c4f-4693-a58c-0a71412ececb None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:47.573614 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caed4f36-3c4f-4693-a58c-0a71412ececb None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:47.578871 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ddcb22-b93d-4762-8f87-0c58d4b77780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:47.579449 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ddcb22-b93d-4762-8f87-0c58d4b77780 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:47.579754 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ddcb22-b93d-4762-8f87-0c58d4b77780 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:47.580026 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ddcb22-b93d-4762-8f87-0c58d4b77780 admin admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:47.580670 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ddcb22-b93d-4762-8f87-0c58d4b77780 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:47.582826 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ddcb22-b93d-4762-8f87-0c58d4b77780 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:47.610576 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1421/2834] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:30:47 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:30:47.614652 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89421773-1b1c-4b6e-82e1-196a3f72d19a admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:47.624474 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89421773-1b1c-4b6e-82e1-196a3f72d19a admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:47.680240 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31afa137-851b-4ac3-b9f9-0279b6ad10fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:47.680831 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31afa137-851b-4ac3-b9f9-0279b6ad10fd admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:47.681136 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31afa137-851b-4ac3-b9f9-0279b6ad10fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:47.681409 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31afa137-851b-4ac3-b9f9-0279b6ad10fd admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:47.682085 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31afa137-851b-4ac3-b9f9-0279b6ad10fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:47.684009 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31afa137-851b-4ac3-b9f9-0279b6ad10fd admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:47.709770 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1414/2835] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:30:47 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:30:47.711173 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ddcb22-b93d-4762-8f87-0c58d4b77780 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:47.722778 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ddcb22-b93d-4762-8f87-0c58d4b77780 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:47.727435 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b0ac86-47ad-402c-a135-deaeb553f00a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:47.728035 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0ac86-47ad-402c-a135-deaeb553f00a admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:47.728307 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0ac86-47ad-402c-a135-deaeb553f00a admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:47.728609 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0ac86-47ad-402c-a135-deaeb553f00a admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:47.729230 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b0ac86-47ad-402c-a135-deaeb553f00a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:47.730831 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b0ac86-47ad-402c-a135-deaeb553f00a admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:47.740950 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1422/2836] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:30:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:30:47.745017 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31afa137-851b-4ac3-b9f9-0279b6ad10fd admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:47.755755 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31afa137-851b-4ac3-b9f9-0279b6ad10fd admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:47.760425 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82ec5af-5859-437d-b049-30ccc1aa3927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:47.761146 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82ec5af-5859-437d-b049-30ccc1aa3927 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:47.761440 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82ec5af-5859-437d-b049-30ccc1aa3927 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:47.761710 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82ec5af-5859-437d-b049-30ccc1aa3927 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:47.762375 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82ec5af-5859-437d-b049-30ccc1aa3927 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:47.763987 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82ec5af-5859-437d-b049-30ccc1aa3927 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:47.778794 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1415/2837] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:30:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 09 10:30:47.780053 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b0ac86-47ad-402c-a135-deaeb553f00a admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:47.792462 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b0ac86-47ad-402c-a135-deaeb553f00a admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:47.797600 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae685749-413f-46cd-aa52-ec4dceeaac70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:47.798286 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae685749-413f-46cd-aa52-ec4dceeaac70 admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:47.798565 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae685749-413f-46cd-aa52-ec4dceeaac70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:47.798835 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae685749-413f-46cd-aa52-ec4dceeaac70 admin admin] PATH_INFO: `/v3/projects/849fa0993c9e4691907b5813d79d548c/users/151586754ff742b29278428ffb810dee/roles/a9895331e9694fa8b2b50908bb057bcb` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:47.801189 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:30:47.816906 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae685749-413f-46cd-aa52-ec4dceeaac70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=849fa0993c9e4691907b5813d79d548c, user_id=151586754ff742b29278428ffb810dee, role_id=a9895331e9694fa8b2b50908bb057bcb)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:47.819499 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae685749-413f-46cd-aa52-ec4dceeaac70 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:47.836077 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1423/2838] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:30:47 2022] PUT /identity/v3/projects/849fa0993c9e4691907b5813d79d548c/users/151586754ff742b29278428ffb810dee/roles/a9895331e9694fa8b2b50908bb057bcb => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:30:47.906628 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9934b6d4-c0ab-4b6b-b8c8-093ede20bf5a None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:47.907421 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9934b6d4-c0ab-4b6b-b8c8-093ede20bf5a None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:47.907717 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9934b6d4-c0ab-4b6b-b8c8-093ede20bf5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:47.943988 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-9934b6d4-c0ab-4b6b-b8c8-093ede20bf5a None None] MFA Rules not processed for user `151586754ff742b29278428ffb810dee`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:30:47.946231 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-9934b6d4-c0ab-4b6b-b8c8-093ede20bf5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:30:48.016155 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1416/2839] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:30:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:30:48.020661 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae685749-413f-46cd-aa52-ec4dceeaac70 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:48.084565 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae685749-413f-46cd-aa52-ec4dceeaac70 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:48.089156 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a1800c-16a8-4af2-a68a-6935e000cd1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:48.089754 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a1800c-16a8-4af2-a68a-6935e000cd1a admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:48.090058 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a1800c-16a8-4af2-a68a-6935e000cd1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:48.090330 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a1800c-16a8-4af2-a68a-6935e000cd1a admin admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:48.090954 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a1800c-16a8-4af2-a68a-6935e000cd1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:48.092859 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a1800c-16a8-4af2-a68a-6935e000cd1a admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:48.120658 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1424/2840] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:30:48 2022] POST /identity/v3/projects => generated 375 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:30:48.124509 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9934b6d4-c0ab-4b6b-b8c8-093ede20bf5a None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:48.137076 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9934b6d4-c0ab-4b6b-b8c8-093ede20bf5a None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:48.182013 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:30:48.196484 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aa8381-04dd-423c-9d0c-0a2dcfc8bff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:48.197097 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa8381-04dd-423c-9d0c-0a2dcfc8bff3 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:48.197378 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa8381-04dd-423c-9d0c-0a2dcfc8bff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:48.197647 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa8381-04dd-423c-9d0c-0a2dcfc8bff3 admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:48.198309 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aa8381-04dd-423c-9d0c-0a2dcfc8bff3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:48.200283 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aa8381-04dd-423c-9d0c-0a2dcfc8bff3 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:48.221798 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1417/2841] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:30:48 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:30:48.225830 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a1800c-16a8-4af2-a68a-6935e000cd1a admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:48.237089 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a1800c-16a8-4af2-a68a-6935e000cd1a admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:48.241720 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc75d64b-5fd0-4110-8a71-2580eb3c9fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:48.242354 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc75d64b-5fd0-4110-8a71-2580eb3c9fb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:48.242619 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc75d64b-5fd0-4110-8a71-2580eb3c9fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:48.242884 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc75d64b-5fd0-4110-8a71-2580eb3c9fb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:48.243510 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc75d64b-5fd0-4110-8a71-2580eb3c9fb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:48.245083 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc75d64b-5fd0-4110-8a71-2580eb3c9fb5 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:48.256129 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1425/2842] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:30:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:30:48.260400 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aa8381-04dd-423c-9d0c-0a2dcfc8bff3 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:48.271932 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aa8381-04dd-423c-9d0c-0a2dcfc8bff3 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:48.276985 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03752a26-ad4e-4040-9d97-76fe49fca708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:48.277588 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03752a26-ad4e-4040-9d97-76fe49fca708 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:48.277889 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03752a26-ad4e-4040-9d97-76fe49fca708 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:48.278169 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03752a26-ad4e-4040-9d97-76fe49fca708 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:48.278810 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03752a26-ad4e-4040-9d97-76fe49fca708 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:48.280407 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03752a26-ad4e-4040-9d97-76fe49fca708 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:48.290525 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1418/2843] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:30:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:30:48.294662 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc75d64b-5fd0-4110-8a71-2580eb3c9fb5 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:48.305289 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc75d64b-5fd0-4110-8a71-2580eb3c9fb5 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:48.309900 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0bbe0e-0a4f-4b3b-ae9f-97b32d363986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:48.310554 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0bbe0e-0a4f-4b3b-ae9f-97b32d363986 admin admin] REQUEST_METHOD: `PUT` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:48.310839 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0bbe0e-0a4f-4b3b-ae9f-97b32d363986 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:48.311111 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0bbe0e-0a4f-4b3b-ae9f-97b32d363986 admin admin] PATH_INFO: `/v3/projects/e8a508f496674f4d88e3366896c16d91/users/da69ec63ac8a4f89876573ede8903bfe/roles/a9895331e9694fa8b2b50908bb057bcb` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:48.326036 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0bbe0e-0a4f-4b3b-ae9f-97b32d363986 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8a508f496674f4d88e3366896c16d91, user_id=da69ec63ac8a4f89876573ede8903bfe, role_id=a9895331e9694fa8b2b50908bb057bcb)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:48.328847 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0bbe0e-0a4f-4b3b-ae9f-97b32d363986 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:48.341263 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1426/2844] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:30:48 2022] PUT /identity/v3/projects/e8a508f496674f4d88e3366896c16d91/users/da69ec63ac8a4f89876573ede8903bfe/roles/a9895331e9694fa8b2b50908bb057bcb => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:30:48.351980 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67606690-cdbc-444b-8eb3-f74d9cb06322 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:48.352292 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67606690-cdbc-444b-8eb3-f74d9cb06322 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:48.352571 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67606690-cdbc-444b-8eb3-f74d9cb06322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:48.380251 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-67606690-cdbc-444b-8eb3-f74d9cb06322 None None] MFA Rules not processed for user `da69ec63ac8a4f89876573ede8903bfe`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:30:48.381455 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-67606690-cdbc-444b-8eb3-f74d9cb06322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:30:48.456545 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1419/2845] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:30:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:30:48.461085 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0bbe0e-0a4f-4b3b-ae9f-97b32d363986 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:48.523520 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0bbe0e-0a4f-4b3b-ae9f-97b32d363986 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:48.528013 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d4b384-3435-40ef-b218-876c36cc0c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:48.528608 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d4b384-3435-40ef-b218-876c36cc0c5e admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:48.528880 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d4b384-3435-40ef-b218-876c36cc0c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:48.529152 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d4b384-3435-40ef-b218-876c36cc0c5e admin admin] PATH_INFO: `/v3/projects` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:48.529759 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d4b384-3435-40ef-b218-876c36cc0c5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:48.532191 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d4b384-3435-40ef-b218-876c36cc0c5e admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:48.557875 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1427/2846] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:30:48 2022] POST /identity/v3/projects => generated 375 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:30:48.561972 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67606690-cdbc-444b-8eb3-f74d9cb06322 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:48.572996 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67606690-cdbc-444b-8eb3-f74d9cb06322 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:48.759257 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d96470-9a78-4a11-b5bf-2ba3a27fe96f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:48.759850 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d96470-9a78-4a11-b5bf-2ba3a27fe96f admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:48.760121 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d96470-9a78-4a11-b5bf-2ba3a27fe96f admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:48.760388 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d96470-9a78-4a11-b5bf-2ba3a27fe96f admin admin] PATH_INFO: `/v3/users` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:48.761000 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d96470-9a78-4a11-b5bf-2ba3a27fe96f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:48.762908 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d96470-9a78-4a11-b5bf-2ba3a27fe96f admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:48.784537 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1420/2847] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:30:48 2022] POST /identity/v3/users => generated 294 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:30:48.788487 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d4b384-3435-40ef-b218-876c36cc0c5e admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:48.798621 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d4b384-3435-40ef-b218-876c36cc0c5e admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:48.803091 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05edbb1f-0629-4201-a66a-eb5e20446cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:48.803675 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05edbb1f-0629-4201-a66a-eb5e20446cba admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:48.803954 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05edbb1f-0629-4201-a66a-eb5e20446cba admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:48.804223 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05edbb1f-0629-4201-a66a-eb5e20446cba admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:48.804851 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05edbb1f-0629-4201-a66a-eb5e20446cba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:48.806473 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05edbb1f-0629-4201-a66a-eb5e20446cba admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:48.816723 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1428/2848] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:30:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:30:48.820678 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d96470-9a78-4a11-b5bf-2ba3a27fe96f admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:48.830903 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d96470-9a78-4a11-b5bf-2ba3a27fe96f admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:48.835550 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e054b678-6a1e-470b-b1ba-541d730cf615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:48.836213 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e054b678-6a1e-470b-b1ba-541d730cf615 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:48.836487 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e054b678-6a1e-470b-b1ba-541d730cf615 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:48.836757 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e054b678-6a1e-470b-b1ba-541d730cf615 admin admin] PATH_INFO: `/v3/projects/adf19e032aed423083b27ccaa882c526/users/d119f2faf2d84e4fb4306f254f7111e3/roles/89ca30cbbb634be8a96e9921aa56626b` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:48.851433 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e054b678-6a1e-470b-b1ba-541d730cf615 admin admin] RBAC: Authorizing `identity:create_grant(project_id=adf19e032aed423083b27ccaa882c526, user_id=d119f2faf2d84e4fb4306f254f7111e3, role_id=89ca30cbbb634be8a96e9921aa56626b)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:48.854078 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e054b678-6a1e-470b-b1ba-541d730cf615 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:48.867379 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1421/2849] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:30:48 2022] PUT /identity/v3/projects/adf19e032aed423083b27ccaa882c526/users/d119f2faf2d84e4fb4306f254f7111e3/roles/89ca30cbbb634be8a96e9921aa56626b => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:30:48.871313 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05edbb1f-0629-4201-a66a-eb5e20446cba admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:48.881068 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05edbb1f-0629-4201-a66a-eb5e20446cba admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:48.884552 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:30:48.938008 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbc7c52-772d-4779-bc91-ce06dbb2b451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:48.938629 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbc7c52-772d-4779-bc91-ce06dbb2b451 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:48.938912 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbc7c52-772d-4779-bc91-ce06dbb2b451 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:48.939181 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbc7c52-772d-4779-bc91-ce06dbb2b451 admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:48.939894 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbc7c52-772d-4779-bc91-ce06dbb2b451 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:48.941389 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbc7c52-772d-4779-bc91-ce06dbb2b451 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:48.954498 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1429/2850] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:30:48 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:30:48.958616 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e054b678-6a1e-470b-b1ba-541d730cf615 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:48.969496 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e054b678-6a1e-470b-b1ba-541d730cf615 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:48.973970 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166706d7-23cd-439f-b8ac-8f1029f50a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:48.974604 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166706d7-23cd-439f-b8ac-8f1029f50a43 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:48.974876 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166706d7-23cd-439f-b8ac-8f1029f50a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:48.975139 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166706d7-23cd-439f-b8ac-8f1029f50a43 admin admin] PATH_INFO: `/v3/projects/adf19e032aed423083b27ccaa882c526/users/d119f2faf2d84e4fb4306f254f7111e3/roles/89ca30cbbb634be8a96e9921aa56626b` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:48.976983 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166706d7-23cd-439f-b8ac-8f1029f50a43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=adf19e032aed423083b27ccaa882c526, user_id=d119f2faf2d84e4fb4306f254f7111e3, role_id=89ca30cbbb634be8a96e9921aa56626b)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:48.979597 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166706d7-23cd-439f-b8ac-8f1029f50a43 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:48.990000 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1422/2851] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:30:48 2022] PUT /identity/v3/projects/adf19e032aed423083b27ccaa882c526/users/d119f2faf2d84e4fb4306f254f7111e3/roles/89ca30cbbb634be8a96e9921aa56626b => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:30:49.002362 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874a5744-c750-420b-acb8-5ce5b5a6e473 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:49.002596 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874a5744-c750-420b-acb8-5ce5b5a6e473 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:49.003049 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874a5744-c750-420b-acb8-5ce5b5a6e473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:49.032082 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-874a5744-c750-420b-acb8-5ce5b5a6e473 None None] MFA Rules not processed for user `d119f2faf2d84e4fb4306f254f7111e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:30:49.033296 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-874a5744-c750-420b-acb8-5ce5b5a6e473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:30:49.108163 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1430/2852] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:30:49 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:30:49.120591 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166706d7-23cd-439f-b8ac-8f1029f50a43 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:49.122396 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-166706d7-23cd-439f-b8ac-8f1029f50a43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:30:49.132997 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:30:49.182646 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166706d7-23cd-439f-b8ac-8f1029f50a43 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:49.186276 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2865c70b-d643-43ce-a9f7-608c12eef1fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6c687a38524de0bf23d87ae91d3b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:49.186876 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2865c70b-d643-43ce-a9f7-608c12eef1fb service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:49.187156 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2865c70b-d643-43ce-a9f7-608c12eef1fb service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:49.187841 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2865c70b-d643-43ce-a9f7-608c12eef1fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:49.241934 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2865c70b-d643-43ce-a9f7-608c12eef1fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:49.243366 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2865c70b-d643-43ce-a9f7-608c12eef1fb service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:49.252329 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1423/2853] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:30:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:30:50.740854 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874a5744-c750-420b-acb8-5ce5b5a6e473 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:50.742715 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-874a5744-c750-420b-acb8-5ce5b5a6e473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:30:50.754650 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874a5744-c750-420b-acb8-5ce5b5a6e473 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:50.758285 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f475e33a-2b07-4570-8843-6e66a01707a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6c687a38524de0bf23d87ae91d3b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:50.758885 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f475e33a-2b07-4570-8843-6e66a01707a9 service cinder] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:50.759163 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f475e33a-2b07-4570-8843-6e66a01707a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:50.759436 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f475e33a-2b07-4570-8843-6e66a01707a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:50.817398 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f475e33a-2b07-4570-8843-6e66a01707a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:50.818777 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f475e33a-2b07-4570-8843-6e66a01707a9 service cinder] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:50.827530 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1431/2854] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:30:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:30:51.384213 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2865c70b-d643-43ce-a9f7-608c12eef1fb service cinder] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:51.394046 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2865c70b-d643-43ce-a9f7-608c12eef1fb service cinder] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:51.398439 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea013de-6b4e-4fd5-9090-ec62b3b58ae7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6c687a38524de0bf23d87ae91d3b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:51.399044 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea013de-6b4e-4fd5-9090-ec62b3b58ae7 service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:51.399324 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea013de-6b4e-4fd5-9090-ec62b3b58ae7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:51.400384 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea013de-6b4e-4fd5-9090-ec62b3b58ae7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:51.411022 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea013de-6b4e-4fd5-9090-ec62b3b58ae7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:51.412719 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea013de-6b4e-4fd5-9090-ec62b3b58ae7 service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:51.423509 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1424/2855] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:30:51 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:30:55.317774 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f475e33a-2b07-4570-8843-6e66a01707a9 service cinder] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:55.347785 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=100 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:30:55.383216 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f475e33a-2b07-4570-8843-6e66a01707a9 service cinder] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:55.387722 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0629618d-7713-4adb-9fe6-3a8cd4f5c67e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:55.388340 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0629618d-7713-4adb-9fe6-3a8cd4f5c67e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:55.388617 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0629618d-7713-4adb-9fe6-3a8cd4f5c67e admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:55.388891 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0629618d-7713-4adb-9fe6-3a8cd4f5c67e admin admin] PATH_INFO: `/v3/users/151586754ff742b29278428ffb810dee` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:55.390033 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0629618d-7713-4adb-9fe6-3a8cd4f5c67e admin admin] RBAC: Authorizing `identity:delete_user(user_id=151586754ff742b29278428ffb810dee)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:55.392520 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0629618d-7713-4adb-9fe6-3a8cd4f5c67e admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:55.439411 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-0629618d-7713-4adb-9fe6-3a8cd4f5c67e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '151586754ff742b29278428ffb810dee'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:55.450943 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-0629618d-7713-4adb-9fe6-3a8cd4f5c67e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '151586754ff742b29278428ffb810dee'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:55.460538 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-0629618d-7713-4adb-9fe6-3a8cd4f5c67e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '151586754ff742b29278428ffb810dee'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:55.461457 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-0629618d-7713-4adb-9fe6-3a8cd4f5c67e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '151586754ff742b29278428ffb810dee'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:55.471739 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-0629618d-7713-4adb-9fe6-3a8cd4f5c67e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '151586754ff742b29278428ffb810dee'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:55.478076 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1432/2856] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:30:55 2022] DELETE /identity/v3/users/151586754ff742b29278428ffb810dee => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:30:55.482447 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8abe05-8cd8-42c8-a25f-c87dbca52dda None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:55.482989 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8abe05-8cd8-42c8-a25f-c87dbca52dda None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:55.483099 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8abe05-8cd8-42c8-a25f-c87dbca52dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:55.501734 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-0f8abe05-8cd8-42c8-a25f-c87dbca52dda None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:30:55.502868 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-0f8abe05-8cd8-42c8-a25f-c87dbca52dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:30:55.562506 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1425/2857] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:30:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:30:55.572190 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0629618d-7713-4adb-9fe6-3a8cd4f5c67e admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:55.573755 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-0629618d-7713-4adb-9fe6-3a8cd4f5c67e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:30:55.634760 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0629618d-7713-4adb-9fe6-3a8cd4f5c67e admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:55.638295 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc84a454-abb5-40bf-af95-9cbe327e099a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:55.638889 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc84a454-abb5-40bf-af95-9cbe327e099a service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:55.639164 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc84a454-abb5-40bf-af95-9cbe327e099a service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:55.639430 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc84a454-abb5-40bf-af95-9cbe327e099a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:55.650624 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc84a454-abb5-40bf-af95-9cbe327e099a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:55.652065 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc84a454-abb5-40bf-af95-9cbe327e099a service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:55.661983 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1433/2858] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:30:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:30:55.939995 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8abe05-8cd8-42c8-a25f-c87dbca52dda None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:55.941507 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-0f8abe05-8cd8-42c8-a25f-c87dbca52dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:30:55.954127 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8abe05-8cd8-42c8-a25f-c87dbca52dda None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:55.962303 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b162bb-958f-4956-b276-5650bf31009b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:55.962956 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b162bb-958f-4956-b276-5650bf31009b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:55.963232 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b162bb-958f-4956-b276-5650bf31009b admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:55.963503 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b162bb-958f-4956-b276-5650bf31009b admin admin] PATH_INFO: `/v3/projects/849fa0993c9e4691907b5813d79d548c` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:55.966627 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b162bb-958f-4956-b276-5650bf31009b admin admin] RBAC: Authorizing `identity:delete_project(project_id=849fa0993c9e4691907b5813d79d548c)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:55.968990 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b162bb-958f-4956-b276-5650bf31009b admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:56.012531 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:30:56.017422 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-67b162bb-958f-4956-b276-5650bf31009b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '849fa0993c9e4691907b5813d79d548c', 'request_id': 'req-67b162bb-958f-4956-b276-5650bf31009b'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:56.023368 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-67b162bb-958f-4956-b276-5650bf31009b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '849fa0993c9e4691907b5813d79d548c', 'request_id': 'req-67b162bb-958f-4956-b276-5650bf31009b'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:56.029382 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-67b162bb-958f-4956-b276-5650bf31009b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '849fa0993c9e4691907b5813d79d548c', 'request_id': 'req-67b162bb-958f-4956-b276-5650bf31009b'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:56.043739 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-67b162bb-958f-4956-b276-5650bf31009b admin admin] The token cache is being invalidate because project 849fa0993c9e4691907b5813d79d548c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:30:56.044083 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-67b162bb-958f-4956-b276-5650bf31009b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:56.044753 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-67b162bb-958f-4956-b276-5650bf31009b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:56.046365 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1426/2859] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:30:55 2022] DELETE /identity/v3/projects/849fa0993c9e4691907b5813d79d548c => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:30:56.051231 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc84a454-abb5-40bf-af95-9cbe327e099a service neutron] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:56.060864 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc84a454-abb5-40bf-af95-9cbe327e099a service neutron] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:56.105604 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:30:56.122033 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc710455-e129-48dc-8114-f836ba18454c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:56.122659 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc710455-e129-48dc-8114-f836ba18454c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:56.122934 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc710455-e129-48dc-8114-f836ba18454c admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:56.123203 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc710455-e129-48dc-8114-f836ba18454c admin admin] PATH_INFO: `/v3/users/da69ec63ac8a4f89876573ede8903bfe` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:56.124313 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc710455-e129-48dc-8114-f836ba18454c admin admin] RBAC: Authorizing `identity:delete_user(user_id=da69ec63ac8a4f89876573ede8903bfe)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:56.126813 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc710455-e129-48dc-8114-f836ba18454c admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:56.172334 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-dc710455-e129-48dc-8114-f836ba18454c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da69ec63ac8a4f89876573ede8903bfe'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:56.184514 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-dc710455-e129-48dc-8114-f836ba18454c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da69ec63ac8a4f89876573ede8903bfe'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:56.193076 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-dc710455-e129-48dc-8114-f836ba18454c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da69ec63ac8a4f89876573ede8903bfe'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:56.193872 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-dc710455-e129-48dc-8114-f836ba18454c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da69ec63ac8a4f89876573ede8903bfe'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:56.201945 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-dc710455-e129-48dc-8114-f836ba18454c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da69ec63ac8a4f89876573ede8903bfe'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:56.208333 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1434/2860] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:30:56 2022] DELETE /identity/v3/users/da69ec63ac8a4f89876573ede8903bfe => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 10:30:56.497690 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b162bb-958f-4956-b276-5650bf31009b admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:56.499205 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-67b162bb-958f-4956-b276-5650bf31009b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:30:56.512900 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b162bb-958f-4956-b276-5650bf31009b admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:56.570460 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56f49f1-1499-4844-81f3-a40afd7b5159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:56.570460 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f49f1-1499-4844-81f3-a40afd7b5159 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:56.570769 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f49f1-1499-4844-81f3-a40afd7b5159 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:56.570883 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f49f1-1499-4844-81f3-a40afd7b5159 admin admin] PATH_INFO: `/v3/projects/e8a508f496674f4d88e3366896c16d91` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:56.572129 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56f49f1-1499-4844-81f3-a40afd7b5159 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8a508f496674f4d88e3366896c16d91)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:56.574098 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56f49f1-1499-4844-81f3-a40afd7b5159 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:56.620114 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a56f49f1-1499-4844-81f3-a40afd7b5159 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8a508f496674f4d88e3366896c16d91', 'request_id': 'req-a56f49f1-1499-4844-81f3-a40afd7b5159'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:56.625755 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a56f49f1-1499-4844-81f3-a40afd7b5159 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8a508f496674f4d88e3366896c16d91', 'request_id': 'req-a56f49f1-1499-4844-81f3-a40afd7b5159'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:56.632018 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a56f49f1-1499-4844-81f3-a40afd7b5159 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8a508f496674f4d88e3366896c16d91', 'request_id': 'req-a56f49f1-1499-4844-81f3-a40afd7b5159'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:56.646853 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a56f49f1-1499-4844-81f3-a40afd7b5159 admin admin] The token cache is being invalidate because project e8a508f496674f4d88e3366896c16d91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:30:56.647140 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a56f49f1-1499-4844-81f3-a40afd7b5159 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:56.648036 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-a56f49f1-1499-4844-81f3-a40afd7b5159 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:56.649523 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1427/2861] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:30:56 2022] DELETE /identity/v3/projects/e8a508f496674f4d88e3366896c16d91 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 09 10:30:56.653561 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc710455-e129-48dc-8114-f836ba18454c admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:56.654995 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-dc710455-e129-48dc-8114-f836ba18454c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:30:56.668387 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc710455-e129-48dc-8114-f836ba18454c admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:56.725098 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11464201-a750-47d6-abe1-6e1d893b1930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:56.725732 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11464201-a750-47d6-abe1-6e1d893b1930 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:56.726036 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11464201-a750-47d6-abe1-6e1d893b1930 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:56.726308 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11464201-a750-47d6-abe1-6e1d893b1930 admin admin] PATH_INFO: `/v3/users/d119f2faf2d84e4fb4306f254f7111e3` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:56.727411 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11464201-a750-47d6-abe1-6e1d893b1930 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d119f2faf2d84e4fb4306f254f7111e3)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:56.729306 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11464201-a750-47d6-abe1-6e1d893b1930 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:56.774799 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-11464201-a750-47d6-abe1-6e1d893b1930 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd119f2faf2d84e4fb4306f254f7111e3'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:56.786860 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-11464201-a750-47d6-abe1-6e1d893b1930 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd119f2faf2d84e4fb4306f254f7111e3'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:56.791210 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:30:56.794663 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-11464201-a750-47d6-abe1-6e1d893b1930 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd119f2faf2d84e4fb4306f254f7111e3'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:56.795488 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-11464201-a750-47d6-abe1-6e1d893b1930 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd119f2faf2d84e4fb4306f254f7111e3'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:56.807468 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-11464201-a750-47d6-abe1-6e1d893b1930 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd119f2faf2d84e4fb4306f254f7111e3'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:56.814687 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1435/2862] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:30:56 2022] DELETE /identity/v3/users/d119f2faf2d84e4fb4306f254f7111e3 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:30:57.092641 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56f49f1-1499-4844-81f3-a40afd7b5159 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:57.094416 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-a56f49f1-1499-4844-81f3-a40afd7b5159 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:30:57.110236 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56f49f1-1499-4844-81f3-a40afd7b5159 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:57.178281 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92415003-1d45-45dd-abb8-7cc62432e91a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:57.178930 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92415003-1d45-45dd-abb8-7cc62432e91a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:57.179213 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92415003-1d45-45dd-abb8-7cc62432e91a admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:57.179478 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92415003-1d45-45dd-abb8-7cc62432e91a admin admin] PATH_INFO: `/v3/projects/adf19e032aed423083b27ccaa882c526` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:57.180663 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92415003-1d45-45dd-abb8-7cc62432e91a admin admin] RBAC: Authorizing `identity:delete_project(project_id=adf19e032aed423083b27ccaa882c526)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:57.182622 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92415003-1d45-45dd-abb8-7cc62432e91a admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:57.185187 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:30:57.230145 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-92415003-1d45-45dd-abb8-7cc62432e91a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adf19e032aed423083b27ccaa882c526', 'request_id': 'req-92415003-1d45-45dd-abb8-7cc62432e91a'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:57.235512 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-92415003-1d45-45dd-abb8-7cc62432e91a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adf19e032aed423083b27ccaa882c526', 'request_id': 'req-92415003-1d45-45dd-abb8-7cc62432e91a'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:57.241716 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-92415003-1d45-45dd-abb8-7cc62432e91a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adf19e032aed423083b27ccaa882c526', 'request_id': 'req-92415003-1d45-45dd-abb8-7cc62432e91a'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:57.254875 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-92415003-1d45-45dd-abb8-7cc62432e91a admin admin] The token cache is being invalidate because project adf19e032aed423083b27ccaa882c526 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:30:57.255163 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-92415003-1d45-45dd-abb8-7cc62432e91a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:57.255767 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-92415003-1d45-45dd-abb8-7cc62432e91a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:30:57.257243 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1428/2863] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:30:57 2022] DELETE /identity/v3/projects/adf19e032aed423083b27ccaa882c526 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:30:57.262077 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5900c7a6-0c99-47db-b989-f20e7626c671 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:57.262364 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5900c7a6-0c99-47db-b989-f20e7626c671 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:57.262639 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5900c7a6-0c99-47db-b989-f20e7626c671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:57.283469 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-5900c7a6-0c99-47db-b989-f20e7626c671 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:30:57.284659 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-5900c7a6-0c99-47db-b989-f20e7626c671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:30:57.347213 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1436/2864] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:30:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:30:57.354828 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee44598-aa18-400f-97c8-54469d6b0808 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:57.355108 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee44598-aa18-400f-97c8-54469d6b0808 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:57.355376 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee44598-aa18-400f-97c8-54469d6b0808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:57.374271 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-4ee44598-aa18-400f-97c8-54469d6b0808 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:30:57.376146 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-4ee44598-aa18-400f-97c8-54469d6b0808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:30:57.383825 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1429/2865] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:30:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:30:57.388015 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5900c7a6-0c99-47db-b989-f20e7626c671 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:57.398868 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5900c7a6-0c99-47db-b989-f20e7626c671 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:57.403487 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b312f8-ea0f-4bdc-87b0-b6f9dd54ae29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:57.404081 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b312f8-ea0f-4bdc-87b0-b6f9dd54ae29 admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:57.404356 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b312f8-ea0f-4bdc-87b0-b6f9dd54ae29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:57.404623 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b312f8-ea0f-4bdc-87b0-b6f9dd54ae29 admin admin] PATH_INFO: `/v3/domains` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:57.405263 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b312f8-ea0f-4bdc-87b0-b6f9dd54ae29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80105) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 09 10:30:57.405593 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b312f8-ea0f-4bdc-87b0-b6f9dd54ae29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:57.407380 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b312f8-ea0f-4bdc-87b0-b6f9dd54ae29 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:57.418683 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1437/2866] 10.222.0.36 () {58 vars in 1153 bytes} [Tue Aug 9 10:30:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 09 10:30:57.423116 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee44598-aa18-400f-97c8-54469d6b0808 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:57.432775 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee44598-aa18-400f-97c8-54469d6b0808 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:57.438411 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094014b9-948c-485b-a30a-6dc3121c5b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:57.438994 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094014b9-948c-485b-a30a-6dc3121c5b00 admin admin] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:57.439266 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094014b9-948c-485b-a30a-6dc3121c5b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:57.439529 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094014b9-948c-485b-a30a-6dc3121c5b00 admin admin] PATH_INFO: `/v3/projects` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:57.440134 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094014b9-948c-485b-a30a-6dc3121c5b00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:57.442018 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094014b9-948c-485b-a30a-6dc3121c5b00 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:57.470195 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1430/2867] 10.222.0.36 () {60 vars in 1153 bytes} [Tue Aug 9 10:30:57 2022] POST /identity/v3/projects => generated 399 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:30:57.474357 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b312f8-ea0f-4bdc-87b0-b6f9dd54ae29 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:57.484632 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b312f8-ea0f-4bdc-87b0-b6f9dd54ae29 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:57.539124 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf11d2cd-9746-4e5e-af4f-9415e0742c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:57.539732 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf11d2cd-9746-4e5e-af4f-9415e0742c16 admin admin] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:57.540012 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf11d2cd-9746-4e5e-af4f-9415e0742c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:57.540278 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf11d2cd-9746-4e5e-af4f-9415e0742c16 admin admin] PATH_INFO: `/v3/users` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:57.540912 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf11d2cd-9746-4e5e-af4f-9415e0742c16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:57.542845 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf11d2cd-9746-4e5e-af4f-9415e0742c16 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:57.566660 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1438/2868] 10.222.0.36 () {60 vars in 1144 bytes} [Tue Aug 9 10:30:57 2022] POST /identity/v3/users => generated 300 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 09 10:30:57.568084 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094014b9-948c-485b-a30a-6dc3121c5b00 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:57.578909 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094014b9-948c-485b-a30a-6dc3121c5b00 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:57.583561 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969fc927-9942-4374-9266-9275b0cd9e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:57.584152 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969fc927-9942-4374-9266-9275b0cd9e96 admin admin] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:57.584430 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969fc927-9942-4374-9266-9275b0cd9e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:57.584692 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969fc927-9942-4374-9266-9275b0cd9e96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:57.585320 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969fc927-9942-4374-9266-9275b0cd9e96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:57.586924 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969fc927-9942-4374-9266-9275b0cd9e96 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:57.597338 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1431/2869] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:30:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:30:57.601231 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf11d2cd-9746-4e5e-af4f-9415e0742c16 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:57.612611 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf11d2cd-9746-4e5e-af4f-9415e0742c16 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:57.617192 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139d8f6c-7649-450b-9a07-af8f24ed366e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:57.617806 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139d8f6c-7649-450b-9a07-af8f24ed366e admin admin] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:57.618098 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139d8f6c-7649-450b-9a07-af8f24ed366e admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:57.618366 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139d8f6c-7649-450b-9a07-af8f24ed366e admin admin] PATH_INFO: `/v3/roles` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:57.619001 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139d8f6c-7649-450b-9a07-af8f24ed366e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:57.620571 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139d8f6c-7649-450b-9a07-af8f24ed366e admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:57.631436 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1439/2870] 10.222.0.36 () {58 vars in 1122 bytes} [Tue Aug 9 10:30:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 09 10:30:57.635721 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969fc927-9942-4374-9266-9275b0cd9e96 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:57.645437 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969fc927-9942-4374-9266-9275b0cd9e96 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:57.650246 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a6a7dc-1745-4cdb-ba12-b19ee0e84a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:57.650877 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a6a7dc-1745-4cdb-ba12-b19ee0e84a42 admin admin] REQUEST_METHOD: `PUT` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:57.651176 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a6a7dc-1745-4cdb-ba12-b19ee0e84a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:57.651419 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a6a7dc-1745-4cdb-ba12-b19ee0e84a42 admin admin] PATH_INFO: `/v3/projects/6bf18a2224e84417a66bcaf3596f39ca/users/fcfb6906f3ff43d0a222478b71ab3e60/roles/a9895331e9694fa8b2b50908bb057bcb` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:57.665746 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a6a7dc-1745-4cdb-ba12-b19ee0e84a42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bf18a2224e84417a66bcaf3596f39ca, user_id=fcfb6906f3ff43d0a222478b71ab3e60, role_id=a9895331e9694fa8b2b50908bb057bcb)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:57.668451 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a6a7dc-1745-4cdb-ba12-b19ee0e84a42 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:57.681798 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1432/2871] 10.222.0.36 () {60 vars in 1483 bytes} [Tue Aug 9 10:30:57 2022] PUT /identity/v3/projects/6bf18a2224e84417a66bcaf3596f39ca/users/fcfb6906f3ff43d0a222478b71ab3e60/roles/a9895331e9694fa8b2b50908bb057bcb => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:30:57.692486 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072826ec-c3f7-4f20-9de0-d014cf27a733 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:57.693165 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072826ec-c3f7-4f20-9de0-d014cf27a733 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:57.693165 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072826ec-c3f7-4f20-9de0-d014cf27a733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:57.720786 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-072826ec-c3f7-4f20-9de0-d014cf27a733 None None] MFA Rules not processed for user `fcfb6906f3ff43d0a222478b71ab3e60`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:30:57.722011 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-072826ec-c3f7-4f20-9de0-d014cf27a733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:30:57.767100 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:30:57.789125 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1440/2872] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:30:57 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:30:57.801085 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a6a7dc-1745-4cdb-ba12-b19ee0e84a42 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:30:57.802768 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-a9a6a7dc-1745-4cdb-ba12-b19ee0e84a42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:30:57.864207 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a6a7dc-1745-4cdb-ba12-b19ee0e84a42 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:30:57.867704 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0215147-2522-4554-a740-cce70f829f1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6c687a38524de0bf23d87ae91d3b0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:30:57.868296 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0215147-2522-4554-a740-cce70f829f1f service cinder] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:30:57.868595 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0215147-2522-4554-a740-cce70f829f1f service cinder] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:30:57.868872 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0215147-2522-4554-a740-cce70f829f1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:30:57.877436 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0215147-2522-4554-a740-cce70f829f1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:30:57.878894 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0215147-2522-4554-a740-cce70f829f1f service cinder] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:30:57.887410 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1433/2873] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:30:57 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:31:02.888637 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072826ec-c3f7-4f20-9de0-d014cf27a733 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:31:02.951878 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072826ec-c3f7-4f20-9de0-d014cf27a733 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:31:02.961145 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a544f626-e082-4fcb-957f-c8790e769cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:31:02.961791 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544f626-e082-4fcb-957f-c8790e769cbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:31:02.962108 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544f626-e082-4fcb-957f-c8790e769cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:31:02.962383 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544f626-e082-4fcb-957f-c8790e769cbf admin admin] PATH_INFO: `/v3/users/fcfb6906f3ff43d0a222478b71ab3e60` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:31:02.963763 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a544f626-e082-4fcb-957f-c8790e769cbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcfb6906f3ff43d0a222478b71ab3e60)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:31:02.965689 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a544f626-e082-4fcb-957f-c8790e769cbf admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:31:03.015236 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-a544f626-e082-4fcb-957f-c8790e769cbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcfb6906f3ff43d0a222478b71ab3e60'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:31:03.027390 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-a544f626-e082-4fcb-957f-c8790e769cbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcfb6906f3ff43d0a222478b71ab3e60'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:31:03.035108 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-a544f626-e082-4fcb-957f-c8790e769cbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcfb6906f3ff43d0a222478b71ab3e60'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:31:03.035772 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-a544f626-e082-4fcb-957f-c8790e769cbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcfb6906f3ff43d0a222478b71ab3e60'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:31:03.042710 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-a544f626-e082-4fcb-957f-c8790e769cbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcfb6906f3ff43d0a222478b71ab3e60'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:31:03.048890 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1441/2874] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:31:02 2022] DELETE /identity/v3/users/fcfb6906f3ff43d0a222478b71ab3e60 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:31:03.053288 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354cc46d-69bf-4138-a6d5-97372fac3385 None None] REQUEST_METHOD: `POST` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:31:03.053788 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354cc46d-69bf-4138-a6d5-97372fac3385 None None] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:31:03.053919 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354cc46d-69bf-4138-a6d5-97372fac3385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:31:03.071758 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.auth.core [None req-354cc46d-69bf-4138-a6d5-97372fac3385 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80106) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:31:03.072933 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-354cc46d-69bf-4138-a6d5-97372fac3385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:31:03.098089 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:31:03.131724 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1434/2875] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:31:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:31:03.141131 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a544f626-e082-4fcb-957f-c8790e769cbf admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:31:03.142564 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-a544f626-e082-4fcb-957f-c8790e769cbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:31:03.202263 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a544f626-e082-4fcb-957f-c8790e769cbf admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:31:03.206733 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb7b8cc-d480-4eeb-b771-e45dd9fd5e9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:31:03.207340 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7b8cc-d480-4eeb-b771-e45dd9fd5e9b service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:31:03.207613 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7b8cc-d480-4eeb-b771-e45dd9fd5e9b service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:31:03.207881 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7b8cc-d480-4eeb-b771-e45dd9fd5e9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:31:03.216732 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb7b8cc-d480-4eeb-b771-e45dd9fd5e9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:31:03.218249 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb7b8cc-d480-4eeb-b771-e45dd9fd5e9b service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:31:03.227390 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1442/2876] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:31:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:31:03.503204 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354cc46d-69bf-4138-a6d5-97372fac3385 None None] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:31:03.505385 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-354cc46d-69bf-4138-a6d5-97372fac3385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:31:03.518216 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354cc46d-69bf-4138-a6d5-97372fac3385 None None] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:31:03.523417 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db6e0e2-fc86-4100-b706-60b797cb2c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:31:03.524056 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db6e0e2-fc86-4100-b706-60b797cb2c88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:31:03.524332 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db6e0e2-fc86-4100-b706-60b797cb2c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:31:03.524603 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db6e0e2-fc86-4100-b706-60b797cb2c88 admin admin] PATH_INFO: `/v3/projects/6bf18a2224e84417a66bcaf3596f39ca` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:31:03.525734 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db6e0e2-fc86-4100-b706-60b797cb2c88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bf18a2224e84417a66bcaf3596f39ca)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:31:03.527659 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db6e0e2-fc86-4100-b706-60b797cb2c88 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:31:03.574636 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-5db6e0e2-fc86-4100-b706-60b797cb2c88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bf18a2224e84417a66bcaf3596f39ca', 'request_id': 'req-5db6e0e2-fc86-4100-b706-60b797cb2c88'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:31:03.581037 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-5db6e0e2-fc86-4100-b706-60b797cb2c88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bf18a2224e84417a66bcaf3596f39ca', 'request_id': 'req-5db6e0e2-fc86-4100-b706-60b797cb2c88'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:31:03.587345 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-5db6e0e2-fc86-4100-b706-60b797cb2c88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bf18a2224e84417a66bcaf3596f39ca', 'request_id': 'req-5db6e0e2-fc86-4100-b706-60b797cb2c88'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:31:03.600265 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-5db6e0e2-fc86-4100-b706-60b797cb2c88 admin admin] The token cache is being invalidate because project 6bf18a2224e84417a66bcaf3596f39ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80106) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:31:03.600557 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-5db6e0e2-fc86-4100-b706-60b797cb2c88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:31:03.601161 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-5db6e0e2-fc86-4100-b706-60b797cb2c88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:31:03.602664 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1435/2877] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:31:03 2022] DELETE /identity/v3/projects/6bf18a2224e84417a66bcaf3596f39ca => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:31:07.698057 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b87278-c789-4739-926f-833103a9cf7b None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:31:07.698562 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b87278-c789-4739-926f-833103a9cf7b None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:31:07.698696 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b87278-c789-4739-926f-833103a9cf7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:31:07.707937 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:31:07.721379 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-51b87278-c789-4739-926f-833103a9cf7b None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:31:07.722651 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-51b87278-c789-4739-926f-833103a9cf7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:31:07.780093 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1443/2878] 10.222.0.30 () {58 vars in 1016 bytes} [Tue Aug 9 10:31:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:31:07.797506 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db6e0e2-fc86-4100-b706-60b797cb2c88 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:31:07.799002 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-5db6e0e2-fc86-4100-b706-60b797cb2c88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:31:07.875166 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db6e0e2-fc86-4100-b706-60b797cb2c88 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:31:07.880645 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e88ad7c-adb7-41ba-80f4-35a9e8f49c1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb863beaaa9f495c8b64655996c061f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:31:07.881238 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e88ad7c-adb7-41ba-80f4-35a9e8f49c1b service nova] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:31:07.881520 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e88ad7c-adb7-41ba-80f4-35a9e8f49c1b service nova] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:31:07.881794 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e88ad7c-adb7-41ba-80f4-35a9e8f49c1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:31:07.890285 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e88ad7c-adb7-41ba-80f4-35a9e8f49c1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:31:07.891983 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e88ad7c-adb7-41ba-80f4-35a9e8f49c1b service nova] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:31:07.901531 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1436/2879] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:31:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:31:10.702747 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1e0b9a-d500-4f5b-b555-b16fb47cddf7 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:31:10.703248 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1e0b9a-d500-4f5b-b555-b16fb47cddf7 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:31:10.703248 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1e0b9a-d500-4f5b-b555-b16fb47cddf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:31:10.723264 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-7d1e0b9a-d500-4f5b-b555-b16fb47cddf7 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:31:10.724462 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-7d1e0b9a-d500-4f5b-b555-b16fb47cddf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:31:10.732161 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1444/2880] 10.222.0.30 () {58 vars in 1016 bytes} [Tue Aug 9 10:31:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:31:10.745473 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e88ad7c-adb7-41ba-80f4-35a9e8f49c1b service nova] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:31:10.746934 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-6e88ad7c-adb7-41ba-80f4-35a9e8f49c1b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:31:10.762296 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e88ad7c-adb7-41ba-80f4-35a9e8f49c1b service nova] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:31:10.768238 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef778b73-cb2d-4cb3-9323-cdaaa6fe4c94 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb863beaaa9f495c8b64655996c061f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:31:10.768974 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef778b73-cb2d-4cb3-9323-cdaaa6fe4c94 service nova] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:31:10.769349 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef778b73-cb2d-4cb3-9323-cdaaa6fe4c94 service nova] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:31:10.769626 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef778b73-cb2d-4cb3-9323-cdaaa6fe4c94 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:31:10.778041 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef778b73-cb2d-4cb3-9323-cdaaa6fe4c94 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:31:10.779607 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef778b73-cb2d-4cb3-9323-cdaaa6fe4c94 service nova] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:31:10.789042 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1437/2881] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:31:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:31:13.958466 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020fd262-f6d9-4779-8d4a-b368f63d54f6 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:31:13.959006 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020fd262-f6d9-4779-8d4a-b368f63d54f6 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:31:13.959163 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020fd262-f6d9-4779-8d4a-b368f63d54f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:31:13.978829 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-020fd262-f6d9-4779-8d4a-b368f63d54f6 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:31:13.980069 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-020fd262-f6d9-4779-8d4a-b368f63d54f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:31:13.988668 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1445/2882] 10.222.0.30 () {58 vars in 1016 bytes} [Tue Aug 9 10:31:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:31:14.001977 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef778b73-cb2d-4cb3-9323-cdaaa6fe4c94 service nova] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:31:14.013158 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef778b73-cb2d-4cb3-9323-cdaaa6fe4c94 service nova] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:31:14.019144 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84cc4a0-0071-44c3-9a40-fa125ab62b73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb863beaaa9f495c8b64655996c061f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:31:14.019723 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84cc4a0-0071-44c3-9a40-fa125ab62b73 service nova] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:31:14.019997 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84cc4a0-0071-44c3-9a40-fa125ab62b73 service nova] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:31:14.020265 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84cc4a0-0071-44c3-9a40-fa125ab62b73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:31:14.028589 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84cc4a0-0071-44c3-9a40-fa125ab62b73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:31:14.031088 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84cc4a0-0071-44c3-9a40-fa125ab62b73 service nova] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:31:14.040393 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1438/2883] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:31:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:31:17.055603 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19039be1-19b8-4697-b3f1-39eb6fdaf439 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:31:17.056107 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19039be1-19b8-4697-b3f1-39eb6fdaf439 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:31:17.056219 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19039be1-19b8-4697-b3f1-39eb6fdaf439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:31:17.075501 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-19039be1-19b8-4697-b3f1-39eb6fdaf439 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:31:17.076704 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-19039be1-19b8-4697-b3f1-39eb6fdaf439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:31:17.084638 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1446/2884] 10.222.0.30 () {58 vars in 1016 bytes} [Tue Aug 9 10:31:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:31:17.100029 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84cc4a0-0071-44c3-9a40-fa125ab62b73 service nova] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:31:17.111750 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84cc4a0-0071-44c3-9a40-fa125ab62b73 service nova] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:31:17.117053 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9860fb-aa4f-478a-80b0-e19833e7b37a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb863beaaa9f495c8b64655996c061f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:31:17.117630 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9860fb-aa4f-478a-80b0-e19833e7b37a service nova] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:31:17.117941 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9860fb-aa4f-478a-80b0-e19833e7b37a service nova] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:31:17.118212 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9860fb-aa4f-478a-80b0-e19833e7b37a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:31:17.126701 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9860fb-aa4f-478a-80b0-e19833e7b37a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:31:17.128244 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9860fb-aa4f-478a-80b0-e19833e7b37a service nova] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:31:17.132992 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:31:17.138033 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1439/2885] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:31:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:31:25.356398 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6241a4fa-53bc-4347-b3ee-e1b097ffb063 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:31:25.356897 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6241a4fa-53bc-4347-b3ee-e1b097ffb063 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:31:25.357009 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6241a4fa-53bc-4347-b3ee-e1b097ffb063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:31:25.377485 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-6241a4fa-53bc-4347-b3ee-e1b097ffb063 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:31:25.378698 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-6241a4fa-53bc-4347-b3ee-e1b097ffb063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:31:25.386380 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1447/2886] 10.222.0.30 () {58 vars in 1016 bytes} [Tue Aug 9 10:31:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:31:25.410600 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9860fb-aa4f-478a-80b0-e19833e7b37a service nova] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:31:25.423067 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9860fb-aa4f-478a-80b0-e19833e7b37a service nova] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:31:25.428548 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d785d3ec-6854-4b82-91bb-f062f81c22d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb863beaaa9f495c8b64655996c061f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:31:25.429158 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d785d3ec-6854-4b82-91bb-f062f81c22d2 service nova] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:31:25.429463 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d785d3ec-6854-4b82-91bb-f062f81c22d2 service nova] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:31:25.429735 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d785d3ec-6854-4b82-91bb-f062f81c22d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:31:25.437661 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d785d3ec-6854-4b82-91bb-f062f81c22d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:31:25.439324 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d785d3ec-6854-4b82-91bb-f062f81c22d2 service nova] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:31:25.448354 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1440/2887] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:31:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:31:28.517686 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c01e42-2552-45e7-b0ae-cdf0edab7ccd None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:31:28.518231 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c01e42-2552-45e7-b0ae-cdf0edab7ccd None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:31:28.518339 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c01e42-2552-45e7-b0ae-cdf0edab7ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:31:28.537732 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-62c01e42-2552-45e7-b0ae-cdf0edab7ccd None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:31:28.538926 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-62c01e42-2552-45e7-b0ae-cdf0edab7ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:31:28.546585 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1448/2888] 10.222.0.30 () {58 vars in 1016 bytes} [Tue Aug 9 10:31:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:31:28.564826 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d785d3ec-6854-4b82-91bb-f062f81c22d2 service nova] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:31:28.576461 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d785d3ec-6854-4b82-91bb-f062f81c22d2 service nova] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:31:28.582716 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c39fb76-b3b8-41b0-9f14-03fe5dae6388 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb863beaaa9f495c8b64655996c061f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:31:28.583305 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c39fb76-b3b8-41b0-9f14-03fe5dae6388 service nova] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:31:28.583591 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c39fb76-b3b8-41b0-9f14-03fe5dae6388 service nova] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:31:28.583860 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c39fb76-b3b8-41b0-9f14-03fe5dae6388 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:31:28.591847 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c39fb76-b3b8-41b0-9f14-03fe5dae6388 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:31:28.594052 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c39fb76-b3b8-41b0-9f14-03fe5dae6388 service nova] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:31:28.603618 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1441/2889] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:31:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:31:38.533209 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=40 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:31:38.599108 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=12 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:31:42.659595 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bf2f2f-1645-44cd-a030-11344a2ce20c None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:31:42.660203 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bf2f2f-1645-44cd-a030-11344a2ce20c None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:31:42.660203 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bf2f2f-1645-44cd-a030-11344a2ce20c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:31:42.690134 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-39bf2f2f-1645-44cd-a030-11344a2ce20c None None] MFA Rules not processed for user `53bc8f8fcced45d2ba44040c2d0a366d`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:31:42.691351 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-39bf2f2f-1645-44cd-a030-11344a2ce20c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:31:42.767928 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1449/2890] 10.222.0.36 () {58 vars in 958 bytes} [Tue Aug 9 10:31:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:31:43.780656 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c39fb76-b3b8-41b0-9f14-03fe5dae6388 service nova] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:31:43.782159 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-4c39fb76-b3b8-41b0-9f14-03fe5dae6388 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:31:43.911082 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c39fb76-b3b8-41b0-9f14-03fe5dae6388 service nova] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:31:43.916474 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586ccb09-eaf6-4da3-a1a9-f2b681fc4b47 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4d3b6a332394adf9e1b81ee9c171c48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:31:43.917070 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586ccb09-eaf6-4da3-a1a9-f2b681fc4b47 service placement] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:31:43.917350 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586ccb09-eaf6-4da3-a1a9-f2b681fc4b47 service placement] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:31:43.917618 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586ccb09-eaf6-4da3-a1a9-f2b681fc4b47 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:31:43.919368 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-586ccb09-eaf6-4da3-a1a9-f2b681fc4b47 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:31:43.930849 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586ccb09-eaf6-4da3-a1a9-f2b681fc4b47 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:31:43.932417 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586ccb09-eaf6-4da3-a1a9-f2b681fc4b47 service placement] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:31:43.942678 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1442/2891] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:31:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:31:52.765589 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=37 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:31:53.301027 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18523015-ace0-4b8a-bbd4-196a341cc5f3 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:31:53.301266 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18523015-ace0-4b8a-bbd4-196a341cc5f3 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:31:53.301544 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18523015-ace0-4b8a-bbd4-196a341cc5f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:31:53.372435 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-18523015-ace0-4b8a-bbd4-196a341cc5f3 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:31:53.373656 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-18523015-ace0-4b8a-bbd4-196a341cc5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:31:53.400947 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1450/2892] 10.222.0.30 () {58 vars in 1016 bytes} [Tue Aug 9 10:31:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 09 10:31:53.417105 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586ccb09-eaf6-4da3-a1a9-f2b681fc4b47 service placement] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:31:53.445325 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586ccb09-eaf6-4da3-a1a9-f2b681fc4b47 service placement] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:31:53.450870 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07829e5f-67bd-4580-9856-678b5a7f0a1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb863beaaa9f495c8b64655996c061f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:31:53.451468 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07829e5f-67bd-4580-9856-678b5a7f0a1b service nova] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:31:53.451744 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07829e5f-67bd-4580-9856-678b5a7f0a1b service nova] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:31:53.452013 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07829e5f-67bd-4580-9856-678b5a7f0a1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:31:53.460823 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07829e5f-67bd-4580-9856-678b5a7f0a1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:31:53.462539 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07829e5f-67bd-4580-9856-678b5a7f0a1b service nova] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:31:53.472702 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1443/2893] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:31:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:31:56.556037 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c8320-a12b-4a4b-865a-8299c9c2eb50 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:31:56.556562 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c8320-a12b-4a4b-865a-8299c9c2eb50 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:31:56.556562 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c8320-a12b-4a4b-865a-8299c9c2eb50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:31:56.575927 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-942c8320-a12b-4a4b-865a-8299c9c2eb50 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:31:56.577104 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-942c8320-a12b-4a4b-865a-8299c9c2eb50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:31:56.585882 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1451/2894] 10.222.0.30 () {58 vars in 1016 bytes} [Tue Aug 9 10:31:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:31:56.601204 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07829e5f-67bd-4580-9856-678b5a7f0a1b service nova] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:31:56.612208 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07829e5f-67bd-4580-9856-678b5a7f0a1b service nova] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:31:56.617520 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fb5e41-967d-4fb2-b535-bc6c36f7838d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb863beaaa9f495c8b64655996c061f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:31:56.618135 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb5e41-967d-4fb2-b535-bc6c36f7838d service nova] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:31:56.618412 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb5e41-967d-4fb2-b535-bc6c36f7838d service nova] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:31:56.618681 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb5e41-967d-4fb2-b535-bc6c36f7838d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:31:56.627053 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fb5e41-967d-4fb2-b535-bc6c36f7838d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:31:56.628706 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fb5e41-967d-4fb2-b535-bc6c36f7838d service nova] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:31:56.637792 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1444/2895] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:31:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:31:59.646821 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d3e94e-c4db-4f1e-bb1f-c7cf721fba27 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:31:59.647335 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d3e94e-c4db-4f1e-bb1f-c7cf721fba27 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:31:59.647335 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d3e94e-c4db-4f1e-bb1f-c7cf721fba27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:31:59.666322 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-64d3e94e-c4db-4f1e-bb1f-c7cf721fba27 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:31:59.667499 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-64d3e94e-c4db-4f1e-bb1f-c7cf721fba27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:31:59.675377 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1452/2896] 10.222.0.30 () {58 vars in 1016 bytes} [Tue Aug 9 10:31:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:31:59.691722 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fb5e41-967d-4fb2-b535-bc6c36f7838d service nova] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:31:59.702891 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fb5e41-967d-4fb2-b535-bc6c36f7838d service nova] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:31:59.708972 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18918b55-368c-4565-b258-ae75323a96c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb863beaaa9f495c8b64655996c061f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:31:59.709546 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18918b55-368c-4565-b258-ae75323a96c3 service nova] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:31:59.709818 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18918b55-368c-4565-b258-ae75323a96c3 service nova] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:31:59.710112 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18918b55-368c-4565-b258-ae75323a96c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:31:59.718763 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18918b55-368c-4565-b258-ae75323a96c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:31:59.720610 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18918b55-368c-4565-b258-ae75323a96c3 service nova] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:31:59.730281 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1445/2897] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:31:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:32:02.804293 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce49be5-b66c-4b85-86e4-523a9ccfdbf3 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:32:02.804789 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce49be5-b66c-4b85-86e4-523a9ccfdbf3 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:32:02.804902 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce49be5-b66c-4b85-86e4-523a9ccfdbf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:32:02.824856 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-dce49be5-b66c-4b85-86e4-523a9ccfdbf3 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:32:02.826104 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-dce49be5-b66c-4b85-86e4-523a9ccfdbf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:32:02.833979 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1453/2898] 10.222.0.30 () {58 vars in 1016 bytes} [Tue Aug 9 10:32:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:32:02.856916 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18918b55-368c-4565-b258-ae75323a96c3 service nova] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:32:02.868419 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18918b55-368c-4565-b258-ae75323a96c3 service nova] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:32:02.873773 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881afe26-5f7c-4217-8d75-c362d9e519e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb863beaaa9f495c8b64655996c061f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:32:02.874383 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881afe26-5f7c-4217-8d75-c362d9e519e6 service nova] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:32:02.874662 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881afe26-5f7c-4217-8d75-c362d9e519e6 service nova] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:32:02.874930 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881afe26-5f7c-4217-8d75-c362d9e519e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:32:02.883521 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881afe26-5f7c-4217-8d75-c362d9e519e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:32:02.885138 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881afe26-5f7c-4217-8d75-c362d9e519e6 service nova] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:32:02.894369 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1446/2899] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:32:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:32:05.983987 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d95c4f0-d18a-479b-94fc-8f2f6089d7e7 None None] REQUEST_METHOD: `POST` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:32:05.984463 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d95c4f0-d18a-479b-94fc-8f2f6089d7e7 None None] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:32:05.984606 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d95c4f0-d18a-479b-94fc-8f2f6089d7e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:32:06.004878 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.auth.core [None req-5d95c4f0-d18a-479b-94fc-8f2f6089d7e7 None None] MFA Rules not processed for user `f678c8c3c6754b9a81efff6e9db8f623`. Rule list: `[]` (Enabled: `True`). {{(pid=80105) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 09 10:32:06.006117 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-5d95c4f0-d18a-479b-94fc-8f2f6089d7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:32:06.014139 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1454/2900] 10.222.0.30 () {58 vars in 1016 bytes} [Tue Aug 9 10:32:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 09 10:32:06.031655 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881afe26-5f7c-4217-8d75-c362d9e519e6 service nova] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:32:06.043829 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881afe26-5f7c-4217-8d75-c362d9e519e6 service nova] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:32:06.049146 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee608fdb-2c79-4b1c-8cd9-83b1c1e6df97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb863beaaa9f495c8b64655996c061f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:32:06.049723 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee608fdb-2c79-4b1c-8cd9-83b1c1e6df97 service nova] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:32:06.050043 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee608fdb-2c79-4b1c-8cd9-83b1c1e6df97 service nova] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:32:06.050312 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee608fdb-2c79-4b1c-8cd9-83b1c1e6df97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:32:06.058758 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee608fdb-2c79-4b1c-8cd9-83b1c1e6df97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:32:06.060522 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee608fdb-2c79-4b1c-8cd9-83b1c1e6df97 service nova] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:32:06.071636 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1447/2901] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:32:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:32:15.999522 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=42 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:32:16.066487 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=96 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:32:33.750302 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d95c4f0-d18a-479b-94fc-8f2f6089d7e7 None None] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:32:33.762405 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d95c4f0-d18a-479b-94fc-8f2f6089d7e7 None None] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:32:33.767539 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb61aec-325b-4d03-8283-f6342ea7395a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4d3b6a332394adf9e1b81ee9c171c48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:32:33.768274 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb61aec-325b-4d03-8283-f6342ea7395a service placement] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:32:33.768646 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb61aec-325b-4d03-8283-f6342ea7395a service placement] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:32:33.769014 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb61aec-325b-4d03-8283-f6342ea7395a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:32:33.771229 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-afb61aec-325b-4d03-8283-f6342ea7395a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:32:33.782950 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb61aec-325b-4d03-8283-f6342ea7395a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:32:33.784535 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb61aec-325b-4d03-8283-f6342ea7395a service placement] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:32:33.794738 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1455/2902] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:32:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:32:33.817483 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee608fdb-2c79-4b1c-8cd9-83b1c1e6df97 service nova] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:32:33.818985 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-ee608fdb-2c79-4b1c-8cd9-83b1c1e6df97 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:32:33.836198 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee608fdb-2c79-4b1c-8cd9-83b1c1e6df97 service nova] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:32:33.842883 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a0cac0-6e30-4294-afb8-31dc53c7506d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:32:33.843499 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a0cac0-6e30-4294-afb8-31dc53c7506d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:32:33.843780 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a0cac0-6e30-4294-afb8-31dc53c7506d admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:32:33.844044 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a0cac0-6e30-4294-afb8-31dc53c7506d admin admin] PATH_INFO: `/v3/users/53bc8f8fcced45d2ba44040c2d0a366d` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:32:33.845142 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a0cac0-6e30-4294-afb8-31dc53c7506d admin admin] RBAC: Authorizing `identity:delete_user(user_id=53bc8f8fcced45d2ba44040c2d0a366d)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:32:33.847095 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a0cac0-6e30-4294-afb8-31dc53c7506d admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:32:33.894557 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-89a0cac0-6e30-4294-afb8-31dc53c7506d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53bc8f8fcced45d2ba44040c2d0a366d'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:32:33.907253 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-89a0cac0-6e30-4294-afb8-31dc53c7506d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53bc8f8fcced45d2ba44040c2d0a366d'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:32:33.914429 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-89a0cac0-6e30-4294-afb8-31dc53c7506d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53bc8f8fcced45d2ba44040c2d0a366d'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:32:33.915083 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-89a0cac0-6e30-4294-afb8-31dc53c7506d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53bc8f8fcced45d2ba44040c2d0a366d'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:32:33.922079 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-89a0cac0-6e30-4294-afb8-31dc53c7506d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53bc8f8fcced45d2ba44040c2d0a366d'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:32:33.928356 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1448/2903] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:32:33 2022] DELETE /identity/v3/users/53bc8f8fcced45d2ba44040c2d0a366d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:32:34.097619 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb61aec-325b-4d03-8283-f6342ea7395a service placement] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:32:34.109076 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb61aec-325b-4d03-8283-f6342ea7395a service placement] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:32:34.169430 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb536b36-16a1-46b9-bc2b-2cafbd77aa20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:32:34.170150 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb536b36-16a1-46b9-bc2b-2cafbd77aa20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:32:34.170424 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb536b36-16a1-46b9-bc2b-2cafbd77aa20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:32:34.170693 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb536b36-16a1-46b9-bc2b-2cafbd77aa20 admin admin] PATH_INFO: `/v3/projects/af8d90679cf54ab4ae1840c7ea2b6507` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:32:34.171803 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb536b36-16a1-46b9-bc2b-2cafbd77aa20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af8d90679cf54ab4ae1840c7ea2b6507)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:32:34.173692 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb536b36-16a1-46b9-bc2b-2cafbd77aa20 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:32:34.219484 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-bb536b36-16a1-46b9-bc2b-2cafbd77aa20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af8d90679cf54ab4ae1840c7ea2b6507', 'request_id': 'req-bb536b36-16a1-46b9-bc2b-2cafbd77aa20'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:32:34.225924 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-bb536b36-16a1-46b9-bc2b-2cafbd77aa20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af8d90679cf54ab4ae1840c7ea2b6507', 'request_id': 'req-bb536b36-16a1-46b9-bc2b-2cafbd77aa20'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:32:34.231936 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-bb536b36-16a1-46b9-bc2b-2cafbd77aa20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af8d90679cf54ab4ae1840c7ea2b6507', 'request_id': 'req-bb536b36-16a1-46b9-bc2b-2cafbd77aa20'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:32:34.244919 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-bb536b36-16a1-46b9-bc2b-2cafbd77aa20 admin admin] The token cache is being invalidate because project af8d90679cf54ab4ae1840c7ea2b6507 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80105) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:32:34.245178 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-bb536b36-16a1-46b9-bc2b-2cafbd77aa20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:32:34.245801 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-bb536b36-16a1-46b9-bc2b-2cafbd77aa20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:32:34.247283 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1456/2904] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:32:34 2022] DELETE /identity/v3/projects/af8d90679cf54ab4ae1840c7ea2b6507 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:32:40.449243 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a0cac0-6e30-4294-afb8-31dc53c7506d admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:32:40.450819 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-89a0cac0-6e30-4294-afb8-31dc53c7506d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:32:40.530020 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a0cac0-6e30-4294-afb8-31dc53c7506d admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:32:40.579782 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af3b18a-925e-491f-ab41-aefa2e84596d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:32:40.580379 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af3b18a-925e-491f-ab41-aefa2e84596d service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:32:40.580649 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af3b18a-925e-491f-ab41-aefa2e84596d service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:32:40.580913 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af3b18a-925e-491f-ab41-aefa2e84596d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:32:40.582747 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-3af3b18a-925e-491f-ab41-aefa2e84596d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:32:40.592326 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af3b18a-925e-491f-ab41-aefa2e84596d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:32:40.593747 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af3b18a-925e-491f-ab41-aefa2e84596d service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:32:40.602135 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1449/2905] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:32:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:32:40.675730 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb536b36-16a1-46b9-bc2b-2cafbd77aa20 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:32:40.677158 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-bb536b36-16a1-46b9-bc2b-2cafbd77aa20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:32:40.690149 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb536b36-16a1-46b9-bc2b-2cafbd77aa20 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:32:40.693824 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62041c52-cdbf-4a2f-be24-c46601486666 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:32:40.694462 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62041c52-cdbf-4a2f-be24-c46601486666 service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:32:40.694742 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62041c52-cdbf-4a2f-be24-c46601486666 service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:32:40.695015 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62041c52-cdbf-4a2f-be24-c46601486666 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:32:40.696673 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-62041c52-cdbf-4a2f-be24-c46601486666 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:32:40.765548 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:32:40.781533 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62041c52-cdbf-4a2f-be24-c46601486666 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:32:40.782999 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62041c52-cdbf-4a2f-be24-c46601486666 service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:32:40.797264 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1457/2906] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:32:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:32:50.598047 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=84,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:32:50.789488 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=4 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:33:56.408337 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af3b18a-925e-491f-ab41-aefa2e84596d service neutron] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:33:56.410439 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-3af3b18a-925e-491f-ab41-aefa2e84596d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:33:56.422325 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af3b18a-925e-491f-ab41-aefa2e84596d service neutron] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:33:56.426045 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68647d6e-f13a-47f3-9a74-5e3d0490d5a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:33:56.426636 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68647d6e-f13a-47f3-9a74-5e3d0490d5a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:33:56.426908 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68647d6e-f13a-47f3-9a74-5e3d0490d5a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:33:56.427174 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68647d6e-f13a-47f3-9a74-5e3d0490d5a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:33:56.428995 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-68647d6e-f13a-47f3-9a74-5e3d0490d5a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:33:56.442829 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68647d6e-f13a-47f3-9a74-5e3d0490d5a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:33:56.444240 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68647d6e-f13a-47f3-9a74-5e3d0490d5a4 service neutron] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:33:56.455263 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1450/2907] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:33:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:33:57.646632 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62041c52-cdbf-4a2f-be24-c46601486666 service neutron] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:33:57.655422 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62041c52-cdbf-4a2f-be24-c46601486666 service neutron] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:33:57.659443 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d975d3-c771-472c-9ab2-722c24d3c0f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9169847a16764da3a2a1dbb5f5f56438', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:33:57.660051 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d975d3-c771-472c-9ab2-722c24d3c0f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:33:57.660359 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d975d3-c771-472c-9ab2-722c24d3c0f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:33:57.660634 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d975d3-c771-472c-9ab2-722c24d3c0f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:33:57.662432 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-94d975d3-c771-472c-9ab2-722c24d3c0f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:33:57.677904 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d975d3-c771-472c-9ab2-722c24d3c0f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:33:57.679345 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d975d3-c771-472c-9ab2-722c24d3c0f9 service neutron] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:33:57.691390 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1458/2908] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:33:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:34:05.476913 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68647d6e-f13a-47f3-9a74-5e3d0490d5a4 service neutron] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:34:05.478547 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-68647d6e-f13a-47f3-9a74-5e3d0490d5a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:34:05.549218 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68647d6e-f13a-47f3-9a74-5e3d0490d5a4 service neutron] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:34:05.553720 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51acc9a1-27e1-4b61-adc8-b639e67d2b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:34:05.554361 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51acc9a1-27e1-4b61-adc8-b639e67d2b4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:34:05.554640 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51acc9a1-27e1-4b61-adc8-b639e67d2b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:34:05.554910 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51acc9a1-27e1-4b61-adc8-b639e67d2b4c admin admin] PATH_INFO: `/v3/users/7821ddf3db39402cbb243eef34829c45` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:34:05.556010 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51acc9a1-27e1-4b61-adc8-b639e67d2b4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7821ddf3db39402cbb243eef34829c45)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:34:05.558496 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51acc9a1-27e1-4b61-adc8-b639e67d2b4c admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:34:05.605163 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-51acc9a1-27e1-4b61-adc8-b639e67d2b4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7821ddf3db39402cbb243eef34829c45'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:34:05.616692 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-51acc9a1-27e1-4b61-adc8-b639e67d2b4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7821ddf3db39402cbb243eef34829c45'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:34:05.623787 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-51acc9a1-27e1-4b61-adc8-b639e67d2b4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7821ddf3db39402cbb243eef34829c45'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:34:05.624459 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-51acc9a1-27e1-4b61-adc8-b639e67d2b4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7821ddf3db39402cbb243eef34829c45'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:34:05.631349 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-51acc9a1-27e1-4b61-adc8-b639e67d2b4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7821ddf3db39402cbb243eef34829c45'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:34:05.637904 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1451/2909] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:34:05 2022] DELETE /identity/v3/users/7821ddf3db39402cbb243eef34829c45 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:34:05.821264 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d975d3-c771-472c-9ab2-722c24d3c0f9 service neutron] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:34:05.834169 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d975d3-c771-472c-9ab2-722c24d3c0f9 service neutron] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:34:05.892453 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f994d598-a4e9-49c7-bb76-00e7133da805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:34:05.892994 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f994d598-a4e9-49c7-bb76-00e7133da805 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:34:05.893268 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f994d598-a4e9-49c7-bb76-00e7133da805 admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:34:05.893539 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f994d598-a4e9-49c7-bb76-00e7133da805 admin admin] PATH_INFO: `/v3/projects/7c30224de88f4d41999346193e4e7ab9` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:34:05.894995 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f994d598-a4e9-49c7-bb76-00e7133da805 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c30224de88f4d41999346193e4e7ab9)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:34:05.896870 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f994d598-a4e9-49c7-bb76-00e7133da805 admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:34:05.942444 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-f994d598-a4e9-49c7-bb76-00e7133da805 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c30224de88f4d41999346193e4e7ab9', 'request_id': 'req-f994d598-a4e9-49c7-bb76-00e7133da805'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:34:05.948984 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-f994d598-a4e9-49c7-bb76-00e7133da805 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c30224de88f4d41999346193e4e7ab9', 'request_id': 'req-f994d598-a4e9-49c7-bb76-00e7133da805'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:34:05.955071 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-f994d598-a4e9-49c7-bb76-00e7133da805 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c30224de88f4d41999346193e4e7ab9', 'request_id': 'req-f994d598-a4e9-49c7-bb76-00e7133da805'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:34:05.968049 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-f994d598-a4e9-49c7-bb76-00e7133da805 admin admin] The token cache is being invalidate because project 7c30224de88f4d41999346193e4e7ab9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80105) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:34:05.968341 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-f994d598-a4e9-49c7-bb76-00e7133da805 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:34:05.968952 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-f994d598-a4e9-49c7-bb76-00e7133da805 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:34:05.970461 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1459/2910] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:34:05 2022] DELETE /identity/v3/projects/7c30224de88f4d41999346193e4e7ab9 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:34:05.974506 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51acc9a1-27e1-4b61-adc8-b639e67d2b4c admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:34:05.975914 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-51acc9a1-27e1-4b61-adc8-b639e67d2b4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:34:05.989256 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51acc9a1-27e1-4b61-adc8-b639e67d2b4c admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:34:06.044128 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd25b8b9-b553-4a6e-8ab4-8a70aa23b173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:34:06.044747 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd25b8b9-b553-4a6e-8ab4-8a70aa23b173 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:34:06.045024 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd25b8b9-b553-4a6e-8ab4-8a70aa23b173 admin admin] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:34:06.045294 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd25b8b9-b553-4a6e-8ab4-8a70aa23b173 admin admin] PATH_INFO: `/v3/users/aff294ffdd1e47e1841d07913c968c19` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:34:06.046441 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd25b8b9-b553-4a6e-8ab4-8a70aa23b173 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aff294ffdd1e47e1841d07913c968c19)` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:34:06.048343 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd25b8b9-b553-4a6e-8ab4-8a70aa23b173 admin admin] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:34:06.053461 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:34:06.099772 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-bd25b8b9-b553-4a6e-8ab4-8a70aa23b173 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aff294ffdd1e47e1841d07913c968c19'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:34:06.112318 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-bd25b8b9-b553-4a6e-8ab4-8a70aa23b173 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aff294ffdd1e47e1841d07913c968c19'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:34:06.119129 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-bd25b8b9-b553-4a6e-8ab4-8a70aa23b173 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aff294ffdd1e47e1841d07913c968c19'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:34:06.119771 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-bd25b8b9-b553-4a6e-8ab4-8a70aa23b173 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aff294ffdd1e47e1841d07913c968c19'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:34:06.126937 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.notifications [None req-bd25b8b9-b553-4a6e-8ab4-8a70aa23b173 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aff294ffdd1e47e1841d07913c968c19'} {{(pid=80106) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:34:06.132656 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1452/2911] 10.222.0.36 () {58 vars in 1224 bytes} [Tue Aug 9 10:34:05 2022] DELETE /identity/v3/users/aff294ffdd1e47e1841d07913c968c19 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:34:06.307818 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f994d598-a4e9-49c7-bb76-00e7133da805 admin admin] Authenticating user token {{(pid=80105) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:34:06.309399 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.fernet_utils [None req-f994d598-a4e9-49c7-bb76-00e7133da805 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80105) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:34:06.323548 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f994d598-a4e9-49c7-bb76-00e7133da805 admin admin] Validating token access rules against request {{(pid=80105) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:34:06.382015 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f121317-b00d-45ac-a174-4bd29dbbbf8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f678c8c3c6754b9a81efff6e9db8f623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '182565a8c7ef44d4a6cfcadb2f45a71f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80105) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:34:06.382649 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f121317-b00d-45ac-a174-4bd29dbbbf8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:34:06.382927 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f121317-b00d-45ac-a174-4bd29dbbbf8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:34:06.383200 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f121317-b00d-45ac-a174-4bd29dbbbf8b admin admin] PATH_INFO: `/v3/projects/fc7a83c19bb545228268d19084c66a1a` {{(pid=80105) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:34:06.384304 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f121317-b00d-45ac-a174-4bd29dbbbf8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc7a83c19bb545228268d19084c66a1a)` {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:34:06.386785 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f121317-b00d-45ac-a174-4bd29dbbbf8b admin admin] RBAC: Authorization granted {{(pid=80105) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:34:06.408632 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:34:06.435540 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-0f121317-b00d-45ac-a174-4bd29dbbbf8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc7a83c19bb545228268d19084c66a1a', 'request_id': 'req-0f121317-b00d-45ac-a174-4bd29dbbbf8b'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:34:06.441054 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-0f121317-b00d-45ac-a174-4bd29dbbbf8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc7a83c19bb545228268d19084c66a1a', 'request_id': 'req-0f121317-b00d-45ac-a174-4bd29dbbbf8b'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:34:06.447112 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-0f121317-b00d-45ac-a174-4bd29dbbbf8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc7a83c19bb545228268d19084c66a1a', 'request_id': 'req-0f121317-b00d-45ac-a174-4bd29dbbbf8b'} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:34:06.458497 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-0f121317-b00d-45ac-a174-4bd29dbbbf8b admin admin] The token cache is being invalidate because project fc7a83c19bb545228268d19084c66a1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80105) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 09 10:34:06.458789 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-0f121317-b00d-45ac-a174-4bd29dbbbf8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:34:06.459407 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG keystone.notifications [None req-0f121317-b00d-45ac-a174-4bd29dbbbf8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80105) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 09 10:34:06.460990 dv-cinder-852364-2-smb devstack@keystone.service[80105]: [pid: 80105|app: 0|req: 1460/2912] 10.222.0.36 () {58 vars in 1233 bytes} [Tue Aug 9 10:34:06 2022] DELETE /identity/v3/projects/fc7a83c19bb545228268d19084c66a1a => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 09 10:34:16.129263 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=23,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:34:16.455390 dv-cinder-852364-2-smb devstack@keystone.service[80105]: DEBUG dbcounter [-] [80105] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80105) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 10:36:46.824218 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd25b8b9-b553-4a6e-8ab4-8a70aa23b173 admin admin] Authenticating user token {{(pid=80106) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 09 10:36:46.825715 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-bd25b8b9-b553-4a6e-8ab4-8a70aa23b173 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:36:46.893866 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd25b8b9-b553-4a6e-8ab4-8a70aa23b173 admin admin] Validating token access rules against request {{(pid=80106) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 09 10:36:46.950933 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432f7f0d-db2e-4eae-9ac4-5e2734f59209 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4d3b6a332394adf9e1b81ee9c171c48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28891cf6239a43469326a864fb0d216c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80106) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 09 10:36:46.951534 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432f7f0d-db2e-4eae-9ac4-5e2734f59209 service placement] REQUEST_METHOD: `GET` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 09 10:36:46.951812 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432f7f0d-db2e-4eae-9ac4-5e2734f59209 service placement] SCRIPT_NAME: `/identity` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 09 10:36:46.952082 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432f7f0d-db2e-4eae-9ac4-5e2734f59209 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80106) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 09 10:36:46.953806 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.fernet_utils [None req-432f7f0d-db2e-4eae-9ac4-5e2734f59209 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80106) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 09 10:36:46.965317 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432f7f0d-db2e-4eae-9ac4-5e2734f59209 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 09 10:36:46.966942 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432f7f0d-db2e-4eae-9ac4-5e2734f59209 service placement] RBAC: Authorization granted {{(pid=80106) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 09 10:36:46.977426 dv-cinder-852364-2-smb devstack@keystone.service[80106]: [pid: 80106|app: 0|req: 1453/2913] 10.222.0.36 () {60 vars in 1365 bytes} [Tue Aug 9 10:36:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 09 10:36:56.973192 dv-cinder-852364-2-smb devstack@keystone.service[80106]: DEBUG dbcounter [-] [80106] Writing DB stats keystone:SELECT=58 {{(pid=80106) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}